Sep 11 12:53:41.893449 ip-10-0-133-79 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 11 12:53:41.893459 ip-10-0-133-79 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 11 12:53:41.893469 ip-10-0-133-79 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 11 12:53:41.893836 ip-10-0-133-79 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 11 12:53:52.985998 ip-10-0-133-79 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 11 12:53:52.986018 ip-10-0-133-79 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 1aa9c5c31f624f0ebc36f413ad859766 --
Sep 11 12:55:33.017047 ip-10-0-133-79 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 12:55:33.450244 ip-10-0-133-79 kubenswrapper[2547]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 12:55:33.450244 ip-10-0-133-79 kubenswrapper[2547]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 12:55:33.450244 ip-10-0-133-79 kubenswrapper[2547]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 12:55:33.450244 ip-10-0-133-79 kubenswrapper[2547]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 12:55:33.450244 ip-10-0-133-79 kubenswrapper[2547]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 12:55:33.453754 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.453624    2547 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 12:55:33.460650 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460632    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:55:33.460650 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460648    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:55:33.460650 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460652    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:55:33.460760 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460655    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:55:33.460760 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460658    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:55:33.460760 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460661    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:55:33.460760 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460664    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:55:33.460760 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460667    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:55:33.460760 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460670    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:55:33.460760 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460672    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:55:33.460760 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460675    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:55:33.460760 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460681    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:55:33.460760 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460685    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:55:33.460760 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460687    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:55:33.460760 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460690    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:55:33.460760 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460692    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:55:33.460760 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460697    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:55:33.460760 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460701    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:55:33.460760 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460704    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:55:33.460760 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460707    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:55:33.460760 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460710    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:55:33.460760 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460726    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:55:33.461200 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460730    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:55:33.461200 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460733    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:55:33.461200 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460736    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:55:33.461200 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460738    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:55:33.461200 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460741    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:55:33.461200 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460744    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:55:33.461200 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460746    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:55:33.461200 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460751    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:55:33.461200 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460754    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:55:33.461200 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460757    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:55:33.461200 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460760    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:55:33.461200 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460763    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:55:33.461200 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460766    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:55:33.461200 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460770    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:55:33.461200 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460773    2547 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:55:33.461200 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460776    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:55:33.461200 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460779    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:55:33.461200 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460781    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:55:33.461200 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460784    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:55:33.461656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460787    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:55:33.461656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460790    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:55:33.461656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460792    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:55:33.461656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460797    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:55:33.461656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460800    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:55:33.461656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460802    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:55:33.461656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460804    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:55:33.461656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460807    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:55:33.461656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460810    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:55:33.461656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460812    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:55:33.461656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460814    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:55:33.461656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460817    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:55:33.461656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460819    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:55:33.461656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460822    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:55:33.461656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460826    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:55:33.461656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460829    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:55:33.461656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460831    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:55:33.461656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460834    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:55:33.461656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460836    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:55:33.461656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460839    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:55:33.462347 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460842    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:55:33.462347 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460844    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:55:33.462347 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460847    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:55:33.462347 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460849    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:55:33.462347 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460852    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:55:33.462347 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460854    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:55:33.462347 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460857    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:55:33.462347 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460859    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:55:33.462347 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460863    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:55:33.462347 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460865    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:55:33.462347 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460868    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:55:33.462347 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460870    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:55:33.462347 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460873    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:55:33.462347 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460876    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:55:33.462347 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460878    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:55:33.462347 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460881    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:55:33.462347 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460884    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:55:33.462347 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460886    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:55:33.462347 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460890    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:55:33.462347 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460894    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:55:33.463097 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460899    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:55:33.463097 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460902    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:55:33.463097 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460904    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:55:33.463097 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460909    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:55:33.463097 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460911    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:55:33.463097 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460914    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:55:33.463097 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460917    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:55:33.463097 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460920    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:55:33.463097 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460923    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:55:33.463097 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460925    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:55:33.463097 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460928    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:55:33.463097 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460931    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:55:33.463097 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460934    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:55:33.463097 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460937    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:55:33.463097 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460939    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:55:33.463097 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460942    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:55:33.463097 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460945    2547 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:55:33.463097 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.460948    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:55:33.463097 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461698    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:55:33.463097 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461706    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:55:33.463592 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461709    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:55:33.463592 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461729    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:55:33.463592 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461733    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:55:33.463592 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461735    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:55:33.463592 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461738    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:55:33.463592 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461741    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:55:33.463592 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461744    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:55:33.463592 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461746    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:55:33.463592 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461749    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:55:33.463592 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461752    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:55:33.463592 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461758    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:55:33.463592 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461762    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:55:33.463592 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461765    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:55:33.463592 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461768    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:55:33.463592 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461772    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:55:33.463592 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461775    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:55:33.463592 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461778    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:55:33.463592 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461781    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:55:33.463592 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461784    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:55:33.463592 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461786    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:55:33.464165 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461789    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:55:33.464165 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461792    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:55:33.464165 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461795    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:55:33.464165 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461797    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:55:33.464165 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461800    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:55:33.464165 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461802    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:55:33.464165 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461805    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:55:33.464165 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461808    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:55:33.464165 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461810    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:55:33.464165 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461813    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:55:33.464165 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461815    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:55:33.464165 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461818    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:55:33.464165 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461820    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:55:33.464165 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461823    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:55:33.464165 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461825    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:55:33.464165 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461828    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:55:33.464165 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461830    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:55:33.464165 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461833    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:55:33.464165 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461836    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:55:33.464165 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461838    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:55:33.465020 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461840    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:55:33.465020 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461843    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:55:33.465020 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461846    2547 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:55:33.465020 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461849    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:55:33.465020 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461852    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:55:33.465020 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461854    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:55:33.465020 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461857    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:55:33.465020 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461860    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:55:33.465020 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461863    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:55:33.465020 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461865    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:55:33.465020 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461869    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:55:33.465020 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461872    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:55:33.465020 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461875    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:55:33.465020 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461877    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:55:33.465020 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461880    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:55:33.465020 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461883    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:55:33.465020 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461885    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:55:33.465020 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461888    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:55:33.465020 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461890    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:55:33.465919 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461893    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:55:33.465919 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461895    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:55:33.465919 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461899    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:55:33.465919 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461901    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:55:33.465919 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461904    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:55:33.465919 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461907    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:55:33.465919 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461909    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:55:33.465919 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461912    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:55:33.465919 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461915    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:55:33.465919 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461918    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:55:33.465919 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461920    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:55:33.465919 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461923    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:55:33.465919 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461925    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:55:33.465919 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461928    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:55:33.465919 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461930    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:55:33.465919 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461933    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:55:33.465919 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461936    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:55:33.465919 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461940    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:55:33.465919 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461944    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:55:33.466408 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461947    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:55:33.466408 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461950    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:55:33.466408 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461953    2547 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:55:33.466408 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461955    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:55:33.466408 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461958    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:55:33.466408 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461961    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:55:33.466408 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461963    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:55:33.466408 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461966    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:55:33.466408 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461969    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:55:33.466408 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461973    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:55:33.466408 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461976    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:55:33.466408 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461979    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:55:33.466408 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461981    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:55:33.466408 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461984    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:55:33.466408 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461987    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:55:33.466408 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461989    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:55:33.466408 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461992    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:55:33.466408 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461994    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:55:33.466408 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.461996    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:55:33.466408 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463614    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:55:33.466926 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463635    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:55:33.466926 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463639    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:55:33.466926 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463643    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:55:33.466926 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463646    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:55:33.466926 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463649    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:55:33.466926 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463652    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:55:33.466926 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463655    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:55:33.466926 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463657    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:55:33.466926 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463660    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:55:33.466926 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463669    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:55:33.466926 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463673    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:55:33.466926 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463680    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:55:33.466926 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463683    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:55:33.466926 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463687    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:55:33.466926 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463690    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:55:33.466926 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463692    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:55:33.466926 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463695    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:55:33.466926 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463698    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:55:33.466926 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463701    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:55:33.467457 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463703    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:55:33.467457 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463706    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:55:33.467457 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463708    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:55:33.467457 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463727    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:55:33.467457 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463733    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:55:33.467457 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463736    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:55:33.467457 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463739    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:55:33.467457 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463742    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:55:33.467457 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463745    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:55:33.467457 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463748    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:55:33.467457 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463750    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:55:33.467457 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463753    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:55:33.467457 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463755    2547 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:55:33.467457 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463759    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:55:33.467457 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463762    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:55:33.467457 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463765    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:55:33.467457 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463768    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:55:33.467457 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463774    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:55:33.467457 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463776    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:55:33.467457 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463779    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:55:33.468002 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463782    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:55:33.468002 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463784    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:55:33.468002 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463788    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:55:33.468002 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463799    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:55:33.468002 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463802    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:55:33.468002 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463805    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:55:33.468002 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463807    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:55:33.468002 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463810    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:55:33.468002 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463812    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:55:33.468002 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463818    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:55:33.468002 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463820    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:55:33.468002 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463823    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:55:33.468002 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463826    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:55:33.468002 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463828    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:55:33.468002 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463831    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:55:33.468002 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463833    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:55:33.468002 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463836    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:55:33.468002 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463839    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:55:33.468002 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463841    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:55:33.468002 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463844    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:55:33.468614 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463847    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:55:33.468614 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463852    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:55:33.468614 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463855    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:55:33.468614 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463857    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:55:33.468614 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463860    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:55:33.468614 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463863    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:55:33.468614 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463866    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:55:33.468614 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463869    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:55:33.468614 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463871    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:55:33.468614 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463876    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:55:33.468614 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463879    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:55:33.468614 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463882    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:55:33.468614 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463885    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:55:33.468614 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463888    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:55:33.468614 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463894    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:55:33.468614 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463897    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:55:33.468614 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463905    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:55:33.468614 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463908    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:55:33.468614 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463911    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:55:33.469184 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463914    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:55:33.469184 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463917    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:55:33.469184 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463920    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:55:33.469184 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463923    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:55:33.469184 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463931    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:55:33.469184 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463935    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:55:33.469184 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463941    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:55:33.469184 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463943    2547 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:55:33.469184 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463946    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:55:33.469184 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463949    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:55:33.469184 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463952    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:55:33.469184 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463955    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:55:33.469184 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463957    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:55:33.469184 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463960    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:55:33.469184 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463963    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:55:33.469184 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463965    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:55:33.469184 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463968    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:55:33.469184 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463971    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:55:33.469184 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463974    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:55:33.469184 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.463979    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:55:33.469671 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464387    2547 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 12:55:33.469671 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464447    2547 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 12:55:33.469671 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464460    2547 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 12:55:33.469671 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464468    2547 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 12:55:33.469671 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464474    2547 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 12:55:33.469671 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464479    2547 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 12:55:33.469671 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464486    2547 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 12:55:33.469671 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464493    2547 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 12:55:33.469671 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464506    2547 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 12:55:33.469671 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464511    2547 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 12:55:33.469671 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464518    2547 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 12:55:33.469671 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464523    2547 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 12:55:33.469671 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464529    2547 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 12:55:33.469671 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464533    2547 flags.go:64] FLAG: --cgroup-root=""
Sep 11 12:55:33.469671 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464538    2547 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 12:55:33.469671 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464543    2547 flags.go:64] FLAG: --client-ca-file=""
Sep 11 12:55:33.469671 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464547    2547 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 12:55:33.469671 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464552    2547 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 12:55:33.469671 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464559    2547 flags.go:64] FLAG: --cluster-domain=""
Sep 11 12:55:33.469671 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464564    2547 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 12:55:33.469671 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464569    2547 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 12:55:33.469671 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464574    2547 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 12:55:33.469671 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464579    2547 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 12:55:33.469671 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464585    2547 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 12:55:33.470367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464589    2547 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 12:55:33.470367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464596    2547 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 12:55:33.470367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464601    2547 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 12:55:33.470367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464606    2547 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 12:55:33.470367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464611    2547 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 12:55:33.470367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464616    2547 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 12:55:33.470367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464621    2547 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 12:55:33.470367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464625    2547 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 12:55:33.470367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464631    2547 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 12:55:33.470367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464637    2547 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 12:55:33.470367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464642    2547 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 12:55:33.470367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464646    2547 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 12:55:33.470367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464651    2547 flags.go:64] FLAG: --enable-server="true"
Sep 11 12:55:33.470367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464656    2547 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 12:55:33.470367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464663    2547 flags.go:64] FLAG: --event-burst="100"
Sep 11 12:55:33.470367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464668    2547 flags.go:64] FLAG: --event-qps="50"
Sep 11 12:55:33.470367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464672    2547 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 12:55:33.470367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464678    2547 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 12:55:33.470367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464683    2547 flags.go:64] FLAG: --eviction-hard=""
Sep 11 12:55:33.470367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464688    2547 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 12:55:33.470367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464693    2547 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 12:55:33.470367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464698    2547 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 12:55:33.470367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464702    2547 flags.go:64] FLAG: --eviction-soft=""
Sep 11 12:55:33.470367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464707    2547 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 12:55:33.470367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464728    2547 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 12:55:33.471060 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464733    2547 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 12:55:33.471060 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464738    2547 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 12:55:33.471060 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464743    2547 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 12:55:33.471060 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464747    2547 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 12:55:33.471060 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464752    2547 flags.go:64] FLAG: --feature-gates=""
Sep 11 12:55:33.471060 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464758    2547 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 12:55:33.471060 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464763    2547 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 12:55:33.471060 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464768    2547 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 12:55:33.471060 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464773    2547 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 12:55:33.471060 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464779    2547 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 12:55:33.471060 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464784    2547 flags.go:64] FLAG: --help="false"
Sep 11 12:55:33.471060 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464789    2547 flags.go:64] FLAG: --hostname-override="ip-10-0-133-79.ec2.internal"
Sep 11 12:55:33.471060 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464794    2547 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 12:55:33.471060 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464799    2547 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 12:55:33.471060 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464804    2547 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 12:55:33.471060 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464809    2547 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 12:55:33.471060 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464816    2547 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 12:55:33.471060 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464822    2547 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 12:55:33.471060 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464827    2547 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 12:55:33.471060 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464832    2547 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 12:55:33.471060 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464837    2547 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 12:55:33.471060 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464841    2547 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 12:55:33.471060 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464847    2547 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 12:55:33.471060 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464851    2547 flags.go:64] FLAG: --kube-reserved=""
Sep 11 12:55:33.471659 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464856    2547 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 12:55:33.471659 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464860    2547 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 12:55:33.471659 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464865    2547 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 12:55:33.471659 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464870    2547 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 12:55:33.471659 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464875    2547 flags.go:64] FLAG: --lock-file=""
Sep 11 12:55:33.471659 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464879    2547 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 12:55:33.471659 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464884    2547 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 12:55:33.471659 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464889    2547 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 12:55:33.471659 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464897    2547 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 12:55:33.471659 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464902    2547 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 12:55:33.471659 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464907    2547 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 12:55:33.471659 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464911    2547 flags.go:64] FLAG: --logging-format="text"
Sep 11 12:55:33.471659 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464916    2547 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 12:55:33.471659 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464922    2547 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 12:55:33.471659 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464926    2547 flags.go:64] FLAG: --manifest-url=""
Sep 11 12:55:33.471659 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464931    2547 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 12:55:33.471659 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464939    2547 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 12:55:33.471659 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464944    2547 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 12:55:33.471659 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464958    2547 flags.go:64] FLAG: --max-pods="110"
Sep 11 12:55:33.471659 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464962    2547 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 12:55:33.471659 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464968    2547 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 12:55:33.471659 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464972    2547 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 12:55:33.471659 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464977    2547 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 12:55:33.471659 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464982    2547 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 12:55:33.471659 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464987    2547 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 12:55:33.472335 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.464991    2547 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 12:55:33.472335 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465004    2547 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 12:55:33.472335 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465009    2547 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 12:55:33.472335 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465014    2547 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 12:55:33.472335 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465018    2547 flags.go:64] FLAG: --pod-cidr=""
Sep 11 12:55:33.472335 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465023    2547 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 12:55:33.472335 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465031    2547 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 12:55:33.472335 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465035    2547 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 12:55:33.472335 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465040    2547 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 12:55:33.472335 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465044    2547 flags.go:64] FLAG: --port="10250"
Sep 11 12:55:33.472335 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465048    2547 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 12:55:33.472335 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465053    2547 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ee98d1aa703cafbd"
Sep 11 12:55:33.472335 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465058    2547 flags.go:64] FLAG: --qos-reserved=""
Sep 11 12:55:33.472335 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465063    2547 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 12:55:33.472335 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465068    2547 flags.go:64] FLAG: --register-node="true"
Sep 11 12:55:33.472335 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465073    2547 flags.go:64] FLAG: --register-with-taints=""
Sep 11 12:55:33.472335 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465079    2547 flags.go:64] FLAG: --registry-burst="10"
Sep 11 12:55:33.472335 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465083    2547 flags.go:64] FLAG: --registry-qps="5"
Sep 11 12:55:33.472335 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465089    2547 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 12:55:33.472335 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465094    2547 flags.go:64] FLAG: --reserved-memory=""
Sep 11 12:55:33.472335 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465100    2547 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 12:55:33.472335 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465105    2547 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 12:55:33.472335 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465110    2547 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 12:55:33.472335 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465115    2547 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 12:55:33.472335 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465123    2547 flags.go:64] FLAG: --runonce="false"
Sep 11 12:55:33.472973 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465127    2547 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 12:55:33.472973 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465132    2547 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 12:55:33.472973 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465137    2547 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 12:55:33.472973 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465142    2547 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 12:55:33.472973 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465146    2547 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 12:55:33.472973 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465151    2547 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 12:55:33.472973 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465156    2547 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 12:55:33.472973 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465161    2547 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 12:55:33.472973 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465166    2547 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 12:55:33.472973 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465170    2547 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 12:55:33.472973 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465175    2547 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 12:55:33.472973 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465179    2547 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 12:55:33.472973 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465184    2547 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 12:55:33.472973 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465189    2547 flags.go:64] FLAG: --system-cgroups=""
Sep 11 12:55:33.472973 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465193    2547 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 12:55:33.472973 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465204    2547 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 12:55:33.472973 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465208    2547 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 12:55:33.472973 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465213    2547 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 12:55:33.472973 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465219    2547 flags.go:64] FLAG: --tls-min-version=""
Sep 11 12:55:33.472973 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465224    2547 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 12:55:33.472973 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465229    2547 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 12:55:33.472973 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465234    2547 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 12:55:33.472973 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465239    2547 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 12:55:33.472973 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465243    2547 flags.go:64] FLAG: --v="2"
Sep 11 12:55:33.472973 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465249    2547 flags.go:64] FLAG: --version="false"
Sep 11 12:55:33.473659 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465255    2547 flags.go:64] FLAG: --vmodule=""
Sep 11 12:55:33.473659 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465262    2547 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 12:55:33.473659 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.465268    2547 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 12:55:33.473659 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465473    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:55:33.473659 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465482    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:55:33.473659 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465487    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:55:33.473659 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465495    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:55:33.473659 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465502    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:55:33.473659 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465508    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:55:33.473659 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465513    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:55:33.473659 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465517    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:55:33.473659 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465523    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:55:33.473659 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465527    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:55:33.473659 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465532    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:55:33.473659 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465536    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:55:33.473659 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465541    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:55:33.473659 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465544    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:55:33.473659 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465549    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:55:33.473659 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465553    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:55:33.473659 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465557    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:55:33.474167 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465561    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:55:33.474167 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465565    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:55:33.474167 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465569    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:55:33.474167 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465573    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:55:33.474167 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465577    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:55:33.474167 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465581    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:55:33.474167 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465585    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:55:33.474167 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465589    2547 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:55:33.474167 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465594    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:55:33.474167 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465598    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:55:33.474167 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465602    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:55:33.474167 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465606    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:55:33.474167 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465610    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:55:33.474167 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465614    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:55:33.474167 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465620    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:55:33.474167 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465624    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:55:33.474167 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465628    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:55:33.474167 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465632    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:55:33.474167 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465638    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:55:33.474167 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465642    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:55:33.474656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465646    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:55:33.474656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465650    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:55:33.474656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465654    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:55:33.474656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465659    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:55:33.474656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465663    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:55:33.474656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465669    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:55:33.474656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465675    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:55:33.474656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465679    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:55:33.474656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465683    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:55:33.474656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465688    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:55:33.474656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465692    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:55:33.474656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465696    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:55:33.474656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465701    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:55:33.474656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465705    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:55:33.474656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465709    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:55:33.474656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465738    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:55:33.474656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465743    2547 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:55:33.474656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465747    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:55:33.474656 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465751    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:55:33.475135 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465754    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:55:33.475135 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465758    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:55:33.475135 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465763    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:55:33.475135 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465767    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:55:33.475135 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465772    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:55:33.475135 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465776    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:55:33.475135 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465779    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:55:33.475135 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465786    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:55:33.475135 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465792    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:55:33.475135 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465797    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:55:33.475135 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465801    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:55:33.475135 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465807    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:55:33.475135 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465811    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:55:33.475135 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465815    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:55:33.475135 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465819    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:55:33.475135 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465823    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:55:33.475135 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465828    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:55:33.475135 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465832    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:55:33.475135 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465836    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:55:33.475135 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465841    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:55:33.475623 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465846    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:55:33.475623 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465850    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:55:33.475623 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465854    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:55:33.475623 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465859    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:55:33.475623 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465863    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:55:33.475623 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465868    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:55:33.475623 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465874    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:55:33.475623 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465880    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:55:33.475623 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465884    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:55:33.475623 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465889    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:55:33.475623 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465893    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:55:33.475623 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465897    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:55:33.475623 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465901    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:55:33.475623 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465905    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:55:33.475623 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465909    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:55:33.475623 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465913    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:55:33.475623 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465917    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:55:33.475623 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465921    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:55:33.475623 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465925    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:55:33.476191 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465930    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:55:33.476191 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465934    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:55:33.476191 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465939    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:55:33.476191 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.465944    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:55:33.476191 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.466917    2547 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 12:55:33.476191 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.474975    2547 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 12:55:33.476191 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.474991    2547 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 12:55:33.476191 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.475794    2547 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 12:55:33.476191 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.475802    2547 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 12:55:33.476191 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475878    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:55:33.476191 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475884    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:55:33.476191 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475887    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:55:33.476191 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475890    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:55:33.476191 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475893    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:55:33.476191 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475896    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:55:33.476579 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475899    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:55:33.476579 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475902    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:55:33.476579 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475905    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:55:33.476579 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475908    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:55:33.476579 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475910    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:55:33.476579 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475913    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:55:33.476579 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475915    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:55:33.476579 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475918    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:55:33.476579 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475921    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:55:33.476579 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475923    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:55:33.476579 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475926    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:55:33.476579 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475928    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:55:33.476579 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475931    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:55:33.476579 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475934    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:55:33.476579 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475936    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:55:33.476579 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475939    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:55:33.476579 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475942    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:55:33.476579 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475945    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:55:33.476579 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475948    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:55:33.476579 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475950    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:55:33.477081 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475953    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:55:33.477081 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475956    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:55:33.477081 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475959    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:55:33.477081 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475964    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:55:33.477081 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475966    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:55:33.477081 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475969    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:55:33.477081 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475971    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:55:33.477081 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475974    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:55:33.477081 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475976    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:55:33.477081 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475979    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:55:33.477081 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475982    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:55:33.477081 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475984    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:55:33.477081 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475987    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:55:33.477081 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475989    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:55:33.477081 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475992    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:55:33.477081 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475994    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:55:33.477081 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475997    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:55:33.477081 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.475999    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:55:33.477081 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476002    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:55:33.477081 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476004    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:55:33.477561 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476007    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:55:33.477561 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476009    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:55:33.477561 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476012    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:55:33.477561 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476015    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:55:33.477561 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476018    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:55:33.477561 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476020    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:55:33.477561 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476023    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:55:33.477561 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476026    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:55:33.477561 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476029    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:55:33.477561 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476031    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:55:33.477561 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476034    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:55:33.477561 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476036    2547 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:55:33.477561 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476039    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:55:33.477561 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476042    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:55:33.477561 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476045    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:55:33.477561 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476048    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:55:33.477561 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476051    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:55:33.477561 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476053    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:55:33.477561 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476056    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:55:33.477561 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476059    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:55:33.478063 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476061    2547 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:55:33.478063 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476064    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:55:33.478063 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476066    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:55:33.478063 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476069    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:55:33.478063 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476071    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:55:33.478063 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476074    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:55:33.478063 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476077    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:55:33.478063 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476080    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:55:33.478063 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476082    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:55:33.478063 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476085    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:55:33.478063 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476087    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:55:33.478063 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476090    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:55:33.478063 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476093    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:55:33.478063 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476096    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:55:33.478063 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476098    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:55:33.478063 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476101    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:55:33.478063 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476103    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:55:33.478063 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476105    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:55:33.478063 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476108    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:55:33.478515 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476111    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:55:33.478515 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476115    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:55:33.478515 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476120    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:55:33.478515 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476123    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:55:33.478515 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476126    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:55:33.478515 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476130    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:55:33.478515 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476134    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:55:33.478515 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476138    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:55:33.478515 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476141    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:55:33.478515 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476144    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:55:33.478515 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476147    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:55:33.478515 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476150    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:55:33.478515 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476153    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:55:33.478515 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476155    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:55:33.478890 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.476160    2547 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 12:55:33.478890 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476279    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:55:33.478890 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476283    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:55:33.478890 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476286    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:55:33.478890 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476289    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:55:33.478890 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476292    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:55:33.478890 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476295    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:55:33.478890 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476298    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:55:33.478890 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476301    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:55:33.478890 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476304    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:55:33.478890 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476306    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:55:33.478890 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476309    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:55:33.478890 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476311    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:55:33.478890 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476314    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:55:33.478890 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476316    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:55:33.479251 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476319    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:55:33.479251 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476322    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:55:33.479251 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476324    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:55:33.479251 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476327    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:55:33.479251 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476330    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:55:33.479251 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476334    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:55:33.479251 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476338    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:55:33.479251 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476341    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:55:33.479251 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476343    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:55:33.479251 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476346    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:55:33.479251 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476349    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:55:33.479251 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476352    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:55:33.479251 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476354    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:55:33.479251 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476357    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:55:33.479251 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476360    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:55:33.479251 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476362    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:55:33.479251 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476365    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:55:33.479251 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476368    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:55:33.479251 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476370    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:55:33.479728 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476373    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:55:33.479728 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476376    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:55:33.479728 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476378    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:55:33.479728 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476380    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:55:33.479728 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476383    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:55:33.479728 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476385    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:55:33.479728 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476388    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:55:33.479728 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476391    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:55:33.479728 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476393    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:55:33.479728 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476395    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:55:33.479728 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476398    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:55:33.479728 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476400    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:55:33.479728 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476403    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:55:33.479728 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476405    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:55:33.479728 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476408    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:55:33.479728 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476411    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:55:33.479728 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476415    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:55:33.479728 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476418    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:55:33.479728 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476421    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:55:33.480228 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476424    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:55:33.480228 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476427    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:55:33.480228 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476429    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:55:33.480228 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476432    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:55:33.480228 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476435    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:55:33.480228 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476438    2547 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:55:33.480228 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476440    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:55:33.480228 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476443    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:55:33.480228 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476445    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:55:33.480228 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476451    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:55:33.480228 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476454    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:55:33.480228 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476456    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:55:33.480228 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476459    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:55:33.480228 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476461    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:55:33.480228 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476464    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:55:33.480228 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476466    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:55:33.480228 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476469    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:55:33.480228 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476471    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:55:33.480228 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476473    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:55:33.480228 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476476    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:55:33.480704 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476479    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:55:33.480704 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476481    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:55:33.480704 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476483    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:55:33.480704 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476486    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:55:33.480704 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476488    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:55:33.480704 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476491    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:55:33.480704 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476493    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:55:33.480704 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476496    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:55:33.480704 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476509    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:55:33.480704 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476513    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:55:33.480704 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476516    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:55:33.480704 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476519    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:55:33.480704 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476522    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:55:33.480704 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476525    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:55:33.480704 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476527    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:55:33.480704 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476529    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:55:33.480704 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476532    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:55:33.480704 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476535    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:55:33.480704 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476537    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:55:33.480704 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476540    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:55:33.481294 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476543    2547 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:55:33.481294 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476545    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:55:33.481294 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476549    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:55:33.481294 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476551    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:55:33.481294 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476554    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:55:33.481294 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476556    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:55:33.481294 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:33.476558    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:55:33.481294 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.476563    2547 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 12:55:33.481294 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.476697    2547 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 12:55:33.481294 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.478900    2547 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 12:55:33.481294 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.479854    2547 server.go:1019] "Starting client certificate rotation"
Sep 11 12:55:33.481294 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.479955    2547 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 12:55:33.481294 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.479988    2547 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 12:55:33.482653 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.482640    2547 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 12:55:33.484013 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.483983    2547 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 12:55:33.496391 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.496286    2547 log.go:25] "Validated CRI v1 runtime API"
Sep 11 12:55:33.500926 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.500897    2547 log.go:25] "Validated CRI v1 image API"
Sep 11 12:55:33.502531 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.502511    2547 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 12:55:33.507194 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.507175    2547 fs.go:135] Filesystem UUIDs: map[531d92c2-7386-45a9-8d2c-063ccae4164e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 fda4bf6e-501b-4e99-b438-a04159845959:/dev/nvme0n1p3]
Sep 11 12:55:33.507283 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.507193    2547 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 12:55:33.513164 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.513056    2547 manager.go:216] Machine: {Timestamp:2026-09-11 12:55:33.511760529 +0000 UTC m=+0.373234708 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3120127 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec218bf34392ca48ea9efa8c44cd4705 SystemUUID:ec218bf3-4392-ca48-ea9e-fa8c44cd4705 BootID:1aa9c5c3-1f62-4f0e-bc36-f413ad859766 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d5:22:b8:cf:6f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d5:22:b8:cf:6f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:87:eb:b4:14:41 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 12:55:33.513164 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.513154    2547 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 12:55:33.513322 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.513234    2547 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 12:55:33.515853 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.515835    2547 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 12:55:33.516347 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.516322    2547 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 12:55:33.516515 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.516355    2547 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-79.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 12:55:33.517221 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.517207    2547 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 12:55:33.517273 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.517227    2547 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 12:55:33.517273 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.517238    2547 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 12:55:33.517979 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.517967    2547 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 12:55:33.518959 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.518946    2547 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 12:55:33.522310 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.522295    2547 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 12:55:33.522443 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.522432    2547 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 12:55:33.522502 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.522471    2547 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 12:55:33.522502 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.522485    2547 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 12:55:33.522592 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.522506    2547 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 12:55:33.522592 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.522520    2547 kubelet.go:398] "Adding apiserver pod source"
Sep 11 12:55:33.522592 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.522536    2547 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 12:55:33.522938 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.522923    2547 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 12:55:33.523007 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.522948    2547 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 12:55:33.525918 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.525904    2547 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 12:55:33.528788 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.528775    2547 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 12:55:33.528842 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.528805    2547 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 12:55:33.530964 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.530950    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 12:55:33.531022 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.530970    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 12:55:33.531022 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.530981    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 12:55:33.531022 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.530990    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 12:55:33.531022 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.531003    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 12:55:33.531022 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.531009    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 12:55:33.531022 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.531023    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 12:55:33.531181 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.531029    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 12:55:33.531181 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.531036    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 12:55:33.531181 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.531041    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 12:55:33.531181 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.531055    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 12:55:33.531181 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.531061    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 12:55:33.531900 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.531890    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 12:55:33.531900 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.531900    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 12:55:33.533891 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:33.533870    2547 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-79.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 12:55:33.533954 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:33.533873    2547 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 12:55:33.535827 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.535813    2547 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-79.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 12:55:33.536089 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.536077    2547 server.go:1268] "Started kubelet"
Sep 11 12:55:33.536175 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.536133    2547 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 12:55:33.536288 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.536229    2547 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 12:55:33.536383 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.536308    2547 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 12:55:33.537055 ip-10-0-133-79 systemd[1]: Started Kubernetes Kubelet.
Sep 11 12:55:33.537834 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.537780    2547 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 12:55:33.546063 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.545999    2547 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zsjtv"
Sep 11 12:55:33.546136 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:33.546114    2547 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 12:55:33.548116 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.548101    2547 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 12:55:33.548831 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:33.547833    2547 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-79.ec2.internal.18d44577f7efb421  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-79.ec2.internal,UID:ip-10-0-133-79.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-79.ec2.internal,},FirstTimestamp:2026-09-11 12:55:33.536035873 +0000 UTC m=+0.397510052,LastTimestamp:2026-09-11 12:55:33.536035873 +0000 UTC m=+0.397510052,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-79.ec2.internal,}"
Sep 11 12:55:33.551295 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.551275    2547 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 12:55:33.551946 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.551927    2547 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 12:55:33.552476 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:33.552359    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-79.ec2.internal\" not found"
Sep 11 12:55:33.552808 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.552789    2547 factory.go:55] Registering systemd factory
Sep 11 12:55:33.552890 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.552811    2547 factory.go:223] Registration of the systemd container factory successfully
Sep 11 12:55:33.553072 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.553055    2547 factory.go:153] Registering CRI-O factory
Sep 11 12:55:33.553185 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.553075    2547 factory.go:223] Registration of the crio container factory successfully
Sep 11 12:55:33.553185 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.553129    2547 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 12:55:33.553185 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.553149    2547 factory.go:103] Registering Raw factory
Sep 11 12:55:33.553185 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.553164    2547 manager.go:1196] Started watching for new ooms in manager
Sep 11 12:55:33.553185 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.553170    2547 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 12:55:33.553185 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.553188    2547 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 12:55:33.553487 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.553171    2547 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 12:55:33.553487 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.553298    2547 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zsjtv"
Sep 11 12:55:33.553487 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.553336    2547 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 12:55:33.553487 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.553344    2547 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 12:55:33.553661 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.553534    2547 manager.go:349] Starting recovery of all containers
Sep 11 12:55:33.556537 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:33.556495    2547 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-79.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 12:55:33.556629 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:33.556571    2547 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 12:55:33.565080 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.565064    2547 manager.go:354] Recovery completed
Sep 11 12:55:33.570582 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.570568    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:55:33.573314 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.573300    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:55:33.573368 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.573328    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:55:33.573368 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.573338    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:55:33.573895 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.573877    2547 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 12:55:33.573895 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.573886    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:55:33.573895 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.573893    2547 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 12:55:33.574070 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.573911    2547 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 12:55:33.574741 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.574697    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:55:33.574820 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.574766    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:55:33.574820 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.574780    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:55:33.575097 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.575085    2547 policy_none.go:49] "None policy: Start"
Sep 11 12:55:33.575127 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.575102    2547 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 12:55:33.575127 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.575112    2547 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 12:55:33.576019 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.576006    2547 policy_none.go:47] "Start"
Sep 11 12:55:33.622325 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.622309    2547 manager.go:337] "Starting Device Plugin manager"
Sep 11 12:55:33.624309 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:33.622352    2547 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 12:55:33.624309 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.622366    2547 server.go:87] "Starting device plugin registration server"
Sep 11 12:55:33.624309 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.622615    2547 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 12:55:33.624309 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.622625    2547 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 12:55:33.624309 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.622751    2547 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 12:55:33.624309 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.622867    2547 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 12:55:33.624309 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.622882    2547 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 12:55:33.624309 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:33.623311    2547 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 12:55:33.624309 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:33.623354    2547 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-79.ec2.internal\" not found"
Sep 11 12:55:33.655451 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.655430    2547 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 12:55:33.656700 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.656684    2547 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 12:55:33.656843 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.656749    2547 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 12:55:33.656843 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.656772    2547 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 12:55:33.656843 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:33.656831    2547 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 12:55:33.659731 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.659695    2547 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:55:33.723013 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.722937    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:55:33.723838 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.723824    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:55:33.723915 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.723849    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:55:33.723915 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.723859    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:55:33.723915 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.723882    2547 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-79.ec2.internal"
Sep 11 12:55:33.730900 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.730885    2547 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-79.ec2.internal"
Sep 11 12:55:33.730968 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:33.730906    2547 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-79.ec2.internal\": node \"ip-10-0-133-79.ec2.internal\" not found"
Sep 11 12:55:33.748786 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:33.748763    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-79.ec2.internal\" not found"
Sep 11 12:55:33.757106 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.757085    2547 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-79.ec2.internal"]
Sep 11 12:55:33.757185 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.757173    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:55:33.760296 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.760276    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:55:33.760384 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.760303    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:55:33.760384 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.760312    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:55:33.761704 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.761693    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:55:33.761850 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.761823    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal"
Sep 11 12:55:33.761904 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.761857    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:55:33.762416 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.762400    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:55:33.762416 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.762410    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:55:33.762553 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.762426    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:55:33.762553 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.762428    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:55:33.762553 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.762471    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:55:33.762553 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.762439    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:55:33.763636 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.763620    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-79.ec2.internal"
Sep 11 12:55:33.763739 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.763648    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:55:33.764376 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.764361    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:55:33.764432 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.764389    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:55:33.764432 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.764399    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:55:33.797534 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:33.797514    2547 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-79.ec2.internal\" not found" node="ip-10-0-133-79.ec2.internal"
Sep 11 12:55:33.802304 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:33.802286    2547 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-79.ec2.internal\" not found" node="ip-10-0-133-79.ec2.internal"
Sep 11 12:55:33.848979 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:33.848951    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-79.ec2.internal\" not found"
Sep 11 12:55:33.949236 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:33.949196    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-79.ec2.internal\" not found"
Sep 11 12:55:33.954532 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.954512    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/336bcc6551e46b69eadff66cca9f19f9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal\" (UID: \"336bcc6551e46b69eadff66cca9f19f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal"
Sep 11 12:55:33.954606 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.954539    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/336bcc6551e46b69eadff66cca9f19f9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal\" (UID: \"336bcc6551e46b69eadff66cca9f19f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal"
Sep 11 12:55:33.954606 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:33.954559    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0f092973866d00f19dd94cc0896a8414-config\") pod \"kube-apiserver-proxy-ip-10-0-133-79.ec2.internal\" (UID: \"0f092973866d00f19dd94cc0896a8414\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-79.ec2.internal"
Sep 11 12:55:34.050030 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:34.049956    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-79.ec2.internal\" not found"
Sep 11 12:55:34.055348 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:34.055327    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/336bcc6551e46b69eadff66cca9f19f9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal\" (UID: \"336bcc6551e46b69eadff66cca9f19f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal"
Sep 11 12:55:34.055419 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:34.055359    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/336bcc6551e46b69eadff66cca9f19f9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal\" (UID: \"336bcc6551e46b69eadff66cca9f19f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal"
Sep 11 12:55:34.055419 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:34.055381    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0f092973866d00f19dd94cc0896a8414-config\") pod \"kube-apiserver-proxy-ip-10-0-133-79.ec2.internal\" (UID: \"0f092973866d00f19dd94cc0896a8414\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-79.ec2.internal"
Sep 11 12:55:34.055481 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:34.055440    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/336bcc6551e46b69eadff66cca9f19f9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal\" (UID: \"336bcc6551e46b69eadff66cca9f19f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal"
Sep 11 12:55:34.055481 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:34.055450    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/336bcc6551e46b69eadff66cca9f19f9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal\" (UID: \"336bcc6551e46b69eadff66cca9f19f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal"
Sep 11 12:55:34.055481 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:34.055461    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0f092973866d00f19dd94cc0896a8414-config\") pod \"kube-apiserver-proxy-ip-10-0-133-79.ec2.internal\" (UID: \"0f092973866d00f19dd94cc0896a8414\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-79.ec2.internal"
Sep 11 12:55:34.100486 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:34.100446    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal"
Sep 11 12:55:34.105883 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:34.105864    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-79.ec2.internal"
Sep 11 12:55:34.150325 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:34.150295    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-79.ec2.internal\" not found"
Sep 11 12:55:34.250912 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:34.250874    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-79.ec2.internal\" not found"
Sep 11 12:55:34.351528 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:34.351441    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-79.ec2.internal\" not found"
Sep 11 12:55:34.451992 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:34.451963    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-79.ec2.internal\" not found"
Sep 11 12:55:34.479430 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:34.479403    2547 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 12:55:34.479571 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:34.479546    2547 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 12:55:34.552045 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:34.552018    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-79.ec2.internal\" not found"
Sep 11 12:55:34.557344 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:34.557308    2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 12:50:33 +0000 UTC" deadline="2028-05-15 05:09:46.83859503 +0000 UTC"
Sep 11 12:55:34.557344 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:34.557341    2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14680h14m12.28125657s"
Sep 11 12:55:34.637884 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:34.637853    2547 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:55:34.640635 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:34.640598    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod336bcc6551e46b69eadff66cca9f19f9.slice/crio-d05362254fe4dc093cae9b710c5d25395a277eb8c782314d5b2edea96e9fca70 WatchSource:0}: Error finding container d05362254fe4dc093cae9b710c5d25395a277eb8c782314d5b2edea96e9fca70: Status 404 returned error can't find the container with id d05362254fe4dc093cae9b710c5d25395a277eb8c782314d5b2edea96e9fca70
Sep 11 12:55:34.641507 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:34.641486    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f092973866d00f19dd94cc0896a8414.slice/crio-45e0019c9f17055a734d84964736853d4fc548b6c86f489b2f2cb20614be97ce WatchSource:0}: Error finding container 45e0019c9f17055a734d84964736853d4fc548b6c86f489b2f2cb20614be97ce: Status 404 returned error can't find the container with id 45e0019c9f17055a734d84964736853d4fc548b6c86f489b2f2cb20614be97ce
Sep 11 12:55:34.646847 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:34.646831    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 12:55:34.652213 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:34.652185    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-79.ec2.internal\" not found"
Sep 11 12:55:34.660823 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:34.660780    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-79.ec2.internal" event={"ID":"0f092973866d00f19dd94cc0896a8414","Type":"ContainerStarted","Data":"45e0019c9f17055a734d84964736853d4fc548b6c86f489b2f2cb20614be97ce"}
Sep 11 12:55:34.662363 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:34.662343    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal" event={"ID":"336bcc6551e46b69eadff66cca9f19f9","Type":"ContainerStarted","Data":"d05362254fe4dc093cae9b710c5d25395a277eb8c782314d5b2edea96e9fca70"}
Sep 11 12:55:34.752577 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:34.752529    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-79.ec2.internal\" not found"
Sep 11 12:55:34.848286 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:34.848255    2547 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:55:34.853226 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:34.853208    2547 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-79.ec2.internal"
Sep 11 12:55:34.863557 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:34.863535    2547 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 12:55:34.865805 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:34.865792    2547 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal"
Sep 11 12:55:34.877066 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:34.877037    2547 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 12:55:35.016090 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.016059    2547 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:55:35.523286 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.523258    2547 apiserver.go:52] "Watching apiserver"
Sep 11 12:55:35.529475 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.529448    2547 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 12:55:35.529897 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.529865    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-hwqfb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57h6r","openshift-image-registry/node-ca-v26jw","openshift-multus/multus-additional-cni-plugins-4wpcw","openshift-multus/multus-zhbh2","openshift-multus/network-metrics-daemon-5jxc9","openshift-ovn-kubernetes/ovnkube-node-bx8zk","kube-system/global-pull-secret-syncer-hw4b9","kube-system/konnectivity-agent-22m8j","kube-system/kube-apiserver-proxy-ip-10-0-133-79.ec2.internal","openshift-cluster-node-tuning-operator/tuned-l5nls","openshift-dns/node-resolver-9bb5n","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal","openshift-network-diagnostics/network-check-target-4bvlc"]
Sep 11 12:55:35.531783 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.531765    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.532978 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.532962    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.534167 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.534126    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 12:55:35.534167 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.534157    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 12:55:35.534341 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.534209    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 12:55:35.534341 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.534268    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v26jw"
Sep 11 12:55:35.534341 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.534134    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gft5r\""
Sep 11 12:55:35.534549 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.534381    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 12:55:35.534549 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.534517    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 12:55:35.534810 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.534792    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 12:55:35.534901 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.534861    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 12:55:35.535033 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.535017    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6zb8g\""
Sep 11 12:55:35.535126 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.535017    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 12:55:35.535470 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.535452    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4wpcw"
Sep 11 12:55:35.536197 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.536180    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 12:55:35.536435 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.536419    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 12:55:35.536501 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.536455    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 12:55:35.537098 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.536858    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.537098 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.536888    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vv7hk\""
Sep 11 12:55:35.538128 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.538111    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 12:55:35.538213 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.538151    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 12:55:35.538273 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.538116    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 12:55:35.538338 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.538323    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 12:55:35.538589 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.538570    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-twpsl\""
Sep 11 12:55:35.538883 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.538870    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 12:55:35.538946 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.538890    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 12:55:35.539017 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.539000    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:55:35.539070 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.539050    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-k7hcf\""
Sep 11 12:55:35.539111 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:35.539075    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jxc9" podUID="4b821e09-a20a-457c-b22d-815df2b09e54"
Sep 11 12:55:35.539748 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.539479    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-22m8j"
Sep 11 12:55:35.541751 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.541533    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 12:55:35.541751 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.541542    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-l9r7w\""
Sep 11 12:55:35.541751 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.541558    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 12:55:35.541751 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.541615    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvlc"
Sep 11 12:55:35.541751 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:35.541669    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvlc" podUID="bc61a33f-faa2-4646-8197-40627ef9da72"
Sep 11 12:55:35.542805 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.542786    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57h6r"
Sep 11 12:55:35.544044 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.544028    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:55:35.544119 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:35.544081    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4b9" podUID="4a0213c0-ea91-46ef-963b-eebfca575f1d"
Sep 11 12:55:35.544831 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.544812    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 12:55:35.544831 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.544825    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 12:55:35.545019 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.545006    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 12:55:35.545560 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.545542    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-s76r9\""
Sep 11 12:55:35.546212 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.546189    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hwqfb"
Sep 11 12:55:35.549361 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.548574    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9bb5n"
Sep 11 12:55:35.549361 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.548599    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 12:55:35.549361 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.549054    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h88d9\""
Sep 11 12:55:35.549531 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.549461    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 12:55:35.549612 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.549587    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 12:55:35.550792 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.550772    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 12:55:35.551053 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.551040    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 12:55:35.551120 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.551091    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zg92r\""
Sep 11 12:55:35.552073 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.552053    2547 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 12:55:35.554479 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.554464    2547 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 12:55:35.560133 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.560115    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-host-var-lib-cni-multus\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.560219 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.560143    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-etc-kubernetes\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.560219 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.560165    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6e4770ce-0b26-4af8-9aa9-f88c744db951-env-overrides\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.560219 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.560183    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-etc-modprobe-d\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.560219 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.560202    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e640946e-2f4b-426a-85fb-a20784da1079-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4wpcw\" (UID: \"e640946e-2f4b-426a-85fb-a20784da1079\") " pod="openshift-multus/multus-additional-cni-plugins-4wpcw"
Sep 11 12:55:35.560405 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.560228    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpf7j\" (UniqueName: \"kubernetes.io/projected/68d59d28-7efe-4ac2-955b-697b740b7781-kube-api-access-gpf7j\") pod \"node-resolver-9bb5n\" (UID: \"68d59d28-7efe-4ac2-955b-697b740b7781\") " pod="openshift-dns/node-resolver-9bb5n"
Sep 11 12:55:35.560405 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.560241    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-multus-cni-dir\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.560405 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.560275    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-log-socket\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.560405 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.560305    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-sys\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.560405 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.560329    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-host-var-lib-kubelet\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.560405 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.560351    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-multus-conf-dir\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.560405 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.560373    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sjlr\" (UniqueName: \"kubernetes.io/projected/4b821e09-a20a-457c-b22d-815df2b09e54-kube-api-access-8sjlr\") pod \"network-metrics-daemon-5jxc9\" (UID: \"4b821e09-a20a-457c-b22d-815df2b09e54\") " pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:55:35.560405 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.560397    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-host-run-ovn-kubernetes\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.560777 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.560420    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/de418b7e-552a-4d60-94bf-fcb75207e5ab-agent-certs\") pod \"konnectivity-agent-22m8j\" (UID: \"de418b7e-552a-4d60-94bf-fcb75207e5ab\") " pod="kube-system/konnectivity-agent-22m8j"
Sep 11 12:55:35.560777 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.560442    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4a0213c0-ea91-46ef-963b-eebfca575f1d-dbus\") pod \"global-pull-secret-syncer-hw4b9\" (UID: \"4a0213c0-ea91-46ef-963b-eebfca575f1d\") " pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:55:35.560777 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.560461    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-cnibin\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.560777 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.560481    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-host-run-netns\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.560777 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.560501    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcqrr\" (UniqueName: \"kubernetes.io/projected/11fe817e-d1fb-4e36-8794-2925002c1b3e-kube-api-access-wcqrr\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.560777 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.560527    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4004b7d0-e402-4d2b-8936-847ae50cbec3-device-dir\") pod \"aws-ebs-csi-driver-node-57h6r\" (UID: \"4004b7d0-e402-4d2b-8936-847ae50cbec3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57h6r"
Sep 11 12:55:35.560777 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.560547    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-host-run-netns\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.560777 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.560567    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-etc-sysconfig\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.560777 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.560600    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4004b7d0-e402-4d2b-8936-847ae50cbec3-registration-dir\") pod \"aws-ebs-csi-driver-node-57h6r\" (UID: \"4004b7d0-e402-4d2b-8936-847ae50cbec3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57h6r"
Sep 11 12:55:35.560777 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.560631    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.560777 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.560736    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-etc-sysctl-conf\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.561324 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.560761    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-run\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.561324 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.560832    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e640946e-2f4b-426a-85fb-a20784da1079-cni-binary-copy\") pod \"multus-additional-cni-plugins-4wpcw\" (UID: \"e640946e-2f4b-426a-85fb-a20784da1079\") " pod="openshift-multus/multus-additional-cni-plugins-4wpcw"
Sep 11 12:55:35.561324 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.560857    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e640946e-2f4b-426a-85fb-a20784da1079-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4wpcw\" (UID: \"e640946e-2f4b-426a-85fb-a20784da1079\") " pod="openshift-multus/multus-additional-cni-plugins-4wpcw"
Sep 11 12:55:35.561324 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.560881    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2mbl\" (UniqueName: \"kubernetes.io/projected/bc61a33f-faa2-4646-8197-40627ef9da72-kube-api-access-w2mbl\") pod \"network-check-target-4bvlc\" (UID: \"bc61a33f-faa2-4646-8197-40627ef9da72\") " pod="openshift-network-diagnostics/network-check-target-4bvlc"
Sep 11 12:55:35.561324 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.560903    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v5nc\" (UniqueName: \"kubernetes.io/projected/21d7503a-0156-478a-b2c2-8555a08faf52-kube-api-access-9v5nc\") pod \"node-ca-v26jw\" (UID: \"21d7503a-0156-478a-b2c2-8555a08faf52\") " pod="openshift-image-registry/node-ca-v26jw"
Sep 11 12:55:35.561324 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.560951    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-host-slash\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.561324 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.560980    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-var-lib-openvswitch\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.561324 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561005    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-host-var-lib-cni-bin\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.561324 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561025    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-host-cni-bin\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.561324 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561048    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz265\" (UniqueName: \"kubernetes.io/projected/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-kube-api-access-rz265\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.561324 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561069    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/de418b7e-552a-4d60-94bf-fcb75207e5ab-konnectivity-ca\") pod \"konnectivity-agent-22m8j\" (UID: \"de418b7e-552a-4d60-94bf-fcb75207e5ab\") " pod="kube-system/konnectivity-agent-22m8j"
Sep 11 12:55:35.561324 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561092    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/74fea4a1-c75b-48a8-ac5d-2d44b9b55732-host-slash\") pod \"iptables-alerter-hwqfb\" (UID: \"74fea4a1-c75b-48a8-ac5d-2d44b9b55732\") " pod="openshift-network-operator/iptables-alerter-hwqfb"
Sep 11 12:55:35.561324 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561107    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-run-openvswitch\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.561324 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561126    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6e4770ce-0b26-4af8-9aa9-f88c744db951-ovn-node-metrics-cert\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.561324 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561138    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-var-lib-kubelet\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.561324 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561152    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/68d59d28-7efe-4ac2-955b-697b740b7781-hosts-file\") pod \"node-resolver-9bb5n\" (UID: \"68d59d28-7efe-4ac2-955b-697b740b7781\") " pod="openshift-dns/node-resolver-9bb5n"
Sep 11 12:55:35.561881 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561218    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4004b7d0-e402-4d2b-8936-847ae50cbec3-socket-dir\") pod \"aws-ebs-csi-driver-node-57h6r\" (UID: \"4004b7d0-e402-4d2b-8936-847ae50cbec3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57h6r"
Sep 11 12:55:35.561881 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561244    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb6hk\" (UniqueName: \"kubernetes.io/projected/74fea4a1-c75b-48a8-ac5d-2d44b9b55732-kube-api-access-gb6hk\") pod \"iptables-alerter-hwqfb\" (UID: \"74fea4a1-c75b-48a8-ac5d-2d44b9b55732\") " pod="openshift-network-operator/iptables-alerter-hwqfb"
Sep 11 12:55:35.561881 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561271    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6e4770ce-0b26-4af8-9aa9-f88c744db951-ovnkube-script-lib\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.561881 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561302    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/21d7503a-0156-478a-b2c2-8555a08faf52-serviceca\") pod \"node-ca-v26jw\" (UID: \"21d7503a-0156-478a-b2c2-8555a08faf52\") " pod="openshift-image-registry/node-ca-v26jw"
Sep 11 12:55:35.561881 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561326    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-system-cni-dir\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.561881 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561359    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4004b7d0-e402-4d2b-8936-847ae50cbec3-etc-selinux\") pod \"aws-ebs-csi-driver-node-57h6r\" (UID: \"4004b7d0-e402-4d2b-8936-847ae50cbec3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57h6r"
Sep 11 12:55:35.561881 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561382    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/74fea4a1-c75b-48a8-ac5d-2d44b9b55732-iptables-alerter-script\") pod \"iptables-alerter-hwqfb\" (UID: \"74fea4a1-c75b-48a8-ac5d-2d44b9b55732\") " pod="openshift-network-operator/iptables-alerter-hwqfb"
Sep 11 12:55:35.561881 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561408    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-run-systemd\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.561881 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561436    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-etc-openvswitch\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.561881 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561464    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-run-ovn\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.561881 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561491    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-lib-modules\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.561881 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561516    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-host\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.561881 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561538    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a0213c0-ea91-46ef-963b-eebfca575f1d-original-pull-secret\") pod \"global-pull-secret-syncer-hw4b9\" (UID: \"4a0213c0-ea91-46ef-963b-eebfca575f1d\") " pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:55:35.561881 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561581    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-host-run-multus-certs\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.561881 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561605    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6e4770ce-0b26-4af8-9aa9-f88c744db951-ovnkube-config\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.561881 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561626    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sqmv\" (UniqueName: \"kubernetes.io/projected/6e4770ce-0b26-4af8-9aa9-f88c744db951-kube-api-access-2sqmv\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.562405 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561702    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-hostroot\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.562405 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561750    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-systemd-units\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.562405 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561773    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-etc-sysctl-d\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.562405 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561793    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-host-run-k8s-cni-cncf-io\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.562405 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561820    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/11fe817e-d1fb-4e36-8794-2925002c1b3e-multus-daemon-config\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.562405 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561842    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4004b7d0-e402-4d2b-8936-847ae50cbec3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-57h6r\" (UID: \"4004b7d0-e402-4d2b-8936-847ae50cbec3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57h6r"
Sep 11 12:55:35.562405 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561861    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4004b7d0-e402-4d2b-8936-847ae50cbec3-sys-fs\") pod \"aws-ebs-csi-driver-node-57h6r\" (UID: \"4004b7d0-e402-4d2b-8936-847ae50cbec3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57h6r"
Sep 11 12:55:35.562405 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561886    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-tmp\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.562405 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561908    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e640946e-2f4b-426a-85fb-a20784da1079-system-cni-dir\") pod \"multus-additional-cni-plugins-4wpcw\" (UID: \"e640946e-2f4b-426a-85fb-a20784da1079\") " pod="openshift-multus/multus-additional-cni-plugins-4wpcw"
Sep 11 12:55:35.562405 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561929    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-etc-kubernetes\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.562405 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561959    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e640946e-2f4b-426a-85fb-a20784da1079-cnibin\") pod \"multus-additional-cni-plugins-4wpcw\" (UID: \"e640946e-2f4b-426a-85fb-a20784da1079\") " pod="openshift-multus/multus-additional-cni-plugins-4wpcw"
Sep 11 12:55:35.562405 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.561980    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21d7503a-0156-478a-b2c2-8555a08faf52-host\") pod \"node-ca-v26jw\" (UID: \"21d7503a-0156-478a-b2c2-8555a08faf52\") " pod="openshift-image-registry/node-ca-v26jw"
Sep 11 12:55:35.562405 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.562001    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11fe817e-d1fb-4e36-8794-2925002c1b3e-cni-binary-copy\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.562405 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.562037    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfgpg\" (UniqueName: \"kubernetes.io/projected/4004b7d0-e402-4d2b-8936-847ae50cbec3-kube-api-access-tfgpg\") pod \"aws-ebs-csi-driver-node-57h6r\" (UID: \"4004b7d0-e402-4d2b-8936-847ae50cbec3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57h6r"
Sep 11 12:55:35.562405 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.562066    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-etc-tuned\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.562405 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.562086    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nh2p\" (UniqueName: \"kubernetes.io/projected/e640946e-2f4b-426a-85fb-a20784da1079-kube-api-access-9nh2p\") pod \"multus-additional-cni-plugins-4wpcw\" (UID: \"e640946e-2f4b-426a-85fb-a20784da1079\") " pod="openshift-multus/multus-additional-cni-plugins-4wpcw"
Sep 11 12:55:35.562972 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.562107    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4a0213c0-ea91-46ef-963b-eebfca575f1d-kubelet-config\") pod \"global-pull-secret-syncer-hw4b9\" (UID: \"4a0213c0-ea91-46ef-963b-eebfca575f1d\") " pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:55:35.562972 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.562126    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-multus-socket-dir-parent\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.562972 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.562143    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b821e09-a20a-457c-b22d-815df2b09e54-metrics-certs\") pod \"network-metrics-daemon-5jxc9\" (UID: \"4b821e09-a20a-457c-b22d-815df2b09e54\") " pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:55:35.562972 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.562157    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-host-kubelet\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.562972 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.562173    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-node-log\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.562972 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.562194    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-host-cni-netd\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.562972 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.562220    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-etc-systemd\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.562972 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.562342    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e640946e-2f4b-426a-85fb-a20784da1079-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4wpcw\" (UID: \"e640946e-2f4b-426a-85fb-a20784da1079\") " pod="openshift-multus/multus-additional-cni-plugins-4wpcw"
Sep 11 12:55:35.562972 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.562380    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68d59d28-7efe-4ac2-955b-697b740b7781-tmp-dir\") pod \"node-resolver-9bb5n\" (UID: \"68d59d28-7efe-4ac2-955b-697b740b7781\") " pod="openshift-dns/node-resolver-9bb5n"
Sep 11 12:55:35.562972 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.562453    2547 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 12:55:35.594036 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.594017    2547 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:55:35.595547 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.595528    2547 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-55zf4"
Sep 11 12:55:35.603761 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.603743    2547 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-55zf4"
Sep 11 12:55:35.662858 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.662833    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e640946e-2f4b-426a-85fb-a20784da1079-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4wpcw\" (UID: \"e640946e-2f4b-426a-85fb-a20784da1079\") " pod="openshift-multus/multus-additional-cni-plugins-4wpcw"
Sep 11 12:55:35.662986 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.662876    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68d59d28-7efe-4ac2-955b-697b740b7781-tmp-dir\") pod \"node-resolver-9bb5n\" (UID: \"68d59d28-7efe-4ac2-955b-697b740b7781\") " pod="openshift-dns/node-resolver-9bb5n"
Sep 11 12:55:35.662986 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.662899    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-host-var-lib-cni-multus\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.662986 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.662920    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-etc-kubernetes\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.662986 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.662965    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-etc-kubernetes\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.663187 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.662983    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-host-var-lib-cni-multus\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.663187 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663022    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6e4770ce-0b26-4af8-9aa9-f88c744db951-env-overrides\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.663187 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663048    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-etc-modprobe-d\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.663187 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663100    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e640946e-2f4b-426a-85fb-a20784da1079-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4wpcw\" (UID: \"e640946e-2f4b-426a-85fb-a20784da1079\") " pod="openshift-multus/multus-additional-cni-plugins-4wpcw"
Sep 11 12:55:35.663367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663187    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68d59d28-7efe-4ac2-955b-697b740b7781-tmp-dir\") pod \"node-resolver-9bb5n\" (UID: \"68d59d28-7efe-4ac2-955b-697b740b7781\") " pod="openshift-dns/node-resolver-9bb5n"
Sep 11 12:55:35.663367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663195    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpf7j\" (UniqueName: \"kubernetes.io/projected/68d59d28-7efe-4ac2-955b-697b740b7781-kube-api-access-gpf7j\") pod \"node-resolver-9bb5n\" (UID: \"68d59d28-7efe-4ac2-955b-697b740b7781\") " pod="openshift-dns/node-resolver-9bb5n"
Sep 11 12:55:35.663367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663219    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-multus-cni-dir\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.663367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663220    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-etc-modprobe-d\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.663367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663243    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-log-socket\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.663367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663266    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-sys\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.663367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663287    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-host-var-lib-kubelet\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.663367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663309    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-multus-conf-dir\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.663367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663332    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sjlr\" (UniqueName: \"kubernetes.io/projected/4b821e09-a20a-457c-b22d-815df2b09e54-kube-api-access-8sjlr\") pod \"network-metrics-daemon-5jxc9\" (UID: \"4b821e09-a20a-457c-b22d-815df2b09e54\") " pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:55:35.663367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663353    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-host-run-ovn-kubernetes\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.663846 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663370    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e640946e-2f4b-426a-85fb-a20784da1079-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4wpcw\" (UID: \"e640946e-2f4b-426a-85fb-a20784da1079\") " pod="openshift-multus/multus-additional-cni-plugins-4wpcw"
Sep 11 12:55:35.663846 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663380    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/de418b7e-552a-4d60-94bf-fcb75207e5ab-agent-certs\") pod \"konnectivity-agent-22m8j\" (UID: \"de418b7e-552a-4d60-94bf-fcb75207e5ab\") " pod="kube-system/konnectivity-agent-22m8j"
Sep 11 12:55:35.663846 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663414    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4a0213c0-ea91-46ef-963b-eebfca575f1d-dbus\") pod \"global-pull-secret-syncer-hw4b9\" (UID: \"4a0213c0-ea91-46ef-963b-eebfca575f1d\") " pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:55:35.663846 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663441    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-cnibin\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.663846 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663453    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-sys\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.663846 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663468    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-host-run-netns\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.663846 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663490    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcqrr\" (UniqueName: \"kubernetes.io/projected/11fe817e-d1fb-4e36-8794-2925002c1b3e-kube-api-access-wcqrr\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.663846 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663492    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e640946e-2f4b-426a-85fb-a20784da1079-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4wpcw\" (UID: \"e640946e-2f4b-426a-85fb-a20784da1079\") " pod="openshift-multus/multus-additional-cni-plugins-4wpcw"
Sep 11 12:55:35.663846 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663505    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-multus-cni-dir\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.663846 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663512    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4004b7d0-e402-4d2b-8936-847ae50cbec3-device-dir\") pod \"aws-ebs-csi-driver-node-57h6r\" (UID: \"4004b7d0-e402-4d2b-8936-847ae50cbec3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57h6r"
Sep 11 12:55:35.663846 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663517    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6e4770ce-0b26-4af8-9aa9-f88c744db951-env-overrides\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.663846 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663538    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-host-run-netns\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.663846 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663552    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-log-socket\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.663846 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663562    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-etc-sysconfig\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.663846 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663570    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-host-run-netns\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.663846 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663583    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4004b7d0-e402-4d2b-8936-847ae50cbec3-registration-dir\") pod \"aws-ebs-csi-driver-node-57h6r\" (UID: \"4004b7d0-e402-4d2b-8936-847ae50cbec3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57h6r"
Sep 11 12:55:35.663846 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663605    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-cnibin\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.663846 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663602    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4a0213c0-ea91-46ef-963b-eebfca575f1d-dbus\") pod \"global-pull-secret-syncer-hw4b9\" (UID: \"4a0213c0-ea91-46ef-963b-eebfca575f1d\") " pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:55:35.664473 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663609    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.664473 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663620    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4004b7d0-e402-4d2b-8936-847ae50cbec3-device-dir\") pod \"aws-ebs-csi-driver-node-57h6r\" (UID: \"4004b7d0-e402-4d2b-8936-847ae50cbec3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57h6r"
Sep 11 12:55:35.664473 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663736    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-etc-sysctl-conf\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.664473 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663757    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-etc-sysconfig\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.664473 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663780    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-run\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.664473 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663811    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-host-run-ovn-kubernetes\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.664473 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663816    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e640946e-2f4b-426a-85fb-a20784da1079-cni-binary-copy\") pod \"multus-additional-cni-plugins-4wpcw\" (UID: \"e640946e-2f4b-426a-85fb-a20784da1079\") " pod="openshift-multus/multus-additional-cni-plugins-4wpcw"
Sep 11 12:55:35.664473 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663856    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e640946e-2f4b-426a-85fb-a20784da1079-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4wpcw\" (UID: \"e640946e-2f4b-426a-85fb-a20784da1079\") " pod="openshift-multus/multus-additional-cni-plugins-4wpcw"
Sep 11 12:55:35.664473 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663868    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-run\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.664473 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663849    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-host-run-netns\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.664473 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663881    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2mbl\" (UniqueName: \"kubernetes.io/projected/bc61a33f-faa2-4646-8197-40627ef9da72-kube-api-access-w2mbl\") pod \"network-check-target-4bvlc\" (UID: \"bc61a33f-faa2-4646-8197-40627ef9da72\") " pod="openshift-network-diagnostics/network-check-target-4bvlc"
Sep 11 12:55:35.664473 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663780    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4004b7d0-e402-4d2b-8936-847ae50cbec3-registration-dir\") pod \"aws-ebs-csi-driver-node-57h6r\" (UID: \"4004b7d0-e402-4d2b-8936-847ae50cbec3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57h6r"
Sep 11 12:55:35.664473 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663902    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.664473 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663910    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-host-var-lib-kubelet\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.664473 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663936    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v5nc\" (UniqueName: \"kubernetes.io/projected/21d7503a-0156-478a-b2c2-8555a08faf52-kube-api-access-9v5nc\") pod \"node-ca-v26jw\" (UID: \"21d7503a-0156-478a-b2c2-8555a08faf52\") " pod="openshift-image-registry/node-ca-v26jw"
Sep 11 12:55:35.664473 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.663969    2547 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 12:55:35.664473 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.664004    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-host-slash\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.665290 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.664062    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-host-slash\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.665290 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.664117    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-var-lib-openvswitch\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.665290 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.664197    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-multus-conf-dir\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.665290 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.664230    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-host-var-lib-cni-bin\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.665290 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.664257    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-var-lib-openvswitch\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.665290 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.664297    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-etc-sysctl-conf\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.665290 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.664373    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-host-cni-bin\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.665290 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.664533    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz265\" (UniqueName: \"kubernetes.io/projected/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-kube-api-access-rz265\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.665290 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.664427    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-host-cni-bin\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.665290 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.664467    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-host-var-lib-cni-bin\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.665290 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.664582    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/de418b7e-552a-4d60-94bf-fcb75207e5ab-konnectivity-ca\") pod \"konnectivity-agent-22m8j\" (UID: \"de418b7e-552a-4d60-94bf-fcb75207e5ab\") " pod="kube-system/konnectivity-agent-22m8j"
Sep 11 12:55:35.665290 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.664597    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e640946e-2f4b-426a-85fb-a20784da1079-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4wpcw\" (UID: \"e640946e-2f4b-426a-85fb-a20784da1079\") " pod="openshift-multus/multus-additional-cni-plugins-4wpcw"
Sep 11 12:55:35.665290 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.664609    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/74fea4a1-c75b-48a8-ac5d-2d44b9b55732-host-slash\") pod \"iptables-alerter-hwqfb\" (UID: \"74fea4a1-c75b-48a8-ac5d-2d44b9b55732\") " pod="openshift-network-operator/iptables-alerter-hwqfb"
Sep 11 12:55:35.665290 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.664654    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e640946e-2f4b-426a-85fb-a20784da1079-cni-binary-copy\") pod \"multus-additional-cni-plugins-4wpcw\" (UID: \"e640946e-2f4b-426a-85fb-a20784da1079\") " pod="openshift-multus/multus-additional-cni-plugins-4wpcw"
Sep 11 12:55:35.665290 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.664658    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/74fea4a1-c75b-48a8-ac5d-2d44b9b55732-host-slash\") pod \"iptables-alerter-hwqfb\" (UID: \"74fea4a1-c75b-48a8-ac5d-2d44b9b55732\") " pod="openshift-network-operator/iptables-alerter-hwqfb"
Sep 11 12:55:35.665290 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.664728    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-run-openvswitch\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.665290 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.664761    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6e4770ce-0b26-4af8-9aa9-f88c744db951-ovn-node-metrics-cert\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.666087 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.664784    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-var-lib-kubelet\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.666087 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.664812    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/68d59d28-7efe-4ac2-955b-697b740b7781-hosts-file\") pod \"node-resolver-9bb5n\" (UID: \"68d59d28-7efe-4ac2-955b-697b740b7781\") " pod="openshift-dns/node-resolver-9bb5n"
Sep 11 12:55:35.666087 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.664814    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-run-openvswitch\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.666087 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.664847    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4004b7d0-e402-4d2b-8936-847ae50cbec3-socket-dir\") pod \"aws-ebs-csi-driver-node-57h6r\" (UID: \"4004b7d0-e402-4d2b-8936-847ae50cbec3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57h6r"
Sep 11 12:55:35.666087 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.664866    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/68d59d28-7efe-4ac2-955b-697b740b7781-hosts-file\") pod \"node-resolver-9bb5n\" (UID: \"68d59d28-7efe-4ac2-955b-697b740b7781\") " pod="openshift-dns/node-resolver-9bb5n"
Sep 11 12:55:35.666087 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.664874    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb6hk\" (UniqueName: \"kubernetes.io/projected/74fea4a1-c75b-48a8-ac5d-2d44b9b55732-kube-api-access-gb6hk\") pod \"iptables-alerter-hwqfb\" (UID: \"74fea4a1-c75b-48a8-ac5d-2d44b9b55732\") " pod="openshift-network-operator/iptables-alerter-hwqfb"
Sep 11 12:55:35.666087 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.664900    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6e4770ce-0b26-4af8-9aa9-f88c744db951-ovnkube-script-lib\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.666087 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.664912    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-var-lib-kubelet\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.666087 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.664926    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/21d7503a-0156-478a-b2c2-8555a08faf52-serviceca\") pod \"node-ca-v26jw\" (UID: \"21d7503a-0156-478a-b2c2-8555a08faf52\") " pod="openshift-image-registry/node-ca-v26jw"
Sep 11 12:55:35.666087 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.664948    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-system-cni-dir\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.666087 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.664970    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4004b7d0-e402-4d2b-8936-847ae50cbec3-etc-selinux\") pod \"aws-ebs-csi-driver-node-57h6r\" (UID: \"4004b7d0-e402-4d2b-8936-847ae50cbec3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57h6r"
Sep 11 12:55:35.666087 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.664991    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/74fea4a1-c75b-48a8-ac5d-2d44b9b55732-iptables-alerter-script\") pod \"iptables-alerter-hwqfb\" (UID: \"74fea4a1-c75b-48a8-ac5d-2d44b9b55732\") " pod="openshift-network-operator/iptables-alerter-hwqfb"
Sep 11 12:55:35.666087 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665006    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/de418b7e-552a-4d60-94bf-fcb75207e5ab-konnectivity-ca\") pod \"konnectivity-agent-22m8j\" (UID: \"de418b7e-552a-4d60-94bf-fcb75207e5ab\") " pod="kube-system/konnectivity-agent-22m8j"
Sep 11 12:55:35.666087 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665011    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-run-systemd\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.666087 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665031    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-etc-openvswitch\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.666087 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665071    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-run-ovn\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.666087 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665095    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4004b7d0-e402-4d2b-8936-847ae50cbec3-socket-dir\") pod \"aws-ebs-csi-driver-node-57h6r\" (UID: \"4004b7d0-e402-4d2b-8936-847ae50cbec3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57h6r"
Sep 11 12:55:35.666864 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665095    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-system-cni-dir\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.666864 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665110    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-run-ovn\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.666864 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665150    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-etc-openvswitch\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.666864 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665191    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4004b7d0-e402-4d2b-8936-847ae50cbec3-etc-selinux\") pod \"aws-ebs-csi-driver-node-57h6r\" (UID: \"4004b7d0-e402-4d2b-8936-847ae50cbec3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57h6r"
Sep 11 12:55:35.666864 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665189    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-run-systemd\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.666864 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665215    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-lib-modules\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.666864 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665236    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-host\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.666864 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665258    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a0213c0-ea91-46ef-963b-eebfca575f1d-original-pull-secret\") pod \"global-pull-secret-syncer-hw4b9\" (UID: \"4a0213c0-ea91-46ef-963b-eebfca575f1d\") " pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:55:35.666864 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665267    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-lib-modules\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.666864 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665290    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-host-run-multus-certs\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.666864 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665313    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6e4770ce-0b26-4af8-9aa9-f88c744db951-ovnkube-config\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.666864 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665335    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sqmv\" (UniqueName: \"kubernetes.io/projected/6e4770ce-0b26-4af8-9aa9-f88c744db951-kube-api-access-2sqmv\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.666864 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:35.665338    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:55:35.666864 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665374    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-hostroot\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.666864 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:35.665399    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a0213c0-ea91-46ef-963b-eebfca575f1d-original-pull-secret podName:4a0213c0-ea91-46ef-963b-eebfca575f1d nodeName:}" failed. No retries permitted until 2026-09-11 12:55:36.165378208 +0000 UTC m=+3.026852375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a0213c0-ea91-46ef-963b-eebfca575f1d-original-pull-secret") pod "global-pull-secret-syncer-hw4b9" (UID: "4a0213c0-ea91-46ef-963b-eebfca575f1d") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:55:35.666864 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665408    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-hostroot\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.666864 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665429    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-systemd-units\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.667418 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665447    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-host-run-multus-certs\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.667418 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665453    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-etc-sysctl-d\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.667418 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665479    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-host-run-k8s-cni-cncf-io\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.667418 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665487    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/21d7503a-0156-478a-b2c2-8555a08faf52-serviceca\") pod \"node-ca-v26jw\" (UID: \"21d7503a-0156-478a-b2c2-8555a08faf52\") " pod="openshift-image-registry/node-ca-v26jw"
Sep 11 12:55:35.667418 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665500    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/11fe817e-d1fb-4e36-8794-2925002c1b3e-multus-daemon-config\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.667418 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665524    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4004b7d0-e402-4d2b-8936-847ae50cbec3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-57h6r\" (UID: \"4004b7d0-e402-4d2b-8936-847ae50cbec3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57h6r"
Sep 11 12:55:35.667418 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665543    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4004b7d0-e402-4d2b-8936-847ae50cbec3-sys-fs\") pod \"aws-ebs-csi-driver-node-57h6r\" (UID: \"4004b7d0-e402-4d2b-8936-847ae50cbec3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57h6r"
Sep 11 12:55:35.667418 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665563    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-tmp\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.667418 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665583    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e640946e-2f4b-426a-85fb-a20784da1079-system-cni-dir\") pod \"multus-additional-cni-plugins-4wpcw\" (UID: \"e640946e-2f4b-426a-85fb-a20784da1079\") " pod="openshift-multus/multus-additional-cni-plugins-4wpcw"
Sep 11 12:55:35.667418 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665605    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-etc-kubernetes\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.667418 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665591    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/74fea4a1-c75b-48a8-ac5d-2d44b9b55732-iptables-alerter-script\") pod \"iptables-alerter-hwqfb\" (UID: \"74fea4a1-c75b-48a8-ac5d-2d44b9b55732\") " pod="openshift-network-operator/iptables-alerter-hwqfb"
Sep 11 12:55:35.667418 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665639    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e640946e-2f4b-426a-85fb-a20784da1079-cnibin\") pod \"multus-additional-cni-plugins-4wpcw\" (UID: \"e640946e-2f4b-426a-85fb-a20784da1079\") " pod="openshift-multus/multus-additional-cni-plugins-4wpcw"
Sep 11 12:55:35.667418 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665663    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21d7503a-0156-478a-b2c2-8555a08faf52-host\") pod \"node-ca-v26jw\" (UID: \"21d7503a-0156-478a-b2c2-8555a08faf52\") " pod="openshift-image-registry/node-ca-v26jw"
Sep 11 12:55:35.667418 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665688    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11fe817e-d1fb-4e36-8794-2925002c1b3e-cni-binary-copy\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.667418 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665679    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-host-run-k8s-cni-cncf-io\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.667418 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665737    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfgpg\" (UniqueName: \"kubernetes.io/projected/4004b7d0-e402-4d2b-8936-847ae50cbec3-kube-api-access-tfgpg\") pod \"aws-ebs-csi-driver-node-57h6r\" (UID: \"4004b7d0-e402-4d2b-8936-847ae50cbec3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57h6r"
Sep 11 12:55:35.667418 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665747    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6e4770ce-0b26-4af8-9aa9-f88c744db951-ovnkube-script-lib\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.668032 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665759    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-etc-tuned\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.668032 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665787    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nh2p\" (UniqueName: \"kubernetes.io/projected/e640946e-2f4b-426a-85fb-a20784da1079-kube-api-access-9nh2p\") pod \"multus-additional-cni-plugins-4wpcw\" (UID: \"e640946e-2f4b-426a-85fb-a20784da1079\") " pod="openshift-multus/multus-additional-cni-plugins-4wpcw"
Sep 11 12:55:35.668032 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665814    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4a0213c0-ea91-46ef-963b-eebfca575f1d-kubelet-config\") pod \"global-pull-secret-syncer-hw4b9\" (UID: \"4a0213c0-ea91-46ef-963b-eebfca575f1d\") " pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:55:35.668032 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665820    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4004b7d0-e402-4d2b-8936-847ae50cbec3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-57h6r\" (UID: \"4004b7d0-e402-4d2b-8936-847ae50cbec3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57h6r"
Sep 11 12:55:35.668032 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665840    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-multus-socket-dir-parent\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.668032 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665874    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b821e09-a20a-457c-b22d-815df2b09e54-metrics-certs\") pod \"network-metrics-daemon-5jxc9\" (UID: \"4b821e09-a20a-457c-b22d-815df2b09e54\") " pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:55:35.668032 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665905    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-host-kubelet\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.668032 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665916    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6e4770ce-0b26-4af8-9aa9-f88c744db951-ovnkube-config\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.668032 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665927    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-node-log\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.668032 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665934    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/11fe817e-d1fb-4e36-8794-2925002c1b3e-multus-socket-dir-parent\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.668032 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665951    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-host-cni-netd\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.668032 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665977    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4004b7d0-e402-4d2b-8936-847ae50cbec3-sys-fs\") pod \"aws-ebs-csi-driver-node-57h6r\" (UID: \"4004b7d0-e402-4d2b-8936-847ae50cbec3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57h6r"
Sep 11 12:55:35.668032 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665994    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-etc-systemd\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.668032 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.666009    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-host-kubelet\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.668032 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:35.666054    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:55:35.668032 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665759    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-host\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.668032 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.666124    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-node-log\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.668032 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.665927    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-systemd-units\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.668796 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.666207    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-etc-sysctl-d\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.668796 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.666298    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6e4770ce-0b26-4af8-9aa9-f88c744db951-host-cni-netd\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.668796 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.666416    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/11fe817e-d1fb-4e36-8794-2925002c1b3e-multus-daemon-config\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.668796 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.666476    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4a0213c0-ea91-46ef-963b-eebfca575f1d-kubelet-config\") pod \"global-pull-secret-syncer-hw4b9\" (UID: \"4a0213c0-ea91-46ef-963b-eebfca575f1d\") " pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:55:35.668796 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:35.666484    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b821e09-a20a-457c-b22d-815df2b09e54-metrics-certs podName:4b821e09-a20a-457c-b22d-815df2b09e54 nodeName:}" failed. No retries permitted until 2026-09-11 12:55:36.166458495 +0000 UTC m=+3.027932673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b821e09-a20a-457c-b22d-815df2b09e54-metrics-certs") pod "network-metrics-daemon-5jxc9" (UID: "4b821e09-a20a-457c-b22d-815df2b09e54") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:55:35.668796 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.666475    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e640946e-2f4b-426a-85fb-a20784da1079-system-cni-dir\") pod \"multus-additional-cni-plugins-4wpcw\" (UID: \"e640946e-2f4b-426a-85fb-a20784da1079\") " pod="openshift-multus/multus-additional-cni-plugins-4wpcw"
Sep 11 12:55:35.668796 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.666530    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e640946e-2f4b-426a-85fb-a20784da1079-cnibin\") pod \"multus-additional-cni-plugins-4wpcw\" (UID: \"e640946e-2f4b-426a-85fb-a20784da1079\") " pod="openshift-multus/multus-additional-cni-plugins-4wpcw"
Sep 11 12:55:35.668796 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.666565    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21d7503a-0156-478a-b2c2-8555a08faf52-host\") pod \"node-ca-v26jw\" (UID: \"21d7503a-0156-478a-b2c2-8555a08faf52\") " pod="openshift-image-registry/node-ca-v26jw"
Sep 11 12:55:35.668796 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.666676    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-etc-kubernetes\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.668796 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.666901    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-etc-systemd\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.668796 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.666979    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11fe817e-d1fb-4e36-8794-2925002c1b3e-cni-binary-copy\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.668796 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.668182    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-tmp\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.668796 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.668310    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6e4770ce-0b26-4af8-9aa9-f88c744db951-ovn-node-metrics-cert\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.668796 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.668796    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/de418b7e-552a-4d60-94bf-fcb75207e5ab-agent-certs\") pod \"konnectivity-agent-22m8j\" (UID: \"de418b7e-552a-4d60-94bf-fcb75207e5ab\") " pod="kube-system/konnectivity-agent-22m8j"
Sep 11 12:55:35.669404 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.669233    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-etc-tuned\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.679272 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:35.679248    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:55:35.679272 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:35.679273    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:55:35.679414 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:35.679289    2547 projected.go:196] Error preparing data for projected volume kube-api-access-w2mbl for pod openshift-network-diagnostics/network-check-target-4bvlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:55:35.679414 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:35.679334    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc61a33f-faa2-4646-8197-40627ef9da72-kube-api-access-w2mbl podName:bc61a33f-faa2-4646-8197-40627ef9da72 nodeName:}" failed. No retries permitted until 2026-09-11 12:55:36.179318699 +0000 UTC m=+3.040792878 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-w2mbl" (UniqueName: "kubernetes.io/projected/bc61a33f-faa2-4646-8197-40627ef9da72-kube-api-access-w2mbl") pod "network-check-target-4bvlc" (UID: "bc61a33f-faa2-4646-8197-40627ef9da72") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:55:35.682450 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.682421    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb6hk\" (UniqueName: \"kubernetes.io/projected/74fea4a1-c75b-48a8-ac5d-2d44b9b55732-kube-api-access-gb6hk\") pod \"iptables-alerter-hwqfb\" (UID: \"74fea4a1-c75b-48a8-ac5d-2d44b9b55732\") " pod="openshift-network-operator/iptables-alerter-hwqfb"
Sep 11 12:55:35.682539 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.682430    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sqmv\" (UniqueName: \"kubernetes.io/projected/6e4770ce-0b26-4af8-9aa9-f88c744db951-kube-api-access-2sqmv\") pod \"ovnkube-node-bx8zk\" (UID: \"6e4770ce-0b26-4af8-9aa9-f88c744db951\") " pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.682539 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.682429    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v5nc\" (UniqueName: \"kubernetes.io/projected/21d7503a-0156-478a-b2c2-8555a08faf52-kube-api-access-9v5nc\") pod \"node-ca-v26jw\" (UID: \"21d7503a-0156-478a-b2c2-8555a08faf52\") " pod="openshift-image-registry/node-ca-v26jw"
Sep 11 12:55:35.683350 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.683326    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sjlr\" (UniqueName: \"kubernetes.io/projected/4b821e09-a20a-457c-b22d-815df2b09e54-kube-api-access-8sjlr\") pod \"network-metrics-daemon-5jxc9\" (UID: \"4b821e09-a20a-457c-b22d-815df2b09e54\") " pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:55:35.684216 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.684164    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz265\" (UniqueName: \"kubernetes.io/projected/8f0f828c-0dac-442d-a850-ac2f3e9fe8ae-kube-api-access-rz265\") pod \"tuned-l5nls\" (UID: \"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.685204 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.685184    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpf7j\" (UniqueName: \"kubernetes.io/projected/68d59d28-7efe-4ac2-955b-697b740b7781-kube-api-access-gpf7j\") pod \"node-resolver-9bb5n\" (UID: \"68d59d28-7efe-4ac2-955b-697b740b7781\") " pod="openshift-dns/node-resolver-9bb5n"
Sep 11 12:55:35.685302 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.685169    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfgpg\" (UniqueName: \"kubernetes.io/projected/4004b7d0-e402-4d2b-8936-847ae50cbec3-kube-api-access-tfgpg\") pod \"aws-ebs-csi-driver-node-57h6r\" (UID: \"4004b7d0-e402-4d2b-8936-847ae50cbec3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57h6r"
Sep 11 12:55:35.685302 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.685235    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcqrr\" (UniqueName: \"kubernetes.io/projected/11fe817e-d1fb-4e36-8794-2925002c1b3e-kube-api-access-wcqrr\") pod \"multus-zhbh2\" (UID: \"11fe817e-d1fb-4e36-8794-2925002c1b3e\") " pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.687340 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.687317    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nh2p\" (UniqueName: \"kubernetes.io/projected/e640946e-2f4b-426a-85fb-a20784da1079-kube-api-access-9nh2p\") pod \"multus-additional-cni-plugins-4wpcw\" (UID: \"e640946e-2f4b-426a-85fb-a20784da1079\") " pod="openshift-multus/multus-additional-cni-plugins-4wpcw"
Sep 11 12:55:35.843989 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.843923    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:55:35.851442 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.851423    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l5nls"
Sep 11 12:55:35.859131 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.859110    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v26jw"
Sep 11 12:55:35.864036 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.864016    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4wpcw"
Sep 11 12:55:35.869932 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.869917    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zhbh2"
Sep 11 12:55:35.876040 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.876023    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-22m8j"
Sep 11 12:55:35.881632 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.881612    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57h6r"
Sep 11 12:55:35.888130 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.888112    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hwqfb"
Sep 11 12:55:35.892533 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:35.892514    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9bb5n"
Sep 11 12:55:36.169964 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:36.169888    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b821e09-a20a-457c-b22d-815df2b09e54-metrics-certs\") pod \"network-metrics-daemon-5jxc9\" (UID: \"4b821e09-a20a-457c-b22d-815df2b09e54\") " pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:55:36.170101 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:36.169979    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a0213c0-ea91-46ef-963b-eebfca575f1d-original-pull-secret\") pod \"global-pull-secret-syncer-hw4b9\" (UID: \"4a0213c0-ea91-46ef-963b-eebfca575f1d\") " pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:55:36.170101 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:36.170046    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:55:36.170101 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:36.170077    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:55:36.170221 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:36.170120    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b821e09-a20a-457c-b22d-815df2b09e54-metrics-certs podName:4b821e09-a20a-457c-b22d-815df2b09e54 nodeName:}" failed. No retries permitted until 2026-09-11 12:55:37.170100804 +0000 UTC m=+4.031574981 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b821e09-a20a-457c-b22d-815df2b09e54-metrics-certs") pod "network-metrics-daemon-5jxc9" (UID: "4b821e09-a20a-457c-b22d-815df2b09e54") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:55:36.170221 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:36.170138    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a0213c0-ea91-46ef-963b-eebfca575f1d-original-pull-secret podName:4a0213c0-ea91-46ef-963b-eebfca575f1d nodeName:}" failed. No retries permitted until 2026-09-11 12:55:37.170129156 +0000 UTC m=+4.031603324 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a0213c0-ea91-46ef-963b-eebfca575f1d-original-pull-secret") pod "global-pull-secret-syncer-hw4b9" (UID: "4a0213c0-ea91-46ef-963b-eebfca575f1d") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:55:36.270350 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:36.270314    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2mbl\" (UniqueName: \"kubernetes.io/projected/bc61a33f-faa2-4646-8197-40627ef9da72-kube-api-access-w2mbl\") pod \"network-check-target-4bvlc\" (UID: \"bc61a33f-faa2-4646-8197-40627ef9da72\") " pod="openshift-network-diagnostics/network-check-target-4bvlc"
Sep 11 12:55:36.270515 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:36.270492    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:55:36.270515 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:36.270513    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:55:36.270593 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:36.270523    2547 projected.go:196] Error preparing data for projected volume kube-api-access-w2mbl for pod openshift-network-diagnostics/network-check-target-4bvlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:55:36.270593 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:36.270581    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc61a33f-faa2-4646-8197-40627ef9da72-kube-api-access-w2mbl podName:bc61a33f-faa2-4646-8197-40627ef9da72 nodeName:}" failed. No retries permitted until 2026-09-11 12:55:37.270561927 +0000 UTC m=+4.132036091 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-w2mbl" (UniqueName: "kubernetes.io/projected/bc61a33f-faa2-4646-8197-40627ef9da72-kube-api-access-w2mbl") pod "network-check-target-4bvlc" (UID: "bc61a33f-faa2-4646-8197-40627ef9da72") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:55:36.406578 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:36.406550    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11fe817e_d1fb_4e36_8794_2925002c1b3e.slice/crio-01a5dcac21e03e930a00a0efd8f6d59257a424064f833c4018da050bfaf3d42c WatchSource:0}: Error finding container 01a5dcac21e03e930a00a0efd8f6d59257a424064f833c4018da050bfaf3d42c: Status 404 returned error can't find the container with id 01a5dcac21e03e930a00a0efd8f6d59257a424064f833c4018da050bfaf3d42c
Sep 11 12:55:36.407541 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:36.407518    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21d7503a_0156_478a_b2c2_8555a08faf52.slice/crio-0890ef35f76c1538f86c51e3e8bdd50144b1207981c7bfdb0ee1e2067b63e6b1 WatchSource:0}: Error finding container 0890ef35f76c1538f86c51e3e8bdd50144b1207981c7bfdb0ee1e2067b63e6b1: Status 404 returned error can't find the container with id 0890ef35f76c1538f86c51e3e8bdd50144b1207981c7bfdb0ee1e2067b63e6b1
Sep 11 12:55:36.408466 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:36.408444    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode640946e_2f4b_426a_85fb_a20784da1079.slice/crio-64450f7b23b719757bd7e251b59dfd817613905bc183f1732b0109f66c5f6ca6 WatchSource:0}: Error finding container 64450f7b23b719757bd7e251b59dfd817613905bc183f1732b0109f66c5f6ca6: Status 404 returned error can't find the container with id 64450f7b23b719757bd7e251b59dfd817613905bc183f1732b0109f66c5f6ca6
Sep 11 12:55:36.409163 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:36.409080    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f0f828c_0dac_442d_a850_ac2f3e9fe8ae.slice/crio-6eaaafdddd3f3a7aad0e19dcd7aeaa411cc2ebaa00e132318ca95880cc012bc6 WatchSource:0}: Error finding container 6eaaafdddd3f3a7aad0e19dcd7aeaa411cc2ebaa00e132318ca95880cc012bc6: Status 404 returned error can't find the container with id 6eaaafdddd3f3a7aad0e19dcd7aeaa411cc2ebaa00e132318ca95880cc012bc6
Sep 11 12:55:36.409924 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:36.409874    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74fea4a1_c75b_48a8_ac5d_2d44b9b55732.slice/crio-d050ee7bc525be5261de99ee46f59d39eda9a764832164b95ddfbbe1c868ad69 WatchSource:0}: Error finding container d050ee7bc525be5261de99ee46f59d39eda9a764832164b95ddfbbe1c868ad69: Status 404 returned error can't find the container with id d050ee7bc525be5261de99ee46f59d39eda9a764832164b95ddfbbe1c868ad69
Sep 11 12:55:36.412257 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:36.412239    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68d59d28_7efe_4ac2_955b_697b740b7781.slice/crio-18ace8208692a9b78b90f71cd88ac9cba3201bc979c6fa9692f7ec8a17f26b6e WatchSource:0}: Error finding container 18ace8208692a9b78b90f71cd88ac9cba3201bc979c6fa9692f7ec8a17f26b6e: Status 404 returned error can't find the container with id 18ace8208692a9b78b90f71cd88ac9cba3201bc979c6fa9692f7ec8a17f26b6e
Sep 11 12:55:36.414646 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:36.413510    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde418b7e_552a_4d60_94bf_fcb75207e5ab.slice/crio-e54d0efb2e4ad3f6534ecda6162b887c50653dd6d6b9a9635ab11be2463b8fe3 WatchSource:0}: Error finding container e54d0efb2e4ad3f6534ecda6162b887c50653dd6d6b9a9635ab11be2463b8fe3: Status 404 returned error can't find the container with id e54d0efb2e4ad3f6534ecda6162b887c50653dd6d6b9a9635ab11be2463b8fe3
Sep 11 12:55:36.414646 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:36.413984    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4004b7d0_e402_4d2b_8936_847ae50cbec3.slice/crio-5b0df1771377cd1021978a63436ecd8137bce86f60f54ba13de3bf2f4183b626 WatchSource:0}: Error finding container 5b0df1771377cd1021978a63436ecd8137bce86f60f54ba13de3bf2f4183b626: Status 404 returned error can't find the container with id 5b0df1771377cd1021978a63436ecd8137bce86f60f54ba13de3bf2f4183b626
Sep 11 12:55:36.415900 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:55:36.415881    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e4770ce_0b26_4af8_9aa9_f88c744db951.slice/crio-7f6416b39c7f3ff391b9a62f266264e1f600c569bf8653219fc038136a393276 WatchSource:0}: Error finding container 7f6416b39c7f3ff391b9a62f266264e1f600c569bf8653219fc038136a393276: Status 404 returned error can't find the container with id 7f6416b39c7f3ff391b9a62f266264e1f600c569bf8653219fc038136a393276
Sep 11 12:55:36.605449 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:36.605415    2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 12:50:35 +0000 UTC" deadline="2028-03-10 17:39:48.844499849 +0000 UTC"
Sep 11 12:55:36.605449 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:36.605445    2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13108h44m12.239059018s"
Sep 11 12:55:36.675229 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:36.675165    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-79.ec2.internal" event={"ID":"0f092973866d00f19dd94cc0896a8414","Type":"ContainerStarted","Data":"75ab3e5880a94fe7922684e730b2077aa5b0dae3f1b71f9dffa5bb8d6154a78a"}
Sep 11 12:55:36.676316 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:36.676292    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9bb5n" event={"ID":"68d59d28-7efe-4ac2-955b-697b740b7781","Type":"ContainerStarted","Data":"18ace8208692a9b78b90f71cd88ac9cba3201bc979c6fa9692f7ec8a17f26b6e"}
Sep 11 12:55:36.677415 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:36.677391    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hwqfb" event={"ID":"74fea4a1-c75b-48a8-ac5d-2d44b9b55732","Type":"ContainerStarted","Data":"d050ee7bc525be5261de99ee46f59d39eda9a764832164b95ddfbbe1c868ad69"}
Sep 11 12:55:36.678611 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:36.678578    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l5nls" event={"ID":"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae","Type":"ContainerStarted","Data":"6eaaafdddd3f3a7aad0e19dcd7aeaa411cc2ebaa00e132318ca95880cc012bc6"}
Sep 11 12:55:36.683608 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:36.683580    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zhbh2" event={"ID":"11fe817e-d1fb-4e36-8794-2925002c1b3e","Type":"ContainerStarted","Data":"01a5dcac21e03e930a00a0efd8f6d59257a424064f833c4018da050bfaf3d42c"}
Sep 11 12:55:36.684741 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:36.684696    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk" event={"ID":"6e4770ce-0b26-4af8-9aa9-f88c744db951","Type":"ContainerStarted","Data":"7f6416b39c7f3ff391b9a62f266264e1f600c569bf8653219fc038136a393276"}
Sep 11 12:55:36.685952 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:36.685933    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-22m8j" event={"ID":"de418b7e-552a-4d60-94bf-fcb75207e5ab","Type":"ContainerStarted","Data":"e54d0efb2e4ad3f6534ecda6162b887c50653dd6d6b9a9635ab11be2463b8fe3"}
Sep 11 12:55:36.686927 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:36.686905    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57h6r" event={"ID":"4004b7d0-e402-4d2b-8936-847ae50cbec3","Type":"ContainerStarted","Data":"5b0df1771377cd1021978a63436ecd8137bce86f60f54ba13de3bf2f4183b626"}
Sep 11 12:55:36.688005 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:36.687983    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4wpcw" event={"ID":"e640946e-2f4b-426a-85fb-a20784da1079","Type":"ContainerStarted","Data":"64450f7b23b719757bd7e251b59dfd817613905bc183f1732b0109f66c5f6ca6"}
Sep 11 12:55:36.688409 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:36.688376    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-79.ec2.internal" podStartSLOduration=2.6883658070000003 podStartE2EDuration="2.688365807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:55:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:55:36.687888642 +0000 UTC m=+3.549362827" watchObservedRunningTime="2026-09-11 12:55:36.688365807 +0000 UTC m=+3.549839992"
Sep 11 12:55:36.689050 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:36.689031    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v26jw" event={"ID":"21d7503a-0156-478a-b2c2-8555a08faf52","Type":"ContainerStarted","Data":"0890ef35f76c1538f86c51e3e8bdd50144b1207981c7bfdb0ee1e2067b63e6b1"}
Sep 11 12:55:37.176935 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:37.176896    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b821e09-a20a-457c-b22d-815df2b09e54-metrics-certs\") pod \"network-metrics-daemon-5jxc9\" (UID: \"4b821e09-a20a-457c-b22d-815df2b09e54\") " pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:55:37.177098 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:37.176984    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a0213c0-ea91-46ef-963b-eebfca575f1d-original-pull-secret\") pod \"global-pull-secret-syncer-hw4b9\" (UID: \"4a0213c0-ea91-46ef-963b-eebfca575f1d\") " pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:55:37.177177 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:37.177102    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:55:37.177177 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:37.177162    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a0213c0-ea91-46ef-963b-eebfca575f1d-original-pull-secret podName:4a0213c0-ea91-46ef-963b-eebfca575f1d nodeName:}" failed. No retries permitted until 2026-09-11 12:55:39.17714452 +0000 UTC m=+6.038618690 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a0213c0-ea91-46ef-963b-eebfca575f1d-original-pull-secret") pod "global-pull-secret-syncer-hw4b9" (UID: "4a0213c0-ea91-46ef-963b-eebfca575f1d") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:55:37.177566 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:37.177544    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:55:37.177670 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:37.177603    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b821e09-a20a-457c-b22d-815df2b09e54-metrics-certs podName:4b821e09-a20a-457c-b22d-815df2b09e54 nodeName:}" failed. No retries permitted until 2026-09-11 12:55:39.177586165 +0000 UTC m=+6.039060331 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b821e09-a20a-457c-b22d-815df2b09e54-metrics-certs") pod "network-metrics-daemon-5jxc9" (UID: "4b821e09-a20a-457c-b22d-815df2b09e54") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:55:37.277642 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:37.277585    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2mbl\" (UniqueName: \"kubernetes.io/projected/bc61a33f-faa2-4646-8197-40627ef9da72-kube-api-access-w2mbl\") pod \"network-check-target-4bvlc\" (UID: \"bc61a33f-faa2-4646-8197-40627ef9da72\") " pod="openshift-network-diagnostics/network-check-target-4bvlc"
Sep 11 12:55:37.277831 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:37.277769    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:55:37.277831 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:37.277791    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:55:37.277831 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:37.277803    2547 projected.go:196] Error preparing data for projected volume kube-api-access-w2mbl for pod openshift-network-diagnostics/network-check-target-4bvlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:55:37.278022 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:37.277863    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc61a33f-faa2-4646-8197-40627ef9da72-kube-api-access-w2mbl podName:bc61a33f-faa2-4646-8197-40627ef9da72 nodeName:}" failed. No retries permitted until 2026-09-11 12:55:39.27784398 +0000 UTC m=+6.139318147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-w2mbl" (UniqueName: "kubernetes.io/projected/bc61a33f-faa2-4646-8197-40627ef9da72-kube-api-access-w2mbl") pod "network-check-target-4bvlc" (UID: "bc61a33f-faa2-4646-8197-40627ef9da72") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:55:37.606671 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:37.606280    2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 12:50:35 +0000 UTC" deadline="2028-03-12 04:46:24.626549498 +0000 UTC"
Sep 11 12:55:37.606671 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:37.606340    2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13143h50m47.020213748s"
Sep 11 12:55:37.660601 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:37.659610    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:55:37.660601 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:37.659768    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jxc9" podUID="4b821e09-a20a-457c-b22d-815df2b09e54"
Sep 11 12:55:37.660601 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:37.660229    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:55:37.660601 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:37.660341    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4b9" podUID="4a0213c0-ea91-46ef-963b-eebfca575f1d"
Sep 11 12:55:37.660601 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:37.660403    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvlc"
Sep 11 12:55:37.660601 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:37.660467    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvlc" podUID="bc61a33f-faa2-4646-8197-40627ef9da72"
Sep 11 12:55:37.716192 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:37.716127    2547 generic.go:356] "Generic (PLEG): container finished" podID="336bcc6551e46b69eadff66cca9f19f9" containerID="eb93010e371fecd73a7f8f73ee364e88894e0487b1df4091e586bd4ea2885db7" exitCode=0
Sep 11 12:55:37.717065 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:37.717039    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal" event={"ID":"336bcc6551e46b69eadff66cca9f19f9","Type":"ContainerDied","Data":"eb93010e371fecd73a7f8f73ee364e88894e0487b1df4091e586bd4ea2885db7"}
Sep 11 12:55:38.729867 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:38.729188    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal" event={"ID":"336bcc6551e46b69eadff66cca9f19f9","Type":"ContainerStarted","Data":"bb6e87252c21e116ddf02dee11f3f6e949619003db933d5ab9f241823ae28bfe"}
Sep 11 12:55:39.201574 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:39.201487    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a0213c0-ea91-46ef-963b-eebfca575f1d-original-pull-secret\") pod \"global-pull-secret-syncer-hw4b9\" (UID: \"4a0213c0-ea91-46ef-963b-eebfca575f1d\") " pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:55:39.201574 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:39.201549    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b821e09-a20a-457c-b22d-815df2b09e54-metrics-certs\") pod \"network-metrics-daemon-5jxc9\" (UID: \"4b821e09-a20a-457c-b22d-815df2b09e54\") " pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:55:39.201841 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:39.201680    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:55:39.201841 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:39.201759    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b821e09-a20a-457c-b22d-815df2b09e54-metrics-certs podName:4b821e09-a20a-457c-b22d-815df2b09e54 nodeName:}" failed. No retries permitted until 2026-09-11 12:55:43.201739358 +0000 UTC m=+10.063213547 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b821e09-a20a-457c-b22d-815df2b09e54-metrics-certs") pod "network-metrics-daemon-5jxc9" (UID: "4b821e09-a20a-457c-b22d-815df2b09e54") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:55:39.202167 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:39.202146    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:55:39.202254 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:39.202201    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a0213c0-ea91-46ef-963b-eebfca575f1d-original-pull-secret podName:4a0213c0-ea91-46ef-963b-eebfca575f1d nodeName:}" failed. No retries permitted until 2026-09-11 12:55:43.202185767 +0000 UTC m=+10.063659937 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a0213c0-ea91-46ef-963b-eebfca575f1d-original-pull-secret") pod "global-pull-secret-syncer-hw4b9" (UID: "4a0213c0-ea91-46ef-963b-eebfca575f1d") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:55:39.302805 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:39.302764    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2mbl\" (UniqueName: \"kubernetes.io/projected/bc61a33f-faa2-4646-8197-40627ef9da72-kube-api-access-w2mbl\") pod \"network-check-target-4bvlc\" (UID: \"bc61a33f-faa2-4646-8197-40627ef9da72\") " pod="openshift-network-diagnostics/network-check-target-4bvlc"
Sep 11 12:55:39.302990 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:39.302979    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:55:39.303055 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:39.303003    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:55:39.303055 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:39.303019    2547 projected.go:196] Error preparing data for projected volume kube-api-access-w2mbl for pod openshift-network-diagnostics/network-check-target-4bvlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:55:39.303155 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:39.303080    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc61a33f-faa2-4646-8197-40627ef9da72-kube-api-access-w2mbl podName:bc61a33f-faa2-4646-8197-40627ef9da72 nodeName:}" failed. No retries permitted until 2026-09-11 12:55:43.303060862 +0000 UTC m=+10.164535047 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-w2mbl" (UniqueName: "kubernetes.io/projected/bc61a33f-faa2-4646-8197-40627ef9da72-kube-api-access-w2mbl") pod "network-check-target-4bvlc" (UID: "bc61a33f-faa2-4646-8197-40627ef9da72") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:55:39.661012 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:39.660931    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:55:39.661163 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:39.661052    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jxc9" podUID="4b821e09-a20a-457c-b22d-815df2b09e54"
Sep 11 12:55:39.661360 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:39.661342    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvlc"
Sep 11 12:55:39.661444 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:39.661409    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvlc" podUID="bc61a33f-faa2-4646-8197-40627ef9da72"
Sep 11 12:55:39.661444 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:39.661441    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:55:39.661550 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:39.661482    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4b9" podUID="4a0213c0-ea91-46ef-963b-eebfca575f1d"
Sep 11 12:55:41.659786 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:41.659753    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:55:41.660201 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:41.659886    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4b9" podUID="4a0213c0-ea91-46ef-963b-eebfca575f1d"
Sep 11 12:55:41.660556 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:41.660294    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:55:41.660556 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:41.660397    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jxc9" podUID="4b821e09-a20a-457c-b22d-815df2b09e54"
Sep 11 12:55:41.660556 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:41.660447    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvlc"
Sep 11 12:55:41.660556 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:41.660510    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvlc" podUID="bc61a33f-faa2-4646-8197-40627ef9da72"
Sep 11 12:55:43.241855 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:43.241118    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b821e09-a20a-457c-b22d-815df2b09e54-metrics-certs\") pod \"network-metrics-daemon-5jxc9\" (UID: \"4b821e09-a20a-457c-b22d-815df2b09e54\") " pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:55:43.241855 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:43.241210    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a0213c0-ea91-46ef-963b-eebfca575f1d-original-pull-secret\") pod \"global-pull-secret-syncer-hw4b9\" (UID: \"4a0213c0-ea91-46ef-963b-eebfca575f1d\") " pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:55:43.241855 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:43.241335    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:55:43.241855 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:43.241393    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a0213c0-ea91-46ef-963b-eebfca575f1d-original-pull-secret podName:4a0213c0-ea91-46ef-963b-eebfca575f1d nodeName:}" failed. No retries permitted until 2026-09-11 12:55:51.24137563 +0000 UTC m=+18.102849799 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a0213c0-ea91-46ef-963b-eebfca575f1d-original-pull-secret") pod "global-pull-secret-syncer-hw4b9" (UID: "4a0213c0-ea91-46ef-963b-eebfca575f1d") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:55:43.241855 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:43.241785    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:55:43.241855 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:43.241825    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b821e09-a20a-457c-b22d-815df2b09e54-metrics-certs podName:4b821e09-a20a-457c-b22d-815df2b09e54 nodeName:}" failed. No retries permitted until 2026-09-11 12:55:51.241813063 +0000 UTC m=+18.103287228 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b821e09-a20a-457c-b22d-815df2b09e54-metrics-certs") pod "network-metrics-daemon-5jxc9" (UID: "4b821e09-a20a-457c-b22d-815df2b09e54") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:55:43.341835 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:43.341788    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2mbl\" (UniqueName: \"kubernetes.io/projected/bc61a33f-faa2-4646-8197-40627ef9da72-kube-api-access-w2mbl\") pod \"network-check-target-4bvlc\" (UID: \"bc61a33f-faa2-4646-8197-40627ef9da72\") " pod="openshift-network-diagnostics/network-check-target-4bvlc"
Sep 11 12:55:43.342042 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:43.342021    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:55:43.342116 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:43.342052    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:55:43.342116 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:43.342065    2547 projected.go:196] Error preparing data for projected volume kube-api-access-w2mbl for pod openshift-network-diagnostics/network-check-target-4bvlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:55:43.342218 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:43.342130    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc61a33f-faa2-4646-8197-40627ef9da72-kube-api-access-w2mbl podName:bc61a33f-faa2-4646-8197-40627ef9da72 nodeName:}" failed. No retries permitted until 2026-09-11 12:55:51.342111082 +0000 UTC m=+18.203585250 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-w2mbl" (UniqueName: "kubernetes.io/projected/bc61a33f-faa2-4646-8197-40627ef9da72-kube-api-access-w2mbl") pod "network-check-target-4bvlc" (UID: "bc61a33f-faa2-4646-8197-40627ef9da72") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:55:43.658157 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:43.658077    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvlc"
Sep 11 12:55:43.658306 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:43.658187    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvlc" podUID="bc61a33f-faa2-4646-8197-40627ef9da72"
Sep 11 12:55:43.658306 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:43.658211    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:55:43.658400 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:43.658331    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4b9" podUID="4a0213c0-ea91-46ef-963b-eebfca575f1d"
Sep 11 12:55:43.658400 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:43.658382    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:55:43.658503 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:43.658463    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jxc9" podUID="4b821e09-a20a-457c-b22d-815df2b09e54"
Sep 11 12:55:45.657316 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:45.657278    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:55:45.657815 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:45.657278    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvlc"
Sep 11 12:55:45.657815 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:45.657420    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4b9" podUID="4a0213c0-ea91-46ef-963b-eebfca575f1d"
Sep 11 12:55:45.657815 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:45.657278    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:55:45.657815 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:45.657509    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvlc" podUID="bc61a33f-faa2-4646-8197-40627ef9da72"
Sep 11 12:55:45.657815 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:45.657628    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jxc9" podUID="4b821e09-a20a-457c-b22d-815df2b09e54"
Sep 11 12:55:47.657513 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:47.657472    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:55:47.657513 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:47.657500    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvlc"
Sep 11 12:55:47.658050 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:47.657477    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:55:47.658050 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:47.657611    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4b9" podUID="4a0213c0-ea91-46ef-963b-eebfca575f1d"
Sep 11 12:55:47.658050 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:47.657688    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jxc9" podUID="4b821e09-a20a-457c-b22d-815df2b09e54"
Sep 11 12:55:47.658050 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:47.657761    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvlc" podUID="bc61a33f-faa2-4646-8197-40627ef9da72"
Sep 11 12:55:49.657247 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:49.657212    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvlc"
Sep 11 12:55:49.657728 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:49.657212    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:55:49.657728 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:49.657330    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvlc" podUID="bc61a33f-faa2-4646-8197-40627ef9da72"
Sep 11 12:55:49.657728 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:49.657339    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:55:49.657728 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:49.657468    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4b9" podUID="4a0213c0-ea91-46ef-963b-eebfca575f1d"
Sep 11 12:55:49.657728 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:49.657563    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jxc9" podUID="4b821e09-a20a-457c-b22d-815df2b09e54"
Sep 11 12:55:51.303938 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:51.303897    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a0213c0-ea91-46ef-963b-eebfca575f1d-original-pull-secret\") pod \"global-pull-secret-syncer-hw4b9\" (UID: \"4a0213c0-ea91-46ef-963b-eebfca575f1d\") " pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:55:51.304460 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:51.303958    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b821e09-a20a-457c-b22d-815df2b09e54-metrics-certs\") pod \"network-metrics-daemon-5jxc9\" (UID: \"4b821e09-a20a-457c-b22d-815df2b09e54\") " pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:55:51.304460 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:51.304062    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:55:51.304460 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:51.304062    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:55:51.304460 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:51.304127    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b821e09-a20a-457c-b22d-815df2b09e54-metrics-certs podName:4b821e09-a20a-457c-b22d-815df2b09e54 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:07.30410778 +0000 UTC m=+34.165581958 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b821e09-a20a-457c-b22d-815df2b09e54-metrics-certs") pod "network-metrics-daemon-5jxc9" (UID: "4b821e09-a20a-457c-b22d-815df2b09e54") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:55:51.304460 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:51.304143    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a0213c0-ea91-46ef-963b-eebfca575f1d-original-pull-secret podName:4a0213c0-ea91-46ef-963b-eebfca575f1d nodeName:}" failed. No retries permitted until 2026-09-11 12:56:07.304135146 +0000 UTC m=+34.165609316 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a0213c0-ea91-46ef-963b-eebfca575f1d-original-pull-secret") pod "global-pull-secret-syncer-hw4b9" (UID: "4a0213c0-ea91-46ef-963b-eebfca575f1d") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:55:51.405332 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:51.405297    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2mbl\" (UniqueName: \"kubernetes.io/projected/bc61a33f-faa2-4646-8197-40627ef9da72-kube-api-access-w2mbl\") pod \"network-check-target-4bvlc\" (UID: \"bc61a33f-faa2-4646-8197-40627ef9da72\") " pod="openshift-network-diagnostics/network-check-target-4bvlc"
Sep 11 12:55:51.405512 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:51.405429    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:55:51.405512 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:51.405449    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:55:51.405512 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:51.405464    2547 projected.go:196] Error preparing data for projected volume kube-api-access-w2mbl for pod openshift-network-diagnostics/network-check-target-4bvlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:55:51.405647 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:51.405524    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc61a33f-faa2-4646-8197-40627ef9da72-kube-api-access-w2mbl podName:bc61a33f-faa2-4646-8197-40627ef9da72 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:07.405507418 +0000 UTC m=+34.266981604 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-w2mbl" (UniqueName: "kubernetes.io/projected/bc61a33f-faa2-4646-8197-40627ef9da72-kube-api-access-w2mbl") pod "network-check-target-4bvlc" (UID: "bc61a33f-faa2-4646-8197-40627ef9da72") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:55:51.657100 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:51.657010    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:55:51.657275 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:51.657016    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:55:51.657275 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:51.657151    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jxc9" podUID="4b821e09-a20a-457c-b22d-815df2b09e54"
Sep 11 12:55:51.657275 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:51.657031    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvlc"
Sep 11 12:55:51.657275 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:51.657224    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4b9" podUID="4a0213c0-ea91-46ef-963b-eebfca575f1d"
Sep 11 12:55:51.657488 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:51.657274    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvlc" podUID="bc61a33f-faa2-4646-8197-40627ef9da72"
Sep 11 12:55:53.657916 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:53.657878    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:55:53.658375 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:53.657983    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:55:53.658375 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:53.657986    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4b9" podUID="4a0213c0-ea91-46ef-963b-eebfca575f1d"
Sep 11 12:55:53.658375 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:53.658119    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvlc"
Sep 11 12:55:53.658375 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:53.658115    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jxc9" podUID="4b821e09-a20a-457c-b22d-815df2b09e54"
Sep 11 12:55:53.658375 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:53.658214    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvlc" podUID="bc61a33f-faa2-4646-8197-40627ef9da72"
Sep 11 12:55:54.763206 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:54.763173    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9bb5n" event={"ID":"68d59d28-7efe-4ac2-955b-697b740b7781","Type":"ContainerStarted","Data":"c7aef834a06a5144d5ddaa8a196946272dde5f6a88ed5d493c0bf4416461a6de"}
Sep 11 12:55:54.764891 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:54.764852    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l5nls" event={"ID":"8f0f828c-0dac-442d-a850-ac2f3e9fe8ae","Type":"ContainerStarted","Data":"e8ccdd3516e94f1b6a8442b151ef0d244635131467e4d45f386a4c5f69a90590"}
Sep 11 12:55:54.766622 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:54.766561    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zhbh2" event={"ID":"11fe817e-d1fb-4e36-8794-2925002c1b3e","Type":"ContainerStarted","Data":"56f854c51e4f8214d6449b50af200ed62d93cd7aaca38806fc020e34154e5762"}
Sep 11 12:55:54.768225 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:54.768195    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-22m8j" event={"ID":"de418b7e-552a-4d60-94bf-fcb75207e5ab","Type":"ContainerStarted","Data":"bda2cc2b1539633e14f8f1da788cc4acb6454f27ef46a1a167589c27266c5280"}
Sep 11 12:55:54.769796 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:54.769774    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57h6r" event={"ID":"4004b7d0-e402-4d2b-8936-847ae50cbec3","Type":"ContainerStarted","Data":"af3d0e32474daad42b28c22fce2047785e416dcaf4eed3a4d3c05dc9d3613001"}
Sep 11 12:55:54.771405 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:54.771383    2547 generic.go:356] "Generic (PLEG): container finished" podID="e640946e-2f4b-426a-85fb-a20784da1079" containerID="2c3299b571373c3c055f4ac877ac5b3fabe92ae5a8014646c3ce21ba05ebd758" exitCode=0
Sep 11 12:55:54.771501 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:54.771463    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4wpcw" event={"ID":"e640946e-2f4b-426a-85fb-a20784da1079","Type":"ContainerDied","Data":"2c3299b571373c3c055f4ac877ac5b3fabe92ae5a8014646c3ce21ba05ebd758"}
Sep 11 12:55:54.773022 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:54.772996    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v26jw" event={"ID":"21d7503a-0156-478a-b2c2-8555a08faf52","Type":"ContainerStarted","Data":"c9e55d91b2f2e3a33f9bc1b7ebda781ba46e2236a88ecdc4eddbabb2a636de93"}
Sep 11 12:55:54.779056 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:54.779006    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9bb5n" podStartSLOduration=3.962015046 podStartE2EDuration="21.778990587s" totalImagesPullingTime="17.816975541s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:55:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:55:54.778271465 +0000 UTC m=+21.639745666" watchObservedRunningTime="2026-09-11 12:55:54.778990587 +0000 UTC m=+21.640464775"
Sep 11 12:55:54.779174 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:54.779103    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal" podStartSLOduration=20.779096525 podStartE2EDuration="20.779096525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:55:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:55:38.749029198 +0000 UTC m=+5.610503386" watchObservedRunningTime="2026-09-11 12:55:54.779096525 +0000 UTC m=+21.640570712"
Sep 11 12:55:54.836267 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:54.836073    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zhbh2" podStartSLOduration=3.729250544 podStartE2EDuration="21.836057621s" totalImagesPullingTime="18.106807077s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:55:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:55:54.817328816 +0000 UTC m=+21.678803005" watchObservedRunningTime="2026-09-11 12:55:54.836057621 +0000 UTC m=+21.697531872"
Sep 11 12:55:54.836538 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:54.836515    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-22m8j" podStartSLOduration=4.019499445 podStartE2EDuration="21.836507989s" totalImagesPullingTime="17.817008544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:55:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:55:54.835774162 +0000 UTC m=+21.697248353" watchObservedRunningTime="2026-09-11 12:55:54.836507989 +0000 UTC m=+21.697982177"
Sep 11 12:55:54.852514 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:54.852465    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-l5nls" podStartSLOduration=4.033357644 podStartE2EDuration="21.852448444s" totalImagesPullingTime="17.8190908s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:55:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:55:54.852362118 +0000 UTC m=+21.713836296" watchObservedRunningTime="2026-09-11 12:55:54.852448444 +0000 UTC m=+21.713922632"
Sep 11 12:55:54.867941 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:54.867887    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-v26jw" podStartSLOduration=4.044725298 podStartE2EDuration="21.867865884s" totalImagesPullingTime="17.823140586s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:55:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:55:54.86718418 +0000 UTC m=+21.728658366" watchObservedRunningTime="2026-09-11 12:55:54.867865884 +0000 UTC m=+21.729340073"
Sep 11 12:55:55.657836 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:55.657560    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:55:55.658024 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:55.657558    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvlc"
Sep 11 12:55:55.658024 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:55.657948    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4b9" podUID="4a0213c0-ea91-46ef-963b-eebfca575f1d"
Sep 11 12:55:55.658024 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:55.657621    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:55:55.658182 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:55.658047    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvlc" podUID="bc61a33f-faa2-4646-8197-40627ef9da72"
Sep 11 12:55:55.658182 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:55.658116    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jxc9" podUID="4b821e09-a20a-457c-b22d-815df2b09e54"
Sep 11 12:55:55.778972 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:55.778933    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk" event={"ID":"6e4770ce-0b26-4af8-9aa9-f88c744db951","Type":"ContainerStarted","Data":"13c34d0f336b7cef82b2c5d957e6f005fd7e68bd56029547755d3502f49bcd2a"}
Sep 11 12:55:55.779928 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:55.779020    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk" event={"ID":"6e4770ce-0b26-4af8-9aa9-f88c744db951","Type":"ContainerStarted","Data":"aab8e85fcb945341394b1e46079eeb1d3b47d5422957e7abb7807a627d32eefb"}
Sep 11 12:55:55.779928 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:55.779077    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk" event={"ID":"6e4770ce-0b26-4af8-9aa9-f88c744db951","Type":"ContainerStarted","Data":"c331a0152092798bb6f888a730c5152fa53efbb25173514a43f6a602b9c3a7df"}
Sep 11 12:55:55.779928 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:55.779123    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk" event={"ID":"6e4770ce-0b26-4af8-9aa9-f88c744db951","Type":"ContainerStarted","Data":"fe73e1efe5a3c916bc7ec2b94f28c2367849fd8623983ad1597704996a1bb33e"}
Sep 11 12:55:55.779928 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:55.779165    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk" event={"ID":"6e4770ce-0b26-4af8-9aa9-f88c744db951","Type":"ContainerStarted","Data":"5b9b10b640175cbf3df01ee2392cd8e4a9b4c51d0d3dcf782772855084e7028c"}
Sep 11 12:55:55.779928 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:55.779206    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk" event={"ID":"6e4770ce-0b26-4af8-9aa9-f88c744db951","Type":"ContainerStarted","Data":"0dd7bdc3ad336c90596659f3409cd264282bd84a2be4d76adcc95a9c344a88bf"}
Sep 11 12:55:56.033801 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:56.033775    2547 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 12:55:56.635990 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:56.635883    2547 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T12:55:56.033793539Z","UUID":"419f03be-368d-425e-a36d-9e21345d9f81","Handler":null,"Name":"","Endpoint":""}
Sep 11 12:55:56.637558 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:56.637537    2547 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 12:55:56.637682 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:56.637573    2547 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 12:55:56.784117 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:56.783693    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hwqfb" event={"ID":"74fea4a1-c75b-48a8-ac5d-2d44b9b55732","Type":"ContainerStarted","Data":"2614abc8e82b86f56396a29585fc6141627dfd2dafe941099ac8c63bff20e177"}
Sep 11 12:55:56.786556 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:56.786521    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57h6r" event={"ID":"4004b7d0-e402-4d2b-8936-847ae50cbec3","Type":"ContainerStarted","Data":"f1c68ca58df1876d2a65c33a630103f76644683ffd3df6a7b14e9074a9dd32d6"}
Sep 11 12:55:56.811014 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:56.810951    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hwqfb" podStartSLOduration=5.985106336 podStartE2EDuration="23.810930485s" totalImagesPullingTime="17.825824149s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:55:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:55:56.810593485 +0000 UTC m=+23.672067673" watchObservedRunningTime="2026-09-11 12:55:56.810930485 +0000 UTC m=+23.672404674"
Sep 11 12:55:57.657950 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:57.657910    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvlc"
Sep 11 12:55:57.658127 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:57.657932    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:55:57.658127 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:57.658049    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvlc" podUID="bc61a33f-faa2-4646-8197-40627ef9da72"
Sep 11 12:55:57.658127 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:57.657932    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:55:57.658293 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:57.658121    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4b9" podUID="4a0213c0-ea91-46ef-963b-eebfca575f1d"
Sep 11 12:55:57.658293 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:57.658203    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jxc9" podUID="4b821e09-a20a-457c-b22d-815df2b09e54"
Sep 11 12:55:57.791952 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:57.791686    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57h6r" event={"ID":"4004b7d0-e402-4d2b-8936-847ae50cbec3","Type":"ContainerStarted","Data":"c34a4651239981804eabbe4f618f38c5e77ece7e62f0781d4cad3e787772c26b"}
Sep 11 12:55:57.795645 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:57.795606    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk" event={"ID":"6e4770ce-0b26-4af8-9aa9-f88c744db951","Type":"ContainerStarted","Data":"58dbec0e892f274672c975704a5637ca3d4f64d2217dba701e17a2f4f043cf19"}
Sep 11 12:55:57.828750 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:57.828676    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57h6r" podStartSLOduration=4.907775421 podStartE2EDuration="24.828652861s" totalImagesPullingTime="19.92087744s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:55:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:55:57.826706735 +0000 UTC m=+24.688180923" watchObservedRunningTime="2026-09-11 12:55:57.828652861 +0000 UTC m=+24.690127052"
Sep 11 12:55:59.149858 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:59.149819    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-22m8j"
Sep 11 12:55:59.150385 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:59.150366    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-22m8j"
Sep 11 12:55:59.657650 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:59.657405    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvlc"
Sep 11 12:55:59.657875 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:59.657405    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:55:59.657875 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:59.657671    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvlc" podUID="bc61a33f-faa2-4646-8197-40627ef9da72"
Sep 11 12:55:59.657875 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:59.657405    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:55:59.657875 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:59.657799    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jxc9" podUID="4b821e09-a20a-457c-b22d-815df2b09e54"
Sep 11 12:55:59.658007 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:55:59.657894    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4b9" podUID="4a0213c0-ea91-46ef-963b-eebfca575f1d"
Sep 11 12:55:59.801174 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:59.801143    2547 generic.go:356] "Generic (PLEG): container finished" podID="e640946e-2f4b-426a-85fb-a20784da1079" containerID="3992e089a927108b6e3d78c482581805669940b994f44ff2d7d5058b30765b52" exitCode=0
Sep 11 12:55:59.801324 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:59.801225    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4wpcw" event={"ID":"e640946e-2f4b-426a-85fb-a20784da1079","Type":"ContainerDied","Data":"3992e089a927108b6e3d78c482581805669940b994f44ff2d7d5058b30765b52"}
Sep 11 12:55:59.805292 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:59.805256    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk" event={"ID":"6e4770ce-0b26-4af8-9aa9-f88c744db951","Type":"ContainerStarted","Data":"2f54b9663846bc68f796edc49473a3aaa689b174cd441b2c9d942b85da93b9c2"}
Sep 11 12:55:59.805536 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:59.805521    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-22m8j"
Sep 11 12:55:59.805979 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:59.805960    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-22m8j"
Sep 11 12:55:59.911758 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:55:59.911646    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk" podStartSLOduration=8.529389844 podStartE2EDuration="26.911630145s" totalImagesPullingTime="18.382240301s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:55:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:55:59.910945882 +0000 UTC m=+26.772420082" watchObservedRunningTime="2026-09-11 12:55:59.911630145 +0000 UTC m=+26.773104333"
Sep 11 12:56:00.812519 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:00.812488    2547 generic.go:356] "Generic (PLEG): container finished" podID="e640946e-2f4b-426a-85fb-a20784da1079" containerID="b90b1ddcea23b1c77ac1a9b9dc24551a9100c58e1d75b37727b3e2a4492fd122" exitCode=0
Sep 11 12:56:00.813293 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:00.812576    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4wpcw" event={"ID":"e640946e-2f4b-426a-85fb-a20784da1079","Type":"ContainerDied","Data":"b90b1ddcea23b1c77ac1a9b9dc24551a9100c58e1d75b37727b3e2a4492fd122"}
Sep 11 12:56:00.813363 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:00.813336    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:56:00.813420 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:00.813408    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:56:00.813471 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:00.813461    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:56:00.830202 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:00.830172    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:56:00.830362 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:00.830346    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:56:01.349391 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:01.349168    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4bvlc"]
Sep 11 12:56:01.349573 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:01.349522    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvlc"
Sep 11 12:56:01.349639 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:01.349607    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvlc" podUID="bc61a33f-faa2-4646-8197-40627ef9da72"
Sep 11 12:56:01.353120 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:01.353064    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hw4b9"]
Sep 11 12:56:01.353248 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:01.353233    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:56:01.353376 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:01.353355    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4b9" podUID="4a0213c0-ea91-46ef-963b-eebfca575f1d"
Sep 11 12:56:01.353821 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:01.353798    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5jxc9"]
Sep 11 12:56:01.353999 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:01.353908    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:56:01.354060 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:01.354010    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jxc9" podUID="4b821e09-a20a-457c-b22d-815df2b09e54"
Sep 11 12:56:01.816794 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:01.816760    2547 generic.go:356] "Generic (PLEG): container finished" podID="e640946e-2f4b-426a-85fb-a20784da1079" containerID="65958e0c6b42688a11db2a11bb4e9664f5bdcf31f8365682c9a6957fee3ba601" exitCode=0
Sep 11 12:56:01.817327 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:01.816843    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4wpcw" event={"ID":"e640946e-2f4b-426a-85fb-a20784da1079","Type":"ContainerDied","Data":"65958e0c6b42688a11db2a11bb4e9664f5bdcf31f8365682c9a6957fee3ba601"}
Sep 11 12:56:02.657657 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:02.657621    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:56:02.657853 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:02.657761    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4b9" podUID="4a0213c0-ea91-46ef-963b-eebfca575f1d"
Sep 11 12:56:02.657853 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:02.657810    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:56:02.657968 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:02.657920    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jxc9" podUID="4b821e09-a20a-457c-b22d-815df2b09e54"
Sep 11 12:56:03.658259 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:03.658161    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvlc"
Sep 11 12:56:03.658259 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:03.658252    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvlc" podUID="bc61a33f-faa2-4646-8197-40627ef9da72"
Sep 11 12:56:04.657154 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:04.657118    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:56:04.657154 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:04.657161    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:56:04.657407 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:04.657250    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jxc9" podUID="4b821e09-a20a-457c-b22d-815df2b09e54"
Sep 11 12:56:04.657407 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:04.657377    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4b9" podUID="4a0213c0-ea91-46ef-963b-eebfca575f1d"
Sep 11 12:56:05.658068 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:05.658029    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvlc"
Sep 11 12:56:05.658497 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:05.658171    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvlc" podUID="bc61a33f-faa2-4646-8197-40627ef9da72"
Sep 11 12:56:06.564232 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:06.564190    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:06.650708 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:06.650677    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:06.657618 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:06.657593    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:56:06.657754 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:06.657693    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jxc9" podUID="4b821e09-a20a-457c-b22d-815df2b09e54"
Sep 11 12:56:06.657754 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:06.657737    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:56:06.657843 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:06.657826    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4b9" podUID="4a0213c0-ea91-46ef-963b-eebfca575f1d"
Sep 11 12:56:06.833469 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:06.833382    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4wpcw" event={"ID":"e640946e-2f4b-426a-85fb-a20784da1079","Type":"ContainerStarted","Data":"cfc479903fbe9e10cb642e772b6775878a0cb318f1dffd7dfb6a1601e10814c8"}
Sep 11 12:56:07.326100 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.325901    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a0213c0-ea91-46ef-963b-eebfca575f1d-original-pull-secret\") pod \"global-pull-secret-syncer-hw4b9\" (UID: \"4a0213c0-ea91-46ef-963b-eebfca575f1d\") " pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:56:07.326295 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.326121    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b821e09-a20a-457c-b22d-815df2b09e54-metrics-certs\") pod \"network-metrics-daemon-5jxc9\" (UID: \"4b821e09-a20a-457c-b22d-815df2b09e54\") " pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:56:07.326295 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:07.326056    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:56:07.326295 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:07.326209    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:56:07.326295 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:07.326228    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a0213c0-ea91-46ef-963b-eebfca575f1d-original-pull-secret podName:4a0213c0-ea91-46ef-963b-eebfca575f1d nodeName:}" failed. No retries permitted until 2026-09-11 12:56:39.326211091 +0000 UTC m=+66.187685257 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a0213c0-ea91-46ef-963b-eebfca575f1d-original-pull-secret") pod "global-pull-secret-syncer-hw4b9" (UID: "4a0213c0-ea91-46ef-963b-eebfca575f1d") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:56:07.326295 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:07.326250    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b821e09-a20a-457c-b22d-815df2b09e54-metrics-certs podName:4b821e09-a20a-457c-b22d-815df2b09e54 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:39.326238273 +0000 UTC m=+66.187712444 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b821e09-a20a-457c-b22d-815df2b09e54-metrics-certs") pod "network-metrics-daemon-5jxc9" (UID: "4b821e09-a20a-457c-b22d-815df2b09e54") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:56:07.426579 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.426546    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2mbl\" (UniqueName: \"kubernetes.io/projected/bc61a33f-faa2-4646-8197-40627ef9da72-kube-api-access-w2mbl\") pod \"network-check-target-4bvlc\" (UID: \"bc61a33f-faa2-4646-8197-40627ef9da72\") " pod="openshift-network-diagnostics/network-check-target-4bvlc"
Sep 11 12:56:07.426777 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:07.426703    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:56:07.426777 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:07.426746    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:56:07.426777 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:07.426759    2547 projected.go:196] Error preparing data for projected volume kube-api-access-w2mbl for pod openshift-network-diagnostics/network-check-target-4bvlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:56:07.426886 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:07.426809    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc61a33f-faa2-4646-8197-40627ef9da72-kube-api-access-w2mbl podName:bc61a33f-faa2-4646-8197-40627ef9da72 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:39.426794516 +0000 UTC m=+66.288268682 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-w2mbl" (UniqueName: "kubernetes.io/projected/bc61a33f-faa2-4646-8197-40627ef9da72-kube-api-access-w2mbl") pod "network-check-target-4bvlc" (UID: "bc61a33f-faa2-4646-8197-40627ef9da72") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:56:07.429460 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.429437    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeReady"
Sep 11 12:56:07.429565 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.429560    2547 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 12:56:07.473642 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.473611    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-75kfq"]
Sep 11 12:56:07.491122 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.491086    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8nv6f"]
Sep 11 12:56:07.491301 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.491239    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-75kfq"
Sep 11 12:56:07.493969 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.493935    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 12:56:07.493969 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.493940    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 12:56:07.494198 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.494015    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l85nk\""
Sep 11 12:56:07.505201 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.505175    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-75kfq"]
Sep 11 12:56:07.505379 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.505210    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8nv6f"]
Sep 11 12:56:07.505379 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.505309    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8nv6f"
Sep 11 12:56:07.508064 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.508037    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 12:56:07.508255 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.508237    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pwbps\""
Sep 11 12:56:07.508316 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.508297    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 12:56:07.508371 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.508310    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 12:56:07.606648 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.606554    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:07.628614 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.628577    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldshj\" (UniqueName: \"kubernetes.io/projected/1dd7158a-e1f4-4aa4-82b0-f85ad37fd213-kube-api-access-ldshj\") pod \"ingress-canary-8nv6f\" (UID: \"1dd7158a-e1f4-4aa4-82b0-f85ad37fd213\") " pod="openshift-ingress-canary/ingress-canary-8nv6f"
Sep 11 12:56:07.628614 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.628615    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0be127eb-c133-4cbd-b442-9c8d0ae735aa-metrics-tls\") pod \"dns-default-75kfq\" (UID: \"0be127eb-c133-4cbd-b442-9c8d0ae735aa\") " pod="openshift-dns/dns-default-75kfq"
Sep 11 12:56:07.628891 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.628635    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0be127eb-c133-4cbd-b442-9c8d0ae735aa-config-volume\") pod \"dns-default-75kfq\" (UID: \"0be127eb-c133-4cbd-b442-9c8d0ae735aa\") " pod="openshift-dns/dns-default-75kfq"
Sep 11 12:56:07.628891 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.628658    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7pgh\" (UniqueName: \"kubernetes.io/projected/0be127eb-c133-4cbd-b442-9c8d0ae735aa-kube-api-access-h7pgh\") pod \"dns-default-75kfq\" (UID: \"0be127eb-c133-4cbd-b442-9c8d0ae735aa\") " pod="openshift-dns/dns-default-75kfq"
Sep 11 12:56:07.628891 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.628756    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0be127eb-c133-4cbd-b442-9c8d0ae735aa-tmp-dir\") pod \"dns-default-75kfq\" (UID: \"0be127eb-c133-4cbd-b442-9c8d0ae735aa\") " pod="openshift-dns/dns-default-75kfq"
Sep 11 12:56:07.628891 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.628815    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1dd7158a-e1f4-4aa4-82b0-f85ad37fd213-cert\") pod \"ingress-canary-8nv6f\" (UID: \"1dd7158a-e1f4-4aa4-82b0-f85ad37fd213\") " pod="openshift-ingress-canary/ingress-canary-8nv6f"
Sep 11 12:56:07.657962 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.657924    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvlc"
Sep 11 12:56:07.660540 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.660380    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 12:56:07.660540 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.660389    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 12:56:07.660540 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.660475    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7r4pp\""
Sep 11 12:56:07.678079 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.678048    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:07.729860 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.729821    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldshj\" (UniqueName: \"kubernetes.io/projected/1dd7158a-e1f4-4aa4-82b0-f85ad37fd213-kube-api-access-ldshj\") pod \"ingress-canary-8nv6f\" (UID: \"1dd7158a-e1f4-4aa4-82b0-f85ad37fd213\") " pod="openshift-ingress-canary/ingress-canary-8nv6f"
Sep 11 12:56:07.729860 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.729862    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0be127eb-c133-4cbd-b442-9c8d0ae735aa-metrics-tls\") pod \"dns-default-75kfq\" (UID: \"0be127eb-c133-4cbd-b442-9c8d0ae735aa\") " pod="openshift-dns/dns-default-75kfq"
Sep 11 12:56:07.730112 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.729885    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0be127eb-c133-4cbd-b442-9c8d0ae735aa-config-volume\") pod \"dns-default-75kfq\" (UID: \"0be127eb-c133-4cbd-b442-9c8d0ae735aa\") " pod="openshift-dns/dns-default-75kfq"
Sep 11 12:56:07.730112 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:07.730002    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:56:07.730112 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.730079    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7pgh\" (UniqueName: \"kubernetes.io/projected/0be127eb-c133-4cbd-b442-9c8d0ae735aa-kube-api-access-h7pgh\") pod \"dns-default-75kfq\" (UID: \"0be127eb-c133-4cbd-b442-9c8d0ae735aa\") " pod="openshift-dns/dns-default-75kfq"
Sep 11 12:56:07.730243 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.730121    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0be127eb-c133-4cbd-b442-9c8d0ae735aa-tmp-dir\") pod \"dns-default-75kfq\" (UID: \"0be127eb-c133-4cbd-b442-9c8d0ae735aa\") " pod="openshift-dns/dns-default-75kfq"
Sep 11 12:56:07.730243 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:07.730186    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0be127eb-c133-4cbd-b442-9c8d0ae735aa-metrics-tls podName:0be127eb-c133-4cbd-b442-9c8d0ae735aa nodeName:}" failed. No retries permitted until 2026-09-11 12:56:08.23013402 +0000 UTC m=+35.091608191 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0be127eb-c133-4cbd-b442-9c8d0ae735aa-metrics-tls") pod "dns-default-75kfq" (UID: "0be127eb-c133-4cbd-b442-9c8d0ae735aa") : secret "dns-default-metrics-tls" not found
Sep 11 12:56:07.730324 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.730251    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1dd7158a-e1f4-4aa4-82b0-f85ad37fd213-cert\") pod \"ingress-canary-8nv6f\" (UID: \"1dd7158a-e1f4-4aa4-82b0-f85ad37fd213\") " pod="openshift-ingress-canary/ingress-canary-8nv6f"
Sep 11 12:56:07.730592 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.730571    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0be127eb-c133-4cbd-b442-9c8d0ae735aa-tmp-dir\") pod \"dns-default-75kfq\" (UID: \"0be127eb-c133-4cbd-b442-9c8d0ae735aa\") " pod="openshift-dns/dns-default-75kfq"
Sep 11 12:56:07.730755 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.730739    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0be127eb-c133-4cbd-b442-9c8d0ae735aa-config-volume\") pod \"dns-default-75kfq\" (UID: \"0be127eb-c133-4cbd-b442-9c8d0ae735aa\") " pod="openshift-dns/dns-default-75kfq"
Sep 11 12:56:07.734621 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.734598    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1dd7158a-e1f4-4aa4-82b0-f85ad37fd213-cert\") pod \"ingress-canary-8nv6f\" (UID: \"1dd7158a-e1f4-4aa4-82b0-f85ad37fd213\") " pod="openshift-ingress-canary/ingress-canary-8nv6f"
Sep 11 12:56:07.741420 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.741397    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldshj\" (UniqueName: \"kubernetes.io/projected/1dd7158a-e1f4-4aa4-82b0-f85ad37fd213-kube-api-access-ldshj\") pod \"ingress-canary-8nv6f\" (UID: \"1dd7158a-e1f4-4aa4-82b0-f85ad37fd213\") " pod="openshift-ingress-canary/ingress-canary-8nv6f"
Sep 11 12:56:07.741635 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.741616    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7pgh\" (UniqueName: \"kubernetes.io/projected/0be127eb-c133-4cbd-b442-9c8d0ae735aa-kube-api-access-h7pgh\") pod \"dns-default-75kfq\" (UID: \"0be127eb-c133-4cbd-b442-9c8d0ae735aa\") " pod="openshift-dns/dns-default-75kfq"
Sep 11 12:56:07.813751 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.813699    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8nv6f"
Sep 11 12:56:07.817762 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.817731    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:07.839290 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.839263    2547 generic.go:356] "Generic (PLEG): container finished" podID="e640946e-2f4b-426a-85fb-a20784da1079" containerID="cfc479903fbe9e10cb642e772b6775878a0cb318f1dffd7dfb6a1601e10814c8" exitCode=0
Sep 11 12:56:07.839688 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.839307    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4wpcw" event={"ID":"e640946e-2f4b-426a-85fb-a20784da1079","Type":"ContainerDied","Data":"cfc479903fbe9e10cb642e772b6775878a0cb318f1dffd7dfb6a1601e10814c8"}
Sep 11 12:56:07.884952 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:07.884919    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:08.136141 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:08.136065    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8nv6f"]
Sep 11 12:56:08.139986 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:56:08.139960    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dd7158a_e1f4_4aa4_82b0_f85ad37fd213.slice/crio-0c74b554b23c0ffe30c7b7143297b9bbcde3b94c8cbe56bee30d7e348fe36aec WatchSource:0}: Error finding container 0c74b554b23c0ffe30c7b7143297b9bbcde3b94c8cbe56bee30d7e348fe36aec: Status 404 returned error can't find the container with id 0c74b554b23c0ffe30c7b7143297b9bbcde3b94c8cbe56bee30d7e348fe36aec
Sep 11 12:56:08.233028 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:08.232990    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0be127eb-c133-4cbd-b442-9c8d0ae735aa-metrics-tls\") pod \"dns-default-75kfq\" (UID: \"0be127eb-c133-4cbd-b442-9c8d0ae735aa\") " pod="openshift-dns/dns-default-75kfq"
Sep 11 12:56:08.233215 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:08.233112    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:56:08.233215 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:08.233175    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0be127eb-c133-4cbd-b442-9c8d0ae735aa-metrics-tls podName:0be127eb-c133-4cbd-b442-9c8d0ae735aa nodeName:}" failed. No retries permitted until 2026-09-11 12:56:09.233156651 +0000 UTC m=+36.094630833 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0be127eb-c133-4cbd-b442-9c8d0ae735aa-metrics-tls") pod "dns-default-75kfq" (UID: "0be127eb-c133-4cbd-b442-9c8d0ae735aa") : secret "dns-default-metrics-tls" not found
Sep 11 12:56:08.657576 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:08.657544    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:56:08.657576 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:08.657579    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:56:08.662693 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:08.662537    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 12:56:08.662693 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:08.662537    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 12:56:08.662693 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:08.662614    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w7fbx\""
Sep 11 12:56:08.776338 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:08.776305    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:08.843378 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:08.843342    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8nv6f" event={"ID":"1dd7158a-e1f4-4aa4-82b0-f85ad37fd213","Type":"ContainerStarted","Data":"0c74b554b23c0ffe30c7b7143297b9bbcde3b94c8cbe56bee30d7e348fe36aec"}
Sep 11 12:56:08.847301 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:08.847272    2547 generic.go:356] "Generic (PLEG): container finished" podID="e640946e-2f4b-426a-85fb-a20784da1079" containerID="2a6271be34ffb75a302c9093c30f6b963b94e21982372d6cbf747ac0981d30f0" exitCode=0
Sep 11 12:56:08.847450 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:08.847317    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4wpcw" event={"ID":"e640946e-2f4b-426a-85fb-a20784da1079","Type":"ContainerDied","Data":"2a6271be34ffb75a302c9093c30f6b963b94e21982372d6cbf747ac0981d30f0"}
Sep 11 12:56:08.855554 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:08.855522    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:09.244006 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:09.243659    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0be127eb-c133-4cbd-b442-9c8d0ae735aa-metrics-tls\") pod \"dns-default-75kfq\" (UID: \"0be127eb-c133-4cbd-b442-9c8d0ae735aa\") " pod="openshift-dns/dns-default-75kfq"
Sep 11 12:56:09.244006 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:09.243828    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:56:09.244321 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:09.244074    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0be127eb-c133-4cbd-b442-9c8d0ae735aa-metrics-tls podName:0be127eb-c133-4cbd-b442-9c8d0ae735aa nodeName:}" failed. No retries permitted until 2026-09-11 12:56:11.244050386 +0000 UTC m=+38.105524564 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0be127eb-c133-4cbd-b442-9c8d0ae735aa-metrics-tls") pod "dns-default-75kfq" (UID: "0be127eb-c133-4cbd-b442-9c8d0ae735aa") : secret "dns-default-metrics-tls" not found
Sep 11 12:56:09.854483 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:09.854445    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4wpcw" event={"ID":"e640946e-2f4b-426a-85fb-a20784da1079","Type":"ContainerStarted","Data":"cc68ea0d2039d0280ba4faefc06169d1881c22f8a47ff3be1d4fda946f233cb5"}
Sep 11 12:56:09.876617 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:09.876560    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4wpcw" podStartSLOduration=8.186295812000001 podStartE2EDuration="36.876540707s" totalImagesPullingTime="28.690244895s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:55:33 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:09.875100364 +0000 UTC m=+36.736574553" watchObservedRunningTime="2026-09-11 12:56:09.876540707 +0000 UTC m=+36.738014898"
Sep 11 12:56:09.996759 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:09.996691    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:10.054336 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:10.054293    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:10.327922 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:10.327829    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:10.422590 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:10.422547    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:10.859331 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:10.859298    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8nv6f" event={"ID":"1dd7158a-e1f4-4aa4-82b0-f85ad37fd213","Type":"ContainerStarted","Data":"eebd47af3fe1bcb10d5847de88de5fa1e14458da4c69217e4af2ffe95cf982f9"}
Sep 11 12:56:10.877939 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:10.877889    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8nv6f" podStartSLOduration=1.327823842 podStartE2EDuration="3.877872481s" totalImagesPullingTime="2.550048639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:56:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:10.877066477 +0000 UTC m=+37.738540666" watchObservedRunningTime="2026-09-11 12:56:10.877872481 +0000 UTC m=+37.739346666"
Sep 11 12:56:11.259104 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:11.259062    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0be127eb-c133-4cbd-b442-9c8d0ae735aa-metrics-tls\") pod \"dns-default-75kfq\" (UID: \"0be127eb-c133-4cbd-b442-9c8d0ae735aa\") " pod="openshift-dns/dns-default-75kfq"
Sep 11 12:56:11.259287 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:11.259207    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:56:11.259287 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:11.259275    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0be127eb-c133-4cbd-b442-9c8d0ae735aa-metrics-tls podName:0be127eb-c133-4cbd-b442-9c8d0ae735aa nodeName:}" failed. No retries permitted until 2026-09-11 12:56:15.259259625 +0000 UTC m=+42.120733797 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0be127eb-c133-4cbd-b442-9c8d0ae735aa-metrics-tls") pod "dns-default-75kfq" (UID: "0be127eb-c133-4cbd-b442-9c8d0ae735aa") : secret "dns-default-metrics-tls" not found
Sep 11 12:56:12.848359 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:12.848320    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:12.912993 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:12.912954    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:13.852307 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.852277    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-rmbdd"]
Sep 11 12:56:13.885804 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.885768    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-b7gsm"]
Sep 11 12:56:13.885947 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.885863    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rmbdd"
Sep 11 12:56:13.889255 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.889230    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 12:56:13.889507 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.889486    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 12:56:13.889619 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.889549    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-467ng\""
Sep 11 12:56:13.889686 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.889641    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 11 12:56:13.889801 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.889787    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 11 12:56:13.903613 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.903589    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-6h8mp"]
Sep 11 12:56:13.903747 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.903699    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-b7gsm"
Sep 11 12:56:13.905928 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.905906    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 11 12:56:13.906042 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.905949    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 11 12:56:13.906042 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.905962    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 11 12:56:13.906367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.906349    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-2kg2d\""
Sep 11 12:56:13.906472 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.906457    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 11 12:56:13.911075 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.911057    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 11 12:56:13.917816 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.917796    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-rmbdd"]
Sep 11 12:56:13.917906 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.917831    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-b7gsm"]
Sep 11 12:56:13.917906 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.917854    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-6h8mp"]
Sep 11 12:56:13.918014 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.917908    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-6h8mp"
Sep 11 12:56:13.920486 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.920466    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 12:56:13.920588 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.920513    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 12:56:13.920647 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.920641    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-gkn2r\""
Sep 11 12:56:13.920800 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.920784    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 11 12:56:13.920857 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.920794    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 11 12:56:13.927882 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.927861    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 11 12:56:13.963036 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.963006    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-8wp9p"]
Sep 11 12:56:13.978956 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.978920    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b22738d7-e796-4173-8fb4-80f9208b99dd-trusted-ca\") pod \"console-operator-696884fb9c-b7gsm\" (UID: \"b22738d7-e796-4173-8fb4-80f9208b99dd\") " pod="openshift-console-operator/console-operator-696884fb9c-b7gsm"
Sep 11 12:56:13.979149 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.979079    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6pcz\" (UniqueName: \"kubernetes.io/projected/b22738d7-e796-4173-8fb4-80f9208b99dd-kube-api-access-w6pcz\") pod \"console-operator-696884fb9c-b7gsm\" (UID: \"b22738d7-e796-4173-8fb4-80f9208b99dd\") " pod="openshift-console-operator/console-operator-696884fb9c-b7gsm"
Sep 11 12:56:13.979149 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.979116    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/026870b5-9a92-410e-ad2b-cb6d9a648da6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rmbdd\" (UID: \"026870b5-9a92-410e-ad2b-cb6d9a648da6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rmbdd"
Sep 11 12:56:13.979273 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.979148    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/026870b5-9a92-410e-ad2b-cb6d9a648da6-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-rmbdd\" (UID: \"026870b5-9a92-410e-ad2b-cb6d9a648da6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rmbdd"
Sep 11 12:56:13.979273 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.979248    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq4r2\" (UniqueName: \"kubernetes.io/projected/026870b5-9a92-410e-ad2b-cb6d9a648da6-kube-api-access-lq4r2\") pod \"cluster-monitoring-operator-6cd954b897-rmbdd\" (UID: \"026870b5-9a92-410e-ad2b-cb6d9a648da6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rmbdd"
Sep 11 12:56:13.979377 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.979292    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b22738d7-e796-4173-8fb4-80f9208b99dd-config\") pod \"console-operator-696884fb9c-b7gsm\" (UID: \"b22738d7-e796-4173-8fb4-80f9208b99dd\") " pod="openshift-console-operator/console-operator-696884fb9c-b7gsm"
Sep 11 12:56:13.979377 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.979316    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b22738d7-e796-4173-8fb4-80f9208b99dd-serving-cert\") pod \"console-operator-696884fb9c-b7gsm\" (UID: \"b22738d7-e796-4173-8fb4-80f9208b99dd\") " pod="openshift-console-operator/console-operator-696884fb9c-b7gsm"
Sep 11 12:56:13.983688 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.983664    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-knwvb"]
Sep 11 12:56:13.983856 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.983833    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-8wp9p"
Sep 11 12:56:13.986489 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:13.986466    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-v6txj\""
Sep 11 12:56:14.005820 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.005793    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-m29lj"]
Sep 11 12:56:14.005958 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.005909    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-knwvb"
Sep 11 12:56:14.008579 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.008556    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 11 12:56:14.008740 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.008558    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 11 12:56:14.008740 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.008562    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wpfvt\""
Sep 11 12:56:14.008740 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.008602    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 11 12:56:14.027869 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.027844    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b6756f9f8-gn9bv"]
Sep 11 12:56:14.027989 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.027963    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-m29lj"
Sep 11 12:56:14.030253 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.030222    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 11 12:56:14.030938 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.030919    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 11 12:56:14.031051 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.030965    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-nzfb7\""
Sep 11 12:56:14.031239 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.031223    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 11 12:56:14.031613 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.031598    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 11 12:56:14.048015 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.047988    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7457bf46d8-8fk2h"]
Sep 11 12:56:14.048147 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.048119    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:14.050476 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.050453    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 12:56:14.050566 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.050457    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 12:56:14.050566 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.050498    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 12:56:14.050566 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.050501    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g4h6z\""
Sep 11 12:56:14.057066 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.057046    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 12:56:14.062037 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.062016    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-knwvb"]
Sep 11 12:56:14.062142 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.062060    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-8wp9p"]
Sep 11 12:56:14.062142 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.062083    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-m29lj"]
Sep 11 12:56:14.062142 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.062104    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b6756f9f8-gn9bv"]
Sep 11 12:56:14.062142 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.062123    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7457bf46d8-8fk2h"]
Sep 11 12:56:14.062314 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.062160    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:14.062983 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.062962    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-nml2c"]
Sep 11 12:56:14.064989 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.064966    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 12:56:14.065083 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.065008    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 11 12:56:14.065136 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.065126    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 12:56:14.065216 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.064979    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 11 12:56:14.065293 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.065270    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 11 12:56:14.065411 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.065373    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 11 12:56:14.065485 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.065211    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jjgmd\""
Sep 11 12:56:14.078297 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.078270    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-kzws9"]
Sep 11 12:56:14.078421 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.078386    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-nml2c"
Sep 11 12:56:14.079647 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.079607    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq4r2\" (UniqueName: \"kubernetes.io/projected/026870b5-9a92-410e-ad2b-cb6d9a648da6-kube-api-access-lq4r2\") pod \"cluster-monitoring-operator-6cd954b897-rmbdd\" (UID: \"026870b5-9a92-410e-ad2b-cb6d9a648da6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rmbdd"
Sep 11 12:56:14.079812 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.079669    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1585ba00-5e8f-42ec-bcd3-a18167f281ea-serving-cert\") pod \"insights-operator-5844b856db-6h8mp\" (UID: \"1585ba00-5e8f-42ec-bcd3-a18167f281ea\") " pod="openshift-insights/insights-operator-5844b856db-6h8mp"
Sep 11 12:56:14.079812 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.079709    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b22738d7-e796-4173-8fb4-80f9208b99dd-config\") pod \"console-operator-696884fb9c-b7gsm\" (UID: \"b22738d7-e796-4173-8fb4-80f9208b99dd\") " pod="openshift-console-operator/console-operator-696884fb9c-b7gsm"
Sep 11 12:56:14.079812 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.079756    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b22738d7-e796-4173-8fb4-80f9208b99dd-serving-cert\") pod \"console-operator-696884fb9c-b7gsm\" (UID: \"b22738d7-e796-4173-8fb4-80f9208b99dd\") " pod="openshift-console-operator/console-operator-696884fb9c-b7gsm"
Sep 11 12:56:14.079812 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.079783    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e83a739-e6de-46d8-b8d2-dc1e247cf5bb-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-knwvb\" (UID: \"4e83a739-e6de-46d8-b8d2-dc1e247cf5bb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-knwvb"
Sep 11 12:56:14.080184 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.079839    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b22738d7-e796-4173-8fb4-80f9208b99dd-trusted-ca\") pod \"console-operator-696884fb9c-b7gsm\" (UID: \"b22738d7-e796-4173-8fb4-80f9208b99dd\") " pod="openshift-console-operator/console-operator-696884fb9c-b7gsm"
Sep 11 12:56:14.080184 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.079868    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6jn9\" (UniqueName: \"kubernetes.io/projected/474cf6ae-d7e2-42bc-8ddf-7bb52099816e-kube-api-access-g6jn9\") pod \"network-check-source-6f8b768455-8wp9p\" (UID: \"474cf6ae-d7e2-42bc-8ddf-7bb52099816e\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-8wp9p"
Sep 11 12:56:14.080184 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.079892    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9bbx\" (UniqueName: \"kubernetes.io/projected/4e83a739-e6de-46d8-b8d2-dc1e247cf5bb-kube-api-access-h9bbx\") pod \"cluster-samples-operator-86499c89c4-knwvb\" (UID: \"4e83a739-e6de-46d8-b8d2-dc1e247cf5bb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-knwvb"
Sep 11 12:56:14.080753 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.080696    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b22738d7-e796-4173-8fb4-80f9208b99dd-trusted-ca\") pod \"console-operator-696884fb9c-b7gsm\" (UID: \"b22738d7-e796-4173-8fb4-80f9208b99dd\") " pod="openshift-console-operator/console-operator-696884fb9c-b7gsm"
Sep 11 12:56:14.080831 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.080606    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b22738d7-e796-4173-8fb4-80f9208b99dd-config\") pod \"console-operator-696884fb9c-b7gsm\" (UID: \"b22738d7-e796-4173-8fb4-80f9208b99dd\") " pod="openshift-console-operator/console-operator-696884fb9c-b7gsm"
Sep 11 12:56:14.080885 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.080868    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1585ba00-5e8f-42ec-bcd3-a18167f281ea-trusted-ca-bundle\") pod \"insights-operator-5844b856db-6h8mp\" (UID: \"1585ba00-5e8f-42ec-bcd3-a18167f281ea\") " pod="openshift-insights/insights-operator-5844b856db-6h8mp"
Sep 11 12:56:14.080927 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.080895    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1585ba00-5e8f-42ec-bcd3-a18167f281ea-snapshots\") pod \"insights-operator-5844b856db-6h8mp\" (UID: \"1585ba00-5e8f-42ec-bcd3-a18167f281ea\") " pod="openshift-insights/insights-operator-5844b856db-6h8mp"
Sep 11 12:56:14.080927 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.080913    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz9dj\" (UniqueName: \"kubernetes.io/projected/1585ba00-5e8f-42ec-bcd3-a18167f281ea-kube-api-access-zz9dj\") pod \"insights-operator-5844b856db-6h8mp\" (UID: \"1585ba00-5e8f-42ec-bcd3-a18167f281ea\") " pod="openshift-insights/insights-operator-5844b856db-6h8mp"
Sep 11 12:56:14.081013 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.080955    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6pcz\" (UniqueName: \"kubernetes.io/projected/b22738d7-e796-4173-8fb4-80f9208b99dd-kube-api-access-w6pcz\") pod \"console-operator-696884fb9c-b7gsm\" (UID: \"b22738d7-e796-4173-8fb4-80f9208b99dd\") " pod="openshift-console-operator/console-operator-696884fb9c-b7gsm"
Sep 11 12:56:14.081013 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.080973    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/026870b5-9a92-410e-ad2b-cb6d9a648da6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rmbdd\" (UID: \"026870b5-9a92-410e-ad2b-cb6d9a648da6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rmbdd"
Sep 11 12:56:14.081013 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.081001    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/026870b5-9a92-410e-ad2b-cb6d9a648da6-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-rmbdd\" (UID: \"026870b5-9a92-410e-ad2b-cb6d9a648da6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rmbdd"
Sep 11 12:56:14.081303 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.081019    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1585ba00-5e8f-42ec-bcd3-a18167f281ea-tmp\") pod \"insights-operator-5844b856db-6h8mp\" (UID: \"1585ba00-5e8f-42ec-bcd3-a18167f281ea\") " pod="openshift-insights/insights-operator-5844b856db-6h8mp"
Sep 11 12:56:14.081303 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.081038    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1585ba00-5e8f-42ec-bcd3-a18167f281ea-service-ca-bundle\") pod \"insights-operator-5844b856db-6h8mp\" (UID: \"1585ba00-5e8f-42ec-bcd3-a18167f281ea\") " pod="openshift-insights/insights-operator-5844b856db-6h8mp"
Sep 11 12:56:14.081303 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:14.081079    2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 12:56:14.081303 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:14.081157    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/026870b5-9a92-410e-ad2b-cb6d9a648da6-cluster-monitoring-operator-tls podName:026870b5-9a92-410e-ad2b-cb6d9a648da6 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:14.581134752 +0000 UTC m=+41.442608932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/026870b5-9a92-410e-ad2b-cb6d9a648da6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-rmbdd" (UID: "026870b5-9a92-410e-ad2b-cb6d9a648da6") : secret "cluster-monitoring-operator-tls" not found
Sep 11 12:56:14.081745 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.081700    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/026870b5-9a92-410e-ad2b-cb6d9a648da6-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-rmbdd\" (UID: \"026870b5-9a92-410e-ad2b-cb6d9a648da6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rmbdd"
Sep 11 12:56:14.081835 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.081774    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 11 12:56:14.081835 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.081820    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 11 12:56:14.081929 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.081866    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 11 12:56:14.082048 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.082031    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-pr69z\""
Sep 11 12:56:14.082134 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.082111    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 11 12:56:14.084698 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.084678    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b22738d7-e796-4173-8fb4-80f9208b99dd-serving-cert\") pod \"console-operator-696884fb9c-b7gsm\" (UID: \"b22738d7-e796-4173-8fb4-80f9208b99dd\") " pod="openshift-console-operator/console-operator-696884fb9c-b7gsm"
Sep 11 12:56:14.092063 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.092035    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6pcz\" (UniqueName: \"kubernetes.io/projected/b22738d7-e796-4173-8fb4-80f9208b99dd-kube-api-access-w6pcz\") pod \"console-operator-696884fb9c-b7gsm\" (UID: \"b22738d7-e796-4173-8fb4-80f9208b99dd\") " pod="openshift-console-operator/console-operator-696884fb9c-b7gsm"
Sep 11 12:56:14.092834 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.092810    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq4r2\" (UniqueName: \"kubernetes.io/projected/026870b5-9a92-410e-ad2b-cb6d9a648da6-kube-api-access-lq4r2\") pod \"cluster-monitoring-operator-6cd954b897-rmbdd\" (UID: \"026870b5-9a92-410e-ad2b-cb6d9a648da6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rmbdd"
Sep 11 12:56:14.110842 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.110769    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-nml2c"]
Sep 11 12:56:14.110842 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.110809    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-kzws9"]
Sep 11 12:56:14.110996 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.110893    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-kzws9"
Sep 11 12:56:14.113388 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.113370    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 11 12:56:14.113633 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.113611    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 11 12:56:14.113781 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.113759    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-9d2sm\""
Sep 11 12:56:14.152738 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.152680    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:14.181636 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.181602    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-registry-tls\") pod \"image-registry-b6756f9f8-gn9bv\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") " pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:14.181808 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.181648    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmfhm\" (UniqueName: \"kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-kube-api-access-vmfhm\") pod \"image-registry-b6756f9f8-gn9bv\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") " pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:14.181808 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.181702    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a59c6516-8024-4800-9e3e-df32fc1c6967-trusted-ca\") pod \"image-registry-b6756f9f8-gn9bv\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") " pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:14.181808 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.181758    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69fdee23-6a53-4095-a856-3e34a64835c3-service-ca-bundle\") pod \"router-default-7457bf46d8-8fk2h\" (UID: \"69fdee23-6a53-4095-a856-3e34a64835c3\") " pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:14.181808 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.181801    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz9dj\" (UniqueName: \"kubernetes.io/projected/1585ba00-5e8f-42ec-bcd3-a18167f281ea-kube-api-access-zz9dj\") pod \"insights-operator-5844b856db-6h8mp\" (UID: \"1585ba00-5e8f-42ec-bcd3-a18167f281ea\") " pod="openshift-insights/insights-operator-5844b856db-6h8mp"
Sep 11 12:56:14.181999 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.181825    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1585ba00-5e8f-42ec-bcd3-a18167f281ea-snapshots\") pod \"insights-operator-5844b856db-6h8mp\" (UID: \"1585ba00-5e8f-42ec-bcd3-a18167f281ea\") " pod="openshift-insights/insights-operator-5844b856db-6h8mp"
Sep 11 12:56:14.181999 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.181854    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a59c6516-8024-4800-9e3e-df32fc1c6967-registry-certificates\") pod \"image-registry-b6756f9f8-gn9bv\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") " pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:14.181999 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.181882    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a59c6516-8024-4800-9e3e-df32fc1c6967-ca-trust-extracted\") pod \"image-registry-b6756f9f8-gn9bv\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") " pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:14.181999 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.181910    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a59c6516-8024-4800-9e3e-df32fc1c6967-installation-pull-secrets\") pod \"image-registry-b6756f9f8-gn9bv\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") " pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:14.181999 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.181939    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4bdb12c4-f42d-4cc2-aa3f-26e5294459f6-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-m29lj\" (UID: \"4bdb12c4-f42d-4cc2-aa3f-26e5294459f6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-m29lj"
Sep 11 12:56:14.182162 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.182033    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1585ba00-5e8f-42ec-bcd3-a18167f281ea-serving-cert\") pod \"insights-operator-5844b856db-6h8mp\" (UID: \"1585ba00-5e8f-42ec-bcd3-a18167f281ea\") " pod="openshift-insights/insights-operator-5844b856db-6h8mp"
Sep 11 12:56:14.182162 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.182075    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tn8m\" (UniqueName: \"kubernetes.io/projected/f56aabf6-4343-4870-9aaf-1bf4745b686e-kube-api-access-9tn8m\") pod \"service-ca-operator-cf7c776b7-nml2c\" (UID: \"f56aabf6-4343-4870-9aaf-1bf4745b686e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-nml2c"
Sep 11 12:56:14.182162 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.182110    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e83a739-e6de-46d8-b8d2-dc1e247cf5bb-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-knwvb\" (UID: \"4e83a739-e6de-46d8-b8d2-dc1e247cf5bb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-knwvb"
Sep 11 12:56:14.182162 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.182139    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a59c6516-8024-4800-9e3e-df32fc1c6967-image-registry-private-configuration\") pod \"image-registry-b6756f9f8-gn9bv\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") " pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:14.182359 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.182163    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f56aabf6-4343-4870-9aaf-1bf4745b686e-serving-cert\") pod \"service-ca-operator-cf7c776b7-nml2c\" (UID: \"f56aabf6-4343-4870-9aaf-1bf4745b686e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-nml2c"
Sep 11 12:56:14.182359 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.182188    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmj2t\" (UniqueName: \"kubernetes.io/projected/69fdee23-6a53-4095-a856-3e34a64835c3-kube-api-access-bmj2t\") pod \"router-default-7457bf46d8-8fk2h\" (UID: \"69fdee23-6a53-4095-a856-3e34a64835c3\") " pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:14.182359 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:14.182221    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 12:56:14.182359 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:14.182291    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e83a739-e6de-46d8-b8d2-dc1e247cf5bb-samples-operator-tls podName:4e83a739-e6de-46d8-b8d2-dc1e247cf5bb nodeName:}" failed. No retries permitted until 2026-09-11 12:56:14.682274953 +0000 UTC m=+41.543749132 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4e83a739-e6de-46d8-b8d2-dc1e247cf5bb-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-knwvb" (UID: "4e83a739-e6de-46d8-b8d2-dc1e247cf5bb") : secret "samples-operator-tls" not found
Sep 11 12:56:14.182359 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.182225    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/69fdee23-6a53-4095-a856-3e34a64835c3-stats-auth\") pod \"router-default-7457bf46d8-8fk2h\" (UID: \"69fdee23-6a53-4095-a856-3e34a64835c3\") " pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:14.182359 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.182315    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69fdee23-6a53-4095-a856-3e34a64835c3-metrics-certs\") pod \"router-default-7457bf46d8-8fk2h\" (UID: \"69fdee23-6a53-4095-a856-3e34a64835c3\") " pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:14.182359 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.182343    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6jn9\" (UniqueName: \"kubernetes.io/projected/474cf6ae-d7e2-42bc-8ddf-7bb52099816e-kube-api-access-g6jn9\") pod \"network-check-source-6f8b768455-8wp9p\" (UID: \"474cf6ae-d7e2-42bc-8ddf-7bb52099816e\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-8wp9p"
Sep 11 12:56:14.182661 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.182370    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9bbx\" (UniqueName: \"kubernetes.io/projected/4e83a739-e6de-46d8-b8d2-dc1e247cf5bb-kube-api-access-h9bbx\") pod \"cluster-samples-operator-86499c89c4-knwvb\" (UID: \"4e83a739-e6de-46d8-b8d2-dc1e247cf5bb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-knwvb"
Sep 11 12:56:14.182661 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.182486    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4bdb12c4-f42d-4cc2-aa3f-26e5294459f6-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-m29lj\" (UID: \"4bdb12c4-f42d-4cc2-aa3f-26e5294459f6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-m29lj"
Sep 11 12:56:14.182661 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.182525    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgzr5\" (UniqueName: \"kubernetes.io/projected/4bdb12c4-f42d-4cc2-aa3f-26e5294459f6-kube-api-access-fgzr5\") pod \"kube-storage-version-migrator-operator-6c8f84f897-m29lj\" (UID: \"4bdb12c4-f42d-4cc2-aa3f-26e5294459f6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-m29lj"
Sep 11 12:56:14.182661 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.182547    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1585ba00-5e8f-42ec-bcd3-a18167f281ea-snapshots\") pod \"insights-operator-5844b856db-6h8mp\" (UID: \"1585ba00-5e8f-42ec-bcd3-a18167f281ea\") " pod="openshift-insights/insights-operator-5844b856db-6h8mp"
Sep 11 12:56:14.182661 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.182631    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/69fdee23-6a53-4095-a856-3e34a64835c3-default-certificate\") pod \"router-default-7457bf46d8-8fk2h\" (UID: \"69fdee23-6a53-4095-a856-3e34a64835c3\") " pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:14.182661 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.182656    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f56aabf6-4343-4870-9aaf-1bf4745b686e-config\") pod \"service-ca-operator-cf7c776b7-nml2c\" (UID: \"f56aabf6-4343-4870-9aaf-1bf4745b686e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-nml2c"
Sep 11 12:56:14.182928 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.182681    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1585ba00-5e8f-42ec-bcd3-a18167f281ea-tmp\") pod \"insights-operator-5844b856db-6h8mp\" (UID: \"1585ba00-5e8f-42ec-bcd3-a18167f281ea\") " pod="openshift-insights/insights-operator-5844b856db-6h8mp"
Sep 11 12:56:14.182928 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.182699    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1585ba00-5e8f-42ec-bcd3-a18167f281ea-service-ca-bundle\") pod \"insights-operator-5844b856db-6h8mp\" (UID: \"1585ba00-5e8f-42ec-bcd3-a18167f281ea\") " pod="openshift-insights/insights-operator-5844b856db-6h8mp"
Sep 11 12:56:14.182928 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.182737    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1585ba00-5e8f-42ec-bcd3-a18167f281ea-trusted-ca-bundle\") pod \"insights-operator-5844b856db-6h8mp\" (UID: \"1585ba00-5e8f-42ec-bcd3-a18167f281ea\") " pod="openshift-insights/insights-operator-5844b856db-6h8mp"
Sep 11 12:56:14.182928 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.182752    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-bound-sa-token\") pod \"image-registry-b6756f9f8-gn9bv\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") " pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:14.183113 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.182946    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1585ba00-5e8f-42ec-bcd3-a18167f281ea-tmp\") pod \"insights-operator-5844b856db-6h8mp\" (UID: \"1585ba00-5e8f-42ec-bcd3-a18167f281ea\") " pod="openshift-insights/insights-operator-5844b856db-6h8mp"
Sep 11 12:56:14.183347 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.183324    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1585ba00-5e8f-42ec-bcd3-a18167f281ea-service-ca-bundle\") pod \"insights-operator-5844b856db-6h8mp\" (UID: \"1585ba00-5e8f-42ec-bcd3-a18167f281ea\") " pod="openshift-insights/insights-operator-5844b856db-6h8mp"
Sep 11 12:56:14.183492 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.183474    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1585ba00-5e8f-42ec-bcd3-a18167f281ea-trusted-ca-bundle\") pod \"insights-operator-5844b856db-6h8mp\" (UID: \"1585ba00-5e8f-42ec-bcd3-a18167f281ea\") " pod="openshift-insights/insights-operator-5844b856db-6h8mp"
Sep 11 12:56:14.184510 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.184496    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1585ba00-5e8f-42ec-bcd3-a18167f281ea-serving-cert\") pod \"insights-operator-5844b856db-6h8mp\" (UID: \"1585ba00-5e8f-42ec-bcd3-a18167f281ea\") " pod="openshift-insights/insights-operator-5844b856db-6h8mp"
Sep 11 12:56:14.190768 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.190746    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6jn9\" (UniqueName: \"kubernetes.io/projected/474cf6ae-d7e2-42bc-8ddf-7bb52099816e-kube-api-access-g6jn9\") pod \"network-check-source-6f8b768455-8wp9p\" (UID: \"474cf6ae-d7e2-42bc-8ddf-7bb52099816e\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-8wp9p"
Sep 11 12:56:14.190852 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.190811    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz9dj\" (UniqueName: \"kubernetes.io/projected/1585ba00-5e8f-42ec-bcd3-a18167f281ea-kube-api-access-zz9dj\") pod \"insights-operator-5844b856db-6h8mp\" (UID: \"1585ba00-5e8f-42ec-bcd3-a18167f281ea\") " pod="openshift-insights/insights-operator-5844b856db-6h8mp"
Sep 11 12:56:14.191355 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.191329    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9bbx\" (UniqueName: \"kubernetes.io/projected/4e83a739-e6de-46d8-b8d2-dc1e247cf5bb-kube-api-access-h9bbx\") pod \"cluster-samples-operator-86499c89c4-knwvb\" (UID: \"4e83a739-e6de-46d8-b8d2-dc1e247cf5bb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-knwvb"
Sep 11 12:56:14.212314 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.212278    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-b7gsm"
Sep 11 12:56:14.216203 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.216174    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:14.228241 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.228211    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-6h8mp"
Sep 11 12:56:14.284001 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.283970    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgzr5\" (UniqueName: \"kubernetes.io/projected/4bdb12c4-f42d-4cc2-aa3f-26e5294459f6-kube-api-access-fgzr5\") pod \"kube-storage-version-migrator-operator-6c8f84f897-m29lj\" (UID: \"4bdb12c4-f42d-4cc2-aa3f-26e5294459f6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-m29lj"
Sep 11 12:56:14.284143 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.284027    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/69fdee23-6a53-4095-a856-3e34a64835c3-default-certificate\") pod \"router-default-7457bf46d8-8fk2h\" (UID: \"69fdee23-6a53-4095-a856-3e34a64835c3\") " pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:14.284143 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.284063    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f56aabf6-4343-4870-9aaf-1bf4745b686e-config\") pod \"service-ca-operator-cf7c776b7-nml2c\" (UID: \"f56aabf6-4343-4870-9aaf-1bf4745b686e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-nml2c"
Sep 11 12:56:14.284143 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.284095    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-bound-sa-token\") pod \"image-registry-b6756f9f8-gn9bv\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") " pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:14.284143 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.284118    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-registry-tls\") pod \"image-registry-b6756f9f8-gn9bv\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") " pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:14.284571 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.284153    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmfhm\" (UniqueName: \"kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-kube-api-access-vmfhm\") pod \"image-registry-b6756f9f8-gn9bv\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") " pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:14.284571 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.284190    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a59c6516-8024-4800-9e3e-df32fc1c6967-trusted-ca\") pod \"image-registry-b6756f9f8-gn9bv\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") " pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:14.284571 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.284222    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69fdee23-6a53-4095-a856-3e34a64835c3-service-ca-bundle\") pod \"router-default-7457bf46d8-8fk2h\" (UID: \"69fdee23-6a53-4095-a856-3e34a64835c3\") " pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:14.284571 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.284253    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a59c6516-8024-4800-9e3e-df32fc1c6967-registry-certificates\") pod \"image-registry-b6756f9f8-gn9bv\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") " pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:14.284571 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.284280    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a59c6516-8024-4800-9e3e-df32fc1c6967-ca-trust-extracted\") pod \"image-registry-b6756f9f8-gn9bv\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") " pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:14.284571 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.284310    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a59c6516-8024-4800-9e3e-df32fc1c6967-installation-pull-secrets\") pod \"image-registry-b6756f9f8-gn9bv\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") " pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:14.284571 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.284336    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4bdb12c4-f42d-4cc2-aa3f-26e5294459f6-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-m29lj\" (UID: \"4bdb12c4-f42d-4cc2-aa3f-26e5294459f6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-m29lj"
Sep 11 12:56:14.284571 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.284367    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrmjx\" (UniqueName: \"kubernetes.io/projected/71bcc6fe-50d4-4d8f-bc8a-8c0073ac3b54-kube-api-access-rrmjx\") pod \"volume-data-source-validator-86695b7cc7-kzws9\" (UID: \"71bcc6fe-50d4-4d8f-bc8a-8c0073ac3b54\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-kzws9"
Sep 11 12:56:14.284571 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.284425    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tn8m\" (UniqueName: \"kubernetes.io/projected/f56aabf6-4343-4870-9aaf-1bf4745b686e-kube-api-access-9tn8m\") pod \"service-ca-operator-cf7c776b7-nml2c\" (UID: \"f56aabf6-4343-4870-9aaf-1bf4745b686e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-nml2c"
Sep 11 12:56:14.284571 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.284465    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a59c6516-8024-4800-9e3e-df32fc1c6967-image-registry-private-configuration\") pod \"image-registry-b6756f9f8-gn9bv\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") " pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:14.284571 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.284490    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f56aabf6-4343-4870-9aaf-1bf4745b686e-serving-cert\") pod \"service-ca-operator-cf7c776b7-nml2c\" (UID: \"f56aabf6-4343-4870-9aaf-1bf4745b686e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-nml2c"
Sep 11 12:56:14.284571 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.284516    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmj2t\" (UniqueName: \"kubernetes.io/projected/69fdee23-6a53-4095-a856-3e34a64835c3-kube-api-access-bmj2t\") pod \"router-default-7457bf46d8-8fk2h\" (UID: \"69fdee23-6a53-4095-a856-3e34a64835c3\") " pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:14.284571 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.284554    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/69fdee23-6a53-4095-a856-3e34a64835c3-stats-auth\") pod \"router-default-7457bf46d8-8fk2h\" (UID: \"69fdee23-6a53-4095-a856-3e34a64835c3\") " pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:14.285203 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.284576    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69fdee23-6a53-4095-a856-3e34a64835c3-metrics-certs\") pod \"router-default-7457bf46d8-8fk2h\" (UID: \"69fdee23-6a53-4095-a856-3e34a64835c3\") " pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:14.285203 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.284610    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4bdb12c4-f42d-4cc2-aa3f-26e5294459f6-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-m29lj\" (UID: \"4bdb12c4-f42d-4cc2-aa3f-26e5294459f6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-m29lj"
Sep 11 12:56:14.285295 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:14.285244    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:56:14.285295 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:14.285263    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b6756f9f8-gn9bv: secret "image-registry-tls" not found
Sep 11 12:56:14.285402 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:14.285297    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69fdee23-6a53-4095-a856-3e34a64835c3-service-ca-bundle podName:69fdee23-6a53-4095-a856-3e34a64835c3 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:14.785273072 +0000 UTC m=+41.646747270 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/69fdee23-6a53-4095-a856-3e34a64835c3-service-ca-bundle") pod "router-default-7457bf46d8-8fk2h" (UID: "69fdee23-6a53-4095-a856-3e34a64835c3") : configmap references non-existent config key: service-ca.crt
Sep 11 12:56:14.285402 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:14.285347    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-registry-tls podName:a59c6516-8024-4800-9e3e-df32fc1c6967 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:14.785328017 +0000 UTC m=+41.646802196 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-registry-tls") pod "image-registry-b6756f9f8-gn9bv" (UID: "a59c6516-8024-4800-9e3e-df32fc1c6967") : secret "image-registry-tls" not found
Sep 11 12:56:14.285846 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.285821    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a59c6516-8024-4800-9e3e-df32fc1c6967-ca-trust-extracted\") pod \"image-registry-b6756f9f8-gn9bv\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") " pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:14.285945 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:14.285918    2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 12:56:14.286004 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:14.285970    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69fdee23-6a53-4095-a856-3e34a64835c3-metrics-certs podName:69fdee23-6a53-4095-a856-3e34a64835c3 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:14.785954888 +0000 UTC m=+41.647429061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69fdee23-6a53-4095-a856-3e34a64835c3-metrics-certs") pod "router-default-7457bf46d8-8fk2h" (UID: "69fdee23-6a53-4095-a856-3e34a64835c3") : secret "router-metrics-certs-default" not found
Sep 11 12:56:14.287281 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.286879    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a59c6516-8024-4800-9e3e-df32fc1c6967-trusted-ca\") pod \"image-registry-b6756f9f8-gn9bv\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") " pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:14.287281 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.286907    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f56aabf6-4343-4870-9aaf-1bf4745b686e-config\") pod \"service-ca-operator-cf7c776b7-nml2c\" (UID: \"f56aabf6-4343-4870-9aaf-1bf4745b686e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-nml2c"
Sep 11 12:56:14.287281 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.286953    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4bdb12c4-f42d-4cc2-aa3f-26e5294459f6-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-m29lj\" (UID: \"4bdb12c4-f42d-4cc2-aa3f-26e5294459f6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-m29lj"
Sep 11 12:56:14.288397 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.288335    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f56aabf6-4343-4870-9aaf-1bf4745b686e-serving-cert\") pod \"service-ca-operator-cf7c776b7-nml2c\" (UID: \"f56aabf6-4343-4870-9aaf-1bf4745b686e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-nml2c"
Sep 11 12:56:14.288470 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.288402    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4bdb12c4-f42d-4cc2-aa3f-26e5294459f6-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-m29lj\" (UID: \"4bdb12c4-f42d-4cc2-aa3f-26e5294459f6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-m29lj"
Sep 11 12:56:14.288595 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.288549    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a59c6516-8024-4800-9e3e-df32fc1c6967-registry-certificates\") pod \"image-registry-b6756f9f8-gn9bv\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") " pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:14.289959 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.289890    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/69fdee23-6a53-4095-a856-3e34a64835c3-stats-auth\") pod \"router-default-7457bf46d8-8fk2h\" (UID: \"69fdee23-6a53-4095-a856-3e34a64835c3\") " pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:14.291298 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.291269    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a59c6516-8024-4800-9e3e-df32fc1c6967-image-registry-private-configuration\") pod \"image-registry-b6756f9f8-gn9bv\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") " pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:14.292316 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.292265    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/69fdee23-6a53-4095-a856-3e34a64835c3-default-certificate\") pod \"router-default-7457bf46d8-8fk2h\" (UID: \"69fdee23-6a53-4095-a856-3e34a64835c3\") " pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:14.292653 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.292633    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a59c6516-8024-4800-9e3e-df32fc1c6967-installation-pull-secrets\") pod \"image-registry-b6756f9f8-gn9bv\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") " pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:14.294227 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.294049    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-8wp9p"
Sep 11 12:56:14.297992 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.297964    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmfhm\" (UniqueName: \"kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-kube-api-access-vmfhm\") pod \"image-registry-b6756f9f8-gn9bv\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") " pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:14.298075 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.298042    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-bound-sa-token\") pod \"image-registry-b6756f9f8-gn9bv\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") " pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:14.298459 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.298434    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgzr5\" (UniqueName: \"kubernetes.io/projected/4bdb12c4-f42d-4cc2-aa3f-26e5294459f6-kube-api-access-fgzr5\") pod \"kube-storage-version-migrator-operator-6c8f84f897-m29lj\" (UID: \"4bdb12c4-f42d-4cc2-aa3f-26e5294459f6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-m29lj"
Sep 11 12:56:14.298739 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.298674    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tn8m\" (UniqueName: \"kubernetes.io/projected/f56aabf6-4343-4870-9aaf-1bf4745b686e-kube-api-access-9tn8m\") pod \"service-ca-operator-cf7c776b7-nml2c\" (UID: \"f56aabf6-4343-4870-9aaf-1bf4745b686e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-nml2c"
Sep 11 12:56:14.300383 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.300360    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmj2t\" (UniqueName: \"kubernetes.io/projected/69fdee23-6a53-4095-a856-3e34a64835c3-kube-api-access-bmj2t\") pod \"router-default-7457bf46d8-8fk2h\" (UID: \"69fdee23-6a53-4095-a856-3e34a64835c3\") " pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:14.336369 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.336335    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-m29lj"
Sep 11 12:56:14.385241 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.385209    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrmjx\" (UniqueName: \"kubernetes.io/projected/71bcc6fe-50d4-4d8f-bc8a-8c0073ac3b54-kube-api-access-rrmjx\") pod \"volume-data-source-validator-86695b7cc7-kzws9\" (UID: \"71bcc6fe-50d4-4d8f-bc8a-8c0073ac3b54\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-kzws9"
Sep 11 12:56:14.394348 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.394319    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrmjx\" (UniqueName: \"kubernetes.io/projected/71bcc6fe-50d4-4d8f-bc8a-8c0073ac3b54-kube-api-access-rrmjx\") pod \"volume-data-source-validator-86695b7cc7-kzws9\" (UID: \"71bcc6fe-50d4-4d8f-bc8a-8c0073ac3b54\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-kzws9"
Sep 11 12:56:14.401097 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.401070    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-nml2c"
Sep 11 12:56:14.420659 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.420410    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-kzws9"
Sep 11 12:56:14.515204 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.514847    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-b7gsm"]
Sep 11 12:56:14.518867 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:56:14.518842    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb22738d7_e796_4173_8fb4_80f9208b99dd.slice/crio-5206d47fdff2e45f58e28096092a8b1955e6dc45b7839937eb20eedea56c6f59 WatchSource:0}: Error finding container 5206d47fdff2e45f58e28096092a8b1955e6dc45b7839937eb20eedea56c6f59: Status 404 returned error can't find the container with id 5206d47fdff2e45f58e28096092a8b1955e6dc45b7839937eb20eedea56c6f59
Sep 11 12:56:14.539349 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.539317    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-6h8mp"]
Sep 11 12:56:14.542429 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:56:14.542405    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1585ba00_5e8f_42ec_bcd3_a18167f281ea.slice/crio-11ca0e3157855d98bfe627703632e522d652b6d162c9be6fee855aa6f92f9034 WatchSource:0}: Error finding container 11ca0e3157855d98bfe627703632e522d652b6d162c9be6fee855aa6f92f9034: Status 404 returned error can't find the container with id 11ca0e3157855d98bfe627703632e522d652b6d162c9be6fee855aa6f92f9034
Sep 11 12:56:14.587129 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.587098    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/026870b5-9a92-410e-ad2b-cb6d9a648da6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rmbdd\" (UID: \"026870b5-9a92-410e-ad2b-cb6d9a648da6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rmbdd"
Sep 11 12:56:14.587291 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:14.587256    2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 12:56:14.587331 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:14.587320    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/026870b5-9a92-410e-ad2b-cb6d9a648da6-cluster-monitoring-operator-tls podName:026870b5-9a92-410e-ad2b-cb6d9a648da6 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:15.587301595 +0000 UTC m=+42.448775778 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/026870b5-9a92-410e-ad2b-cb6d9a648da6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-rmbdd" (UID: "026870b5-9a92-410e-ad2b-cb6d9a648da6") : secret "cluster-monitoring-operator-tls" not found
Sep 11 12:56:14.590251 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.590109    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-8wp9p"]
Sep 11 12:56:14.592650 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:56:14.592625    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod474cf6ae_d7e2_42bc_8ddf_7bb52099816e.slice/crio-6c76d6bc05a585389d35977a0eba6fcd10b989f47d2c5888ceedfd418e51b6c3 WatchSource:0}: Error finding container 6c76d6bc05a585389d35977a0eba6fcd10b989f47d2c5888ceedfd418e51b6c3: Status 404 returned error can't find the container with id 6c76d6bc05a585389d35977a0eba6fcd10b989f47d2c5888ceedfd418e51b6c3
Sep 11 12:56:14.637571 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.637500    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-m29lj"]
Sep 11 12:56:14.640416 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:56:14.640389    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bdb12c4_f42d_4cc2_aa3f_26e5294459f6.slice/crio-1066177cbfa78ab3dceeaf3639b0b8485f65e68feb338bc424b8cc647767dd4b WatchSource:0}: Error finding container 1066177cbfa78ab3dceeaf3639b0b8485f65e68feb338bc424b8cc647767dd4b: Status 404 returned error can't find the container with id 1066177cbfa78ab3dceeaf3639b0b8485f65e68feb338bc424b8cc647767dd4b
Sep 11 12:56:14.687915 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.687879    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e83a739-e6de-46d8-b8d2-dc1e247cf5bb-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-knwvb\" (UID: \"4e83a739-e6de-46d8-b8d2-dc1e247cf5bb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-knwvb"
Sep 11 12:56:14.688101 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:14.688001    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 12:56:14.688101 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:14.688064    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e83a739-e6de-46d8-b8d2-dc1e247cf5bb-samples-operator-tls podName:4e83a739-e6de-46d8-b8d2-dc1e247cf5bb nodeName:}" failed. No retries permitted until 2026-09-11 12:56:15.688049219 +0000 UTC m=+42.549523384 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4e83a739-e6de-46d8-b8d2-dc1e247cf5bb-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-knwvb" (UID: "4e83a739-e6de-46d8-b8d2-dc1e247cf5bb") : secret "samples-operator-tls" not found
Sep 11 12:56:14.701003 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.700974    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-nml2c"]
Sep 11 12:56:14.703511 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:56:14.703485    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf56aabf6_4343_4870_9aaf_1bf4745b686e.slice/crio-734bde4ded91699b7a503f54fbfe6b915a97155b1fdbb50d3cc16188e353a4b2 WatchSource:0}: Error finding container 734bde4ded91699b7a503f54fbfe6b915a97155b1fdbb50d3cc16188e353a4b2: Status 404 returned error can't find the container with id 734bde4ded91699b7a503f54fbfe6b915a97155b1fdbb50d3cc16188e353a4b2
Sep 11 12:56:14.727080 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.727059    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-kzws9"]
Sep 11 12:56:14.729303 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:56:14.729279    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71bcc6fe_50d4_4d8f_bc8a_8c0073ac3b54.slice/crio-0652f2a76a8aaa39cbfb9a52fe9acd5b4b593596df01b604230107f0b9f3bbc3 WatchSource:0}: Error finding container 0652f2a76a8aaa39cbfb9a52fe9acd5b4b593596df01b604230107f0b9f3bbc3: Status 404 returned error can't find the container with id 0652f2a76a8aaa39cbfb9a52fe9acd5b4b593596df01b604230107f0b9f3bbc3
Sep 11 12:56:14.788821 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.788784    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-registry-tls\") pod \"image-registry-b6756f9f8-gn9bv\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") " pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:14.788974 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.788843    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69fdee23-6a53-4095-a856-3e34a64835c3-service-ca-bundle\") pod \"router-default-7457bf46d8-8fk2h\" (UID: \"69fdee23-6a53-4095-a856-3e34a64835c3\") " pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:14.788974 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.788913    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69fdee23-6a53-4095-a856-3e34a64835c3-metrics-certs\") pod \"router-default-7457bf46d8-8fk2h\" (UID: \"69fdee23-6a53-4095-a856-3e34a64835c3\") " pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:14.788974 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:14.788939    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:56:14.788974 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:14.788959    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b6756f9f8-gn9bv: secret "image-registry-tls" not found
Sep 11 12:56:14.789122 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:14.789015    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69fdee23-6a53-4095-a856-3e34a64835c3-service-ca-bundle podName:69fdee23-6a53-4095-a856-3e34a64835c3 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:15.788997097 +0000 UTC m=+42.650471263 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/69fdee23-6a53-4095-a856-3e34a64835c3-service-ca-bundle") pod "router-default-7457bf46d8-8fk2h" (UID: "69fdee23-6a53-4095-a856-3e34a64835c3") : configmap references non-existent config key: service-ca.crt
Sep 11 12:56:14.789122 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:14.789024    2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 12:56:14.789122 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:14.789033    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-registry-tls podName:a59c6516-8024-4800-9e3e-df32fc1c6967 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:15.789026505 +0000 UTC m=+42.650500671 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-registry-tls") pod "image-registry-b6756f9f8-gn9bv" (UID: "a59c6516-8024-4800-9e3e-df32fc1c6967") : secret "image-registry-tls" not found
Sep 11 12:56:14.789122 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:14.789090    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69fdee23-6a53-4095-a856-3e34a64835c3-metrics-certs podName:69fdee23-6a53-4095-a856-3e34a64835c3 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:15.789051404 +0000 UTC m=+42.650525586 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69fdee23-6a53-4095-a856-3e34a64835c3-metrics-certs") pod "router-default-7457bf46d8-8fk2h" (UID: "69fdee23-6a53-4095-a856-3e34a64835c3") : secret "router-metrics-certs-default" not found
Sep 11 12:56:14.870585 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.870550    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-kzws9" event={"ID":"71bcc6fe-50d4-4d8f-bc8a-8c0073ac3b54","Type":"ContainerStarted","Data":"0652f2a76a8aaa39cbfb9a52fe9acd5b4b593596df01b604230107f0b9f3bbc3"}
Sep 11 12:56:14.872066 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.872010    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-m29lj" event={"ID":"4bdb12c4-f42d-4cc2-aa3f-26e5294459f6","Type":"ContainerStarted","Data":"1066177cbfa78ab3dceeaf3639b0b8485f65e68feb338bc424b8cc647767dd4b"}
Sep 11 12:56:14.876547 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.876521    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-8wp9p" event={"ID":"474cf6ae-d7e2-42bc-8ddf-7bb52099816e","Type":"ContainerStarted","Data":"6c76d6bc05a585389d35977a0eba6fcd10b989f47d2c5888ceedfd418e51b6c3"}
Sep 11 12:56:14.877673 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.877646    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-6h8mp" event={"ID":"1585ba00-5e8f-42ec-bcd3-a18167f281ea","Type":"ContainerStarted","Data":"11ca0e3157855d98bfe627703632e522d652b6d162c9be6fee855aa6f92f9034"}
Sep 11 12:56:14.878970 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.878946    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-b7gsm" event={"ID":"b22738d7-e796-4173-8fb4-80f9208b99dd","Type":"ContainerStarted","Data":"5206d47fdff2e45f58e28096092a8b1955e6dc45b7839937eb20eedea56c6f59"}
Sep 11 12:56:14.880116 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:14.880094    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-nml2c" event={"ID":"f56aabf6-4343-4870-9aaf-1bf4745b686e","Type":"ContainerStarted","Data":"734bde4ded91699b7a503f54fbfe6b915a97155b1fdbb50d3cc16188e353a4b2"}
Sep 11 12:56:15.213244 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:15.213158    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:15.294099 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:15.293326    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0be127eb-c133-4cbd-b442-9c8d0ae735aa-metrics-tls\") pod \"dns-default-75kfq\" (UID: \"0be127eb-c133-4cbd-b442-9c8d0ae735aa\") " pod="openshift-dns/dns-default-75kfq"
Sep 11 12:56:15.294099 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:15.293636    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:56:15.294099 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:15.293703    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0be127eb-c133-4cbd-b442-9c8d0ae735aa-metrics-tls podName:0be127eb-c133-4cbd-b442-9c8d0ae735aa nodeName:}" failed. No retries permitted until 2026-09-11 12:56:23.293681827 +0000 UTC m=+50.155156009 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0be127eb-c133-4cbd-b442-9c8d0ae735aa-metrics-tls") pod "dns-default-75kfq" (UID: "0be127eb-c133-4cbd-b442-9c8d0ae735aa") : secret "dns-default-metrics-tls" not found
Sep 11 12:56:15.598022 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:15.597423    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/026870b5-9a92-410e-ad2b-cb6d9a648da6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rmbdd\" (UID: \"026870b5-9a92-410e-ad2b-cb6d9a648da6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rmbdd"
Sep 11 12:56:15.598022 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:15.597592    2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 12:56:15.598022 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:15.597657    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/026870b5-9a92-410e-ad2b-cb6d9a648da6-cluster-monitoring-operator-tls podName:026870b5-9a92-410e-ad2b-cb6d9a648da6 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:17.597637615 +0000 UTC m=+44.459111794 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/026870b5-9a92-410e-ad2b-cb6d9a648da6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-rmbdd" (UID: "026870b5-9a92-410e-ad2b-cb6d9a648da6") : secret "cluster-monitoring-operator-tls" not found
Sep 11 12:56:15.699633 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:15.698706    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e83a739-e6de-46d8-b8d2-dc1e247cf5bb-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-knwvb\" (UID: \"4e83a739-e6de-46d8-b8d2-dc1e247cf5bb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-knwvb"
Sep 11 12:56:15.699633 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:15.699166    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 12:56:15.699633 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:15.699237    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e83a739-e6de-46d8-b8d2-dc1e247cf5bb-samples-operator-tls podName:4e83a739-e6de-46d8-b8d2-dc1e247cf5bb nodeName:}" failed. No retries permitted until 2026-09-11 12:56:17.699218281 +0000 UTC m=+44.560692464 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4e83a739-e6de-46d8-b8d2-dc1e247cf5bb-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-knwvb" (UID: "4e83a739-e6de-46d8-b8d2-dc1e247cf5bb") : secret "samples-operator-tls" not found
Sep 11 12:56:15.801409 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:15.800334    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-registry-tls\") pod \"image-registry-b6756f9f8-gn9bv\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") " pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:15.801409 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:15.800437    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69fdee23-6a53-4095-a856-3e34a64835c3-service-ca-bundle\") pod \"router-default-7457bf46d8-8fk2h\" (UID: \"69fdee23-6a53-4095-a856-3e34a64835c3\") " pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:15.801409 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:15.800552    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69fdee23-6a53-4095-a856-3e34a64835c3-metrics-certs\") pod \"router-default-7457bf46d8-8fk2h\" (UID: \"69fdee23-6a53-4095-a856-3e34a64835c3\") " pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:15.801409 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:15.800684    2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 12:56:15.801409 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:15.800779    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69fdee23-6a53-4095-a856-3e34a64835c3-metrics-certs podName:69fdee23-6a53-4095-a856-3e34a64835c3 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:17.800759636 +0000 UTC m=+44.662233817 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69fdee23-6a53-4095-a856-3e34a64835c3-metrics-certs") pod "router-default-7457bf46d8-8fk2h" (UID: "69fdee23-6a53-4095-a856-3e34a64835c3") : secret "router-metrics-certs-default" not found
Sep 11 12:56:15.801409 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:15.801195    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:56:15.801409 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:15.801210    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b6756f9f8-gn9bv: secret "image-registry-tls" not found
Sep 11 12:56:15.801409 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:15.801252    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-registry-tls podName:a59c6516-8024-4800-9e3e-df32fc1c6967 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:17.801237422 +0000 UTC m=+44.662711610 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-registry-tls") pod "image-registry-b6756f9f8-gn9bv" (UID: "a59c6516-8024-4800-9e3e-df32fc1c6967") : secret "image-registry-tls" not found
Sep 11 12:56:15.801409 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:15.801331    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69fdee23-6a53-4095-a856-3e34a64835c3-service-ca-bundle podName:69fdee23-6a53-4095-a856-3e34a64835c3 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:17.801320764 +0000 UTC m=+44.662794944 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/69fdee23-6a53-4095-a856-3e34a64835c3-service-ca-bundle") pod "router-default-7457bf46d8-8fk2h" (UID: "69fdee23-6a53-4095-a856-3e34a64835c3") : configmap references non-existent config key: service-ca.crt
Sep 11 12:56:17.620097 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:17.620042    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/026870b5-9a92-410e-ad2b-cb6d9a648da6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rmbdd\" (UID: \"026870b5-9a92-410e-ad2b-cb6d9a648da6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rmbdd"
Sep 11 12:56:17.620536 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:17.620191    2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 12:56:17.620536 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:17.620261    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/026870b5-9a92-410e-ad2b-cb6d9a648da6-cluster-monitoring-operator-tls podName:026870b5-9a92-410e-ad2b-cb6d9a648da6 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:21.620239641 +0000 UTC m=+48.481713807 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/026870b5-9a92-410e-ad2b-cb6d9a648da6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-rmbdd" (UID: "026870b5-9a92-410e-ad2b-cb6d9a648da6") : secret "cluster-monitoring-operator-tls" not found
Sep 11 12:56:17.720849 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:17.720806    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e83a739-e6de-46d8-b8d2-dc1e247cf5bb-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-knwvb\" (UID: \"4e83a739-e6de-46d8-b8d2-dc1e247cf5bb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-knwvb"
Sep 11 12:56:17.720998 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:17.720953    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 12:56:17.721036 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:17.721015    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e83a739-e6de-46d8-b8d2-dc1e247cf5bb-samples-operator-tls podName:4e83a739-e6de-46d8-b8d2-dc1e247cf5bb nodeName:}" failed. No retries permitted until 2026-09-11 12:56:21.720997708 +0000 UTC m=+48.582471875 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4e83a739-e6de-46d8-b8d2-dc1e247cf5bb-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-knwvb" (UID: "4e83a739-e6de-46d8-b8d2-dc1e247cf5bb") : secret "samples-operator-tls" not found
Sep 11 12:56:17.821910 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:17.821868    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69fdee23-6a53-4095-a856-3e34a64835c3-metrics-certs\") pod \"router-default-7457bf46d8-8fk2h\" (UID: \"69fdee23-6a53-4095-a856-3e34a64835c3\") " pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:17.822106 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:17.822047    2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 12:56:17.822106 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:17.822066    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-registry-tls\") pod \"image-registry-b6756f9f8-gn9bv\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") " pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:17.822217 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:17.822122    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69fdee23-6a53-4095-a856-3e34a64835c3-metrics-certs podName:69fdee23-6a53-4095-a856-3e34a64835c3 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:21.822100337 +0000 UTC m=+48.683574523 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69fdee23-6a53-4095-a856-3e34a64835c3-metrics-certs") pod "router-default-7457bf46d8-8fk2h" (UID: "69fdee23-6a53-4095-a856-3e34a64835c3") : secret "router-metrics-certs-default" not found
Sep 11 12:56:17.822217 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:17.822148    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69fdee23-6a53-4095-a856-3e34a64835c3-service-ca-bundle\") pod \"router-default-7457bf46d8-8fk2h\" (UID: \"69fdee23-6a53-4095-a856-3e34a64835c3\") " pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:17.822327 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:17.822223    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:56:17.822327 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:17.822239    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b6756f9f8-gn9bv: secret "image-registry-tls" not found
Sep 11 12:56:17.822327 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:17.822284    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-registry-tls podName:a59c6516-8024-4800-9e3e-df32fc1c6967 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:21.822266935 +0000 UTC m=+48.683741120 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-registry-tls") pod "image-registry-b6756f9f8-gn9bv" (UID: "a59c6516-8024-4800-9e3e-df32fc1c6967") : secret "image-registry-tls" not found
Sep 11 12:56:17.822451 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:17.822351    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69fdee23-6a53-4095-a856-3e34a64835c3-service-ca-bundle podName:69fdee23-6a53-4095-a856-3e34a64835c3 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:21.822337214 +0000 UTC m=+48.683811404 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/69fdee23-6a53-4095-a856-3e34a64835c3-service-ca-bundle") pod "router-default-7457bf46d8-8fk2h" (UID: "69fdee23-6a53-4095-a856-3e34a64835c3") : configmap references non-existent config key: service-ca.crt
Sep 11 12:56:19.297959 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:19.297917    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:19.360928 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:19.360884    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:20.123231 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:20.123193    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:20.183320 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:20.183276    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:21.655003 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:21.654822    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/026870b5-9a92-410e-ad2b-cb6d9a648da6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rmbdd\" (UID: \"026870b5-9a92-410e-ad2b-cb6d9a648da6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rmbdd"
Sep 11 12:56:21.655550 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:21.654962    2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 12:56:21.655550 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:21.655132    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/026870b5-9a92-410e-ad2b-cb6d9a648da6-cluster-monitoring-operator-tls podName:026870b5-9a92-410e-ad2b-cb6d9a648da6 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:29.655110015 +0000 UTC m=+56.516584185 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/026870b5-9a92-410e-ad2b-cb6d9a648da6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-rmbdd" (UID: "026870b5-9a92-410e-ad2b-cb6d9a648da6") : secret "cluster-monitoring-operator-tls" not found
Sep 11 12:56:21.756592 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:21.756551    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e83a739-e6de-46d8-b8d2-dc1e247cf5bb-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-knwvb\" (UID: \"4e83a739-e6de-46d8-b8d2-dc1e247cf5bb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-knwvb"
Sep 11 12:56:21.756807 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:21.756699    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 12:56:21.756807 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:21.756778    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e83a739-e6de-46d8-b8d2-dc1e247cf5bb-samples-operator-tls podName:4e83a739-e6de-46d8-b8d2-dc1e247cf5bb nodeName:}" failed. No retries permitted until 2026-09-11 12:56:29.756761804 +0000 UTC m=+56.618235970 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4e83a739-e6de-46d8-b8d2-dc1e247cf5bb-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-knwvb" (UID: "4e83a739-e6de-46d8-b8d2-dc1e247cf5bb") : secret "samples-operator-tls" not found
Sep 11 12:56:21.857413 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:21.857363    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69fdee23-6a53-4095-a856-3e34a64835c3-metrics-certs\") pod \"router-default-7457bf46d8-8fk2h\" (UID: \"69fdee23-6a53-4095-a856-3e34a64835c3\") " pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:21.857588 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:21.857477    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-registry-tls\") pod \"image-registry-b6756f9f8-gn9bv\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") " pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:21.857588 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:21.857520    2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 12:56:21.857732 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:21.857594    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69fdee23-6a53-4095-a856-3e34a64835c3-metrics-certs podName:69fdee23-6a53-4095-a856-3e34a64835c3 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:29.857573799 +0000 UTC m=+56.719047971 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69fdee23-6a53-4095-a856-3e34a64835c3-metrics-certs") pod "router-default-7457bf46d8-8fk2h" (UID: "69fdee23-6a53-4095-a856-3e34a64835c3") : secret "router-metrics-certs-default" not found
Sep 11 12:56:21.857732 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:21.857522    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69fdee23-6a53-4095-a856-3e34a64835c3-service-ca-bundle\") pod \"router-default-7457bf46d8-8fk2h\" (UID: \"69fdee23-6a53-4095-a856-3e34a64835c3\") " pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:21.857732 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:21.857634    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69fdee23-6a53-4095-a856-3e34a64835c3-service-ca-bundle podName:69fdee23-6a53-4095-a856-3e34a64835c3 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:29.857603159 +0000 UTC m=+56.719077331 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/69fdee23-6a53-4095-a856-3e34a64835c3-service-ca-bundle") pod "router-default-7457bf46d8-8fk2h" (UID: "69fdee23-6a53-4095-a856-3e34a64835c3") : configmap references non-existent config key: service-ca.crt
Sep 11 12:56:21.857732 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:21.857674    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:56:21.857732 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:21.857688    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b6756f9f8-gn9bv: secret "image-registry-tls" not found
Sep 11 12:56:21.858005 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:21.857754    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-registry-tls podName:a59c6516-8024-4800-9e3e-df32fc1c6967 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:29.857738891 +0000 UTC m=+56.719213064 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-registry-tls") pod "image-registry-b6756f9f8-gn9bv" (UID: "a59c6516-8024-4800-9e3e-df32fc1c6967") : secret "image-registry-tls" not found
Sep 11 12:56:21.902667 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:21.902630    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-kzws9" event={"ID":"71bcc6fe-50d4-4d8f-bc8a-8c0073ac3b54","Type":"ContainerStarted","Data":"a64a8bc18ad582a547b99dafea4c12e2a3e711b3dc63881610723bac8a3aa89e"}
Sep 11 12:56:21.905117 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:21.905038    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-m29lj" event={"ID":"4bdb12c4-f42d-4cc2-aa3f-26e5294459f6","Type":"ContainerStarted","Data":"eadedb1f881cbc1b044930ac1ec30f868076f13ba6297d75b8bb45ca0d800de0"}
Sep 11 12:56:21.906771 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:21.906741    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-8wp9p" event={"ID":"474cf6ae-d7e2-42bc-8ddf-7bb52099816e","Type":"ContainerStarted","Data":"9165aa75050cf049de29fb0b1b074aaeb743f72dc3ba2ff092c3ecd8bea8f2f3"}
Sep 11 12:56:21.908847 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:21.908821    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-6h8mp" event={"ID":"1585ba00-5e8f-42ec-bcd3-a18167f281ea","Type":"ContainerStarted","Data":"dcc360e18353a76629c34a18b3679c4f1aa858bfc492fe77a9c83d070edf60bb"}
Sep 11 12:56:21.910589 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:21.910572    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-b7gsm_b22738d7-e796-4173-8fb4-80f9208b99dd/console-operator/0.log"
Sep 11 12:56:21.910697 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:21.910604    2547 generic.go:356] "Generic (PLEG): container finished" podID="b22738d7-e796-4173-8fb4-80f9208b99dd" containerID="f334a76fefad5d38d5f43cb2eec0bb7c7bebb502e95b4308bd274d4fbb60de2d" exitCode=255
Sep 11 12:56:21.910697 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:21.910678    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-b7gsm" event={"ID":"b22738d7-e796-4173-8fb4-80f9208b99dd","Type":"ContainerDied","Data":"f334a76fefad5d38d5f43cb2eec0bb7c7bebb502e95b4308bd274d4fbb60de2d"}
Sep 11 12:56:21.910890 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:21.910866    2547 scope.go:117] "RemoveContainer" containerID="f334a76fefad5d38d5f43cb2eec0bb7c7bebb502e95b4308bd274d4fbb60de2d"
Sep 11 12:56:21.912569 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:21.912549    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-nml2c" event={"ID":"f56aabf6-4343-4870-9aaf-1bf4745b686e","Type":"ContainerStarted","Data":"15f74967fa25d0215fd1532a42ff9148e8a4607eb5766d07d2c1d52300c98425"}
Sep 11 12:56:21.920373 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:21.920320    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-kzws9" podStartSLOduration=1.697693082 podStartE2EDuration="7.920302027s" totalImagesPullingTime="6.222608945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:56:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:21.918999027 +0000 UTC m=+48.780473217" watchObservedRunningTime="2026-09-11 12:56:21.920302027 +0000 UTC m=+48.781776217"
Sep 11 12:56:21.939413 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:21.939354    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-6h8mp" podStartSLOduration=2.476748066 podStartE2EDuration="8.939333859s" totalImagesPullingTime="6.462585793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:56:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:21.93866039 +0000 UTC m=+48.800134578" watchObservedRunningTime="2026-09-11 12:56:21.939333859 +0000 UTC m=+48.800808043"
Sep 11 12:56:21.954840 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:21.954783    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-8wp9p" podStartSLOduration=2.5319238090000002 podStartE2EDuration="8.954763508s" totalImagesPullingTime="6.422839699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:56:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:21.95404928 +0000 UTC m=+48.815523473" watchObservedRunningTime="2026-09-11 12:56:21.954763508 +0000 UTC m=+48.816237694"
Sep 11 12:56:21.973190 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:21.973123    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-m29lj" podStartSLOduration=2.6082165870000003 podStartE2EDuration="8.973099533s" totalImagesPullingTime="6.364882946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:56:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:21.971984125 +0000 UTC m=+48.833458325" watchObservedRunningTime="2026-09-11 12:56:21.973099533 +0000 UTC m=+48.834573724"
Sep 11 12:56:22.009622 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:22.009566    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-nml2c" podStartSLOduration=1.707750734 podStartE2EDuration="8.009542065s" totalImagesPullingTime="6.301791331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:56:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:22.008206522 +0000 UTC m=+48.869680711" watchObservedRunningTime="2026-09-11 12:56:22.009542065 +0000 UTC m=+48.871016253"
Sep 11 12:56:22.025758 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:22.025307    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:22.120787 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:22.120742    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:22.320710 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:22.320673    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:22.399923 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:22.399883    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:22.500908 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:22.500858    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:22.819077 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:22.819033    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:22.902597 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:22.902551    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-v9qrk"]
Sep 11 12:56:22.910940 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:22.910911    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v9qrk"
Sep 11 12:56:22.913387 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:22.913351    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 12:56:22.913387 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:22.913362    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-22vc9\""
Sep 11 12:56:22.913387 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:22.913352    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 12:56:22.917872 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:22.917851    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v9qrk"]
Sep 11 12:56:22.918001 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:22.917886    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-b7gsm_b22738d7-e796-4173-8fb4-80f9208b99dd/console-operator/1.log"
Sep 11 12:56:22.918504 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:22.918379    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-b7gsm_b22738d7-e796-4173-8fb4-80f9208b99dd/console-operator/0.log"
Sep 11 12:56:22.918504 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:22.918431    2547 generic.go:356] "Generic (PLEG): container finished" podID="b22738d7-e796-4173-8fb4-80f9208b99dd" containerID="ad22439eb8386b17cf1f01da637c85e5ca800b50da3e72ac1cff4f24fecb2792" exitCode=255
Sep 11 12:56:22.918625 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:22.918557    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-b7gsm" event={"ID":"b22738d7-e796-4173-8fb4-80f9208b99dd","Type":"ContainerDied","Data":"ad22439eb8386b17cf1f01da637c85e5ca800b50da3e72ac1cff4f24fecb2792"}
Sep 11 12:56:22.918625 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:22.918608    2547 scope.go:117] "RemoveContainer" containerID="f334a76fefad5d38d5f43cb2eec0bb7c7bebb502e95b4308bd274d4fbb60de2d"
Sep 11 12:56:22.919190 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:22.919172    2547 scope.go:117] "RemoveContainer" containerID="ad22439eb8386b17cf1f01da637c85e5ca800b50da3e72ac1cff4f24fecb2792"
Sep 11 12:56:22.919370 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:22.919336    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-b7gsm_openshift-console-operator(b22738d7-e796-4173-8fb4-80f9208b99dd)\"" pod="openshift-console-operator/console-operator-696884fb9c-b7gsm" podUID="b22738d7-e796-4173-8fb4-80f9208b99dd"
Sep 11 12:56:22.925414 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:22.925391    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:23.067793 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:23.067752    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/da903b32-17b4-42ff-849c-deb3e59ce02b-data-volume\") pod \"insights-runtime-extractor-v9qrk\" (UID: \"da903b32-17b4-42ff-849c-deb3e59ce02b\") " pod="openshift-insights/insights-runtime-extractor-v9qrk"
Sep 11 12:56:23.068006 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:23.067819    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/da903b32-17b4-42ff-849c-deb3e59ce02b-crio-socket\") pod \"insights-runtime-extractor-v9qrk\" (UID: \"da903b32-17b4-42ff-849c-deb3e59ce02b\") " pod="openshift-insights/insights-runtime-extractor-v9qrk"
Sep 11 12:56:23.068258 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:23.068234    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da903b32-17b4-42ff-849c-deb3e59ce02b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v9qrk\" (UID: \"da903b32-17b4-42ff-849c-deb3e59ce02b\") " pod="openshift-insights/insights-runtime-extractor-v9qrk"
Sep 11 12:56:23.068365 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:23.068303    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq72p\" (UniqueName: \"kubernetes.io/projected/da903b32-17b4-42ff-849c-deb3e59ce02b-kube-api-access-dq72p\") pod \"insights-runtime-extractor-v9qrk\" (UID: \"da903b32-17b4-42ff-849c-deb3e59ce02b\") " pod="openshift-insights/insights-runtime-extractor-v9qrk"
Sep 11 12:56:23.068568 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:23.068536    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da903b32-17b4-42ff-849c-deb3e59ce02b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v9qrk\" (UID: \"da903b32-17b4-42ff-849c-deb3e59ce02b\") " pod="openshift-insights/insights-runtime-extractor-v9qrk"
Sep 11 12:56:23.169455 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:23.169374    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/da903b32-17b4-42ff-849c-deb3e59ce02b-crio-socket\") pod \"insights-runtime-extractor-v9qrk\" (UID: \"da903b32-17b4-42ff-849c-deb3e59ce02b\") " pod="openshift-insights/insights-runtime-extractor-v9qrk"
Sep 11 12:56:23.169590 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:23.169487    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da903b32-17b4-42ff-849c-deb3e59ce02b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v9qrk\" (UID: \"da903b32-17b4-42ff-849c-deb3e59ce02b\") " pod="openshift-insights/insights-runtime-extractor-v9qrk"
Sep 11 12:56:23.169590 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:23.169511    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/da903b32-17b4-42ff-849c-deb3e59ce02b-crio-socket\") pod \"insights-runtime-extractor-v9qrk\" (UID: \"da903b32-17b4-42ff-849c-deb3e59ce02b\") " pod="openshift-insights/insights-runtime-extractor-v9qrk"
Sep 11 12:56:23.169590 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:23.169520    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq72p\" (UniqueName: \"kubernetes.io/projected/da903b32-17b4-42ff-849c-deb3e59ce02b-kube-api-access-dq72p\") pod \"insights-runtime-extractor-v9qrk\" (UID: \"da903b32-17b4-42ff-849c-deb3e59ce02b\") " pod="openshift-insights/insights-runtime-extractor-v9qrk"
Sep 11 12:56:23.169590 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:23.169565    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da903b32-17b4-42ff-849c-deb3e59ce02b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v9qrk\" (UID: \"da903b32-17b4-42ff-849c-deb3e59ce02b\") " pod="openshift-insights/insights-runtime-extractor-v9qrk"
Sep 11 12:56:23.169778 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:23.169622    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:56:23.169778 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:23.169673    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da903b32-17b4-42ff-849c-deb3e59ce02b-insights-runtime-extractor-tls podName:da903b32-17b4-42ff-849c-deb3e59ce02b nodeName:}" failed. No retries permitted until 2026-09-11 12:56:23.669658408 +0000 UTC m=+50.531132573 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da903b32-17b4-42ff-849c-deb3e59ce02b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v9qrk" (UID: "da903b32-17b4-42ff-849c-deb3e59ce02b") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:56:23.169903 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:23.169774    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 12:56:23.169903 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:23.169842    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/da903b32-17b4-42ff-849c-deb3e59ce02b-kube-rbac-proxy-cm podName:da903b32-17b4-42ff-849c-deb3e59ce02b nodeName:}" failed. No retries permitted until 2026-09-11 12:56:23.669821712 +0000 UTC m=+50.531295895 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/da903b32-17b4-42ff-849c-deb3e59ce02b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v9qrk" (UID: "da903b32-17b4-42ff-849c-deb3e59ce02b") : configmap "kube-rbac-proxy" not found
Sep 11 12:56:23.169903 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:23.169866    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/da903b32-17b4-42ff-849c-deb3e59ce02b-data-volume\") pod \"insights-runtime-extractor-v9qrk\" (UID: \"da903b32-17b4-42ff-849c-deb3e59ce02b\") " pod="openshift-insights/insights-runtime-extractor-v9qrk"
Sep 11 12:56:23.170196 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:23.170176    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/da903b32-17b4-42ff-849c-deb3e59ce02b-data-volume\") pod \"insights-runtime-extractor-v9qrk\" (UID: \"da903b32-17b4-42ff-849c-deb3e59ce02b\") " pod="openshift-insights/insights-runtime-extractor-v9qrk"
Sep 11 12:56:23.180111 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:23.180085    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq72p\" (UniqueName: \"kubernetes.io/projected/da903b32-17b4-42ff-849c-deb3e59ce02b-kube-api-access-dq72p\") pod \"insights-runtime-extractor-v9qrk\" (UID: \"da903b32-17b4-42ff-849c-deb3e59ce02b\") " pod="openshift-insights/insights-runtime-extractor-v9qrk"
Sep 11 12:56:23.215550 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:23.215511    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:23.315725 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:23.315674    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:23.371508 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:23.371475    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0be127eb-c133-4cbd-b442-9c8d0ae735aa-metrics-tls\") pod \"dns-default-75kfq\" (UID: \"0be127eb-c133-4cbd-b442-9c8d0ae735aa\") " pod="openshift-dns/dns-default-75kfq"
Sep 11 12:56:23.371688 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:23.371645    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:56:23.371788 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:23.371749    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0be127eb-c133-4cbd-b442-9c8d0ae735aa-metrics-tls podName:0be127eb-c133-4cbd-b442-9c8d0ae735aa nodeName:}" failed. No retries permitted until 2026-09-11 12:56:39.371703166 +0000 UTC m=+66.233177351 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0be127eb-c133-4cbd-b442-9c8d0ae735aa-metrics-tls") pod "dns-default-75kfq" (UID: "0be127eb-c133-4cbd-b442-9c8d0ae735aa") : secret "dns-default-metrics-tls" not found
Sep 11 12:56:23.554972 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:23.554949    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:23.653555 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:23.653521    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:23.674764 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:23.674707    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da903b32-17b4-42ff-849c-deb3e59ce02b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v9qrk\" (UID: \"da903b32-17b4-42ff-849c-deb3e59ce02b\") " pod="openshift-insights/insights-runtime-extractor-v9qrk"
Sep 11 12:56:23.674898 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:23.674797    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da903b32-17b4-42ff-849c-deb3e59ce02b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v9qrk\" (UID: \"da903b32-17b4-42ff-849c-deb3e59ce02b\") " pod="openshift-insights/insights-runtime-extractor-v9qrk"
Sep 11 12:56:23.674898 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:23.674856    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:56:23.674898 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:23.674876    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 12:56:23.675021 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:23.674918    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da903b32-17b4-42ff-849c-deb3e59ce02b-insights-runtime-extractor-tls podName:da903b32-17b4-42ff-849c-deb3e59ce02b nodeName:}" failed. No retries permitted until 2026-09-11 12:56:24.674902426 +0000 UTC m=+51.536376592 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da903b32-17b4-42ff-849c-deb3e59ce02b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v9qrk" (UID: "da903b32-17b4-42ff-849c-deb3e59ce02b") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:56:23.675021 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:23.674932    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/da903b32-17b4-42ff-849c-deb3e59ce02b-kube-rbac-proxy-cm podName:da903b32-17b4-42ff-849c-deb3e59ce02b nodeName:}" failed. No retries permitted until 2026-09-11 12:56:24.674926052 +0000 UTC m=+51.536400218 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/da903b32-17b4-42ff-849c-deb3e59ce02b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v9qrk" (UID: "da903b32-17b4-42ff-849c-deb3e59ce02b") : configmap "kube-rbac-proxy" not found
Sep 11 12:56:23.922890 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:23.922814    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-b7gsm_b22738d7-e796-4173-8fb4-80f9208b99dd/console-operator/1.log"
Sep 11 12:56:23.923293 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:23.923127    2547 scope.go:117] "RemoveContainer" containerID="ad22439eb8386b17cf1f01da637c85e5ca800b50da3e72ac1cff4f24fecb2792"
Sep 11 12:56:23.923356 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:23.923287    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-b7gsm_openshift-console-operator(b22738d7-e796-4173-8fb4-80f9208b99dd)\"" pod="openshift-console-operator/console-operator-696884fb9c-b7gsm" podUID="b22738d7-e796-4173-8fb4-80f9208b99dd"
Sep 11 12:56:24.213011 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:24.212925    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-b7gsm"
Sep 11 12:56:24.213011 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:24.213014    2547 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-b7gsm"
Sep 11 12:56:24.680822 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:24.680779    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da903b32-17b4-42ff-849c-deb3e59ce02b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v9qrk\" (UID: \"da903b32-17b4-42ff-849c-deb3e59ce02b\") " pod="openshift-insights/insights-runtime-extractor-v9qrk"
Sep 11 12:56:24.680992 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:24.680903    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 12:56:24.680992 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:24.680918    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da903b32-17b4-42ff-849c-deb3e59ce02b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v9qrk\" (UID: \"da903b32-17b4-42ff-849c-deb3e59ce02b\") " pod="openshift-insights/insights-runtime-extractor-v9qrk"
Sep 11 12:56:24.680992 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:24.680986    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/da903b32-17b4-42ff-849c-deb3e59ce02b-kube-rbac-proxy-cm podName:da903b32-17b4-42ff-849c-deb3e59ce02b nodeName:}" failed. No retries permitted until 2026-09-11 12:56:26.68096207 +0000 UTC m=+53.542436237 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/da903b32-17b4-42ff-849c-deb3e59ce02b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v9qrk" (UID: "da903b32-17b4-42ff-849c-deb3e59ce02b") : configmap "kube-rbac-proxy" not found
Sep 11 12:56:24.681149 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:24.681012    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:56:24.681149 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:24.681063    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da903b32-17b4-42ff-849c-deb3e59ce02b-insights-runtime-extractor-tls podName:da903b32-17b4-42ff-849c-deb3e59ce02b nodeName:}" failed. No retries permitted until 2026-09-11 12:56:26.681051389 +0000 UTC m=+53.542525559 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da903b32-17b4-42ff-849c-deb3e59ce02b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v9qrk" (UID: "da903b32-17b4-42ff-849c-deb3e59ce02b") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:56:24.927735 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:24.927691    2547 scope.go:117] "RemoveContainer" containerID="ad22439eb8386b17cf1f01da637c85e5ca800b50da3e72ac1cff4f24fecb2792"
Sep 11 12:56:24.928106 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:24.927872    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-b7gsm_openshift-console-operator(b22738d7-e796-4173-8fb4-80f9208b99dd)\"" pod="openshift-console-operator/console-operator-696884fb9c-b7gsm" podUID="b22738d7-e796-4173-8fb4-80f9208b99dd"
Sep 11 12:56:25.121848 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:25.121811    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:25.176358 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:25.176316    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:25.367656 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:25.367621    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:25.651130 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:25.651101    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9bb5n_68d59d28-7efe-4ac2-955b-697b740b7781/dns-node-resolver/0.log"
Sep 11 12:56:26.127329 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:26.127292    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:26.700282 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:26.700237    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da903b32-17b4-42ff-849c-deb3e59ce02b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v9qrk\" (UID: \"da903b32-17b4-42ff-849c-deb3e59ce02b\") " pod="openshift-insights/insights-runtime-extractor-v9qrk"
Sep 11 12:56:26.700483 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:26.700300    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da903b32-17b4-42ff-849c-deb3e59ce02b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v9qrk\" (UID: \"da903b32-17b4-42ff-849c-deb3e59ce02b\") " pod="openshift-insights/insights-runtime-extractor-v9qrk"
Sep 11 12:56:26.700483 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:26.700366    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 12:56:26.700483 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:26.700387    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:56:26.700483 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:26.700443    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da903b32-17b4-42ff-849c-deb3e59ce02b-insights-runtime-extractor-tls podName:da903b32-17b4-42ff-849c-deb3e59ce02b nodeName:}" failed. No retries permitted until 2026-09-11 12:56:30.700428362 +0000 UTC m=+57.561902528 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da903b32-17b4-42ff-849c-deb3e59ce02b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v9qrk" (UID: "da903b32-17b4-42ff-849c-deb3e59ce02b") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:56:26.700483 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:26.700466    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/da903b32-17b4-42ff-849c-deb3e59ce02b-kube-rbac-proxy-cm podName:da903b32-17b4-42ff-849c-deb3e59ce02b nodeName:}" failed. No retries permitted until 2026-09-11 12:56:30.700457734 +0000 UTC m=+57.561931901 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/da903b32-17b4-42ff-849c-deb3e59ce02b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v9qrk" (UID: "da903b32-17b4-42ff-849c-deb3e59ce02b") : configmap "kube-rbac-proxy" not found
Sep 11 12:56:26.860798 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:26.860770    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v26jw_21d7503a-0156-478a-b2c2-8555a08faf52/node-ca/0.log"
Sep 11 12:56:27.258599 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:27.258565    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8nv6f_1dd7158a-e1f4-4aa4-82b0-f85ad37fd213/serve-healthcheck-canary/0.log"
Sep 11 12:56:28.255788 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:28.255759    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-m29lj_4bdb12c4-f42d-4cc2-aa3f-26e5294459f6/kube-storage-version-migrator-operator/0.log"
Sep 11 12:56:29.662976 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:29.662940    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:29.726733 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:29.726683    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/026870b5-9a92-410e-ad2b-cb6d9a648da6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rmbdd\" (UID: \"026870b5-9a92-410e-ad2b-cb6d9a648da6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rmbdd"
Sep 11 12:56:29.726863 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:29.726835    2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 12:56:29.726942 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:29.726932    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/026870b5-9a92-410e-ad2b-cb6d9a648da6-cluster-monitoring-operator-tls podName:026870b5-9a92-410e-ad2b-cb6d9a648da6 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:45.726916028 +0000 UTC m=+72.588390207 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/026870b5-9a92-410e-ad2b-cb6d9a648da6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-rmbdd" (UID: "026870b5-9a92-410e-ad2b-cb6d9a648da6") : secret "cluster-monitoring-operator-tls" not found
Sep 11 12:56:29.759052 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:29.759003    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:29.827831 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:29.827798    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e83a739-e6de-46d8-b8d2-dc1e247cf5bb-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-knwvb\" (UID: \"4e83a739-e6de-46d8-b8d2-dc1e247cf5bb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-knwvb"
Sep 11 12:56:29.827990 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:29.827945    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 12:56:29.828029 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:29.828009    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e83a739-e6de-46d8-b8d2-dc1e247cf5bb-samples-operator-tls podName:4e83a739-e6de-46d8-b8d2-dc1e247cf5bb nodeName:}" failed. No retries permitted until 2026-09-11 12:56:45.827994383 +0000 UTC m=+72.689468548 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4e83a739-e6de-46d8-b8d2-dc1e247cf5bb-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-knwvb" (UID: "4e83a739-e6de-46d8-b8d2-dc1e247cf5bb") : secret "samples-operator-tls" not found
Sep 11 12:56:29.879173 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:29.879135    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:29.928491 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:29.928411    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-registry-tls\") pod \"image-registry-b6756f9f8-gn9bv\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") " pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:29.928491 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:29.928460    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69fdee23-6a53-4095-a856-3e34a64835c3-service-ca-bundle\") pod \"router-default-7457bf46d8-8fk2h\" (UID: \"69fdee23-6a53-4095-a856-3e34a64835c3\") " pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:29.928672 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:29.928524    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69fdee23-6a53-4095-a856-3e34a64835c3-metrics-certs\") pod \"router-default-7457bf46d8-8fk2h\" (UID: \"69fdee23-6a53-4095-a856-3e34a64835c3\") " pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:29.928672 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:29.928567    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:56:29.928672 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:29.928586    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b6756f9f8-gn9bv: secret "image-registry-tls" not found
Sep 11 12:56:29.928672 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:29.928616    2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 12:56:29.928672 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:29.928651    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-registry-tls podName:a59c6516-8024-4800-9e3e-df32fc1c6967 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:45.92863508 +0000 UTC m=+72.790109246 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-registry-tls") pod "image-registry-b6756f9f8-gn9bv" (UID: "a59c6516-8024-4800-9e3e-df32fc1c6967") : secret "image-registry-tls" not found
Sep 11 12:56:29.928672 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:29.928665    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69fdee23-6a53-4095-a856-3e34a64835c3-service-ca-bundle podName:69fdee23-6a53-4095-a856-3e34a64835c3 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:45.928659474 +0000 UTC m=+72.790133640 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/69fdee23-6a53-4095-a856-3e34a64835c3-service-ca-bundle") pod "router-default-7457bf46d8-8fk2h" (UID: "69fdee23-6a53-4095-a856-3e34a64835c3") : configmap references non-existent config key: service-ca.crt
Sep 11 12:56:29.928672 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:29.928676    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69fdee23-6a53-4095-a856-3e34a64835c3-metrics-certs podName:69fdee23-6a53-4095-a856-3e34a64835c3 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:45.928671501 +0000 UTC m=+72.790145666 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69fdee23-6a53-4095-a856-3e34a64835c3-metrics-certs") pod "router-default-7457bf46d8-8fk2h" (UID: "69fdee23-6a53-4095-a856-3e34a64835c3") : secret "router-metrics-certs-default" not found
Sep 11 12:56:30.025960 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:30.025915    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:30.194710 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:30.194637    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:30.294763 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:30.294702    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:30.396463 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:30.396413    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:30.494736 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:30.494639    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:30.667122 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:30.667083    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:30.735588 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:30.735547    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da903b32-17b4-42ff-849c-deb3e59ce02b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v9qrk\" (UID: \"da903b32-17b4-42ff-849c-deb3e59ce02b\") " pod="openshift-insights/insights-runtime-extractor-v9qrk"
Sep 11 12:56:30.735798 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:30.735663    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 12:56:30.735798 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:30.735689    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da903b32-17b4-42ff-849c-deb3e59ce02b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v9qrk\" (UID: \"da903b32-17b4-42ff-849c-deb3e59ce02b\") " pod="openshift-insights/insights-runtime-extractor-v9qrk"
Sep 11 12:56:30.735798 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:30.735750    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/da903b32-17b4-42ff-849c-deb3e59ce02b-kube-rbac-proxy-cm podName:da903b32-17b4-42ff-849c-deb3e59ce02b nodeName:}" failed. No retries permitted until 2026-09-11 12:56:38.735707232 +0000 UTC m=+65.597181397 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/da903b32-17b4-42ff-849c-deb3e59ce02b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v9qrk" (UID: "da903b32-17b4-42ff-849c-deb3e59ce02b") : configmap "kube-rbac-proxy" not found
Sep 11 12:56:30.735936 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:30.735807    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:56:30.735936 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:30.735870    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da903b32-17b4-42ff-849c-deb3e59ce02b-insights-runtime-extractor-tls podName:da903b32-17b4-42ff-849c-deb3e59ce02b nodeName:}" failed. No retries permitted until 2026-09-11 12:56:38.735857881 +0000 UTC m=+65.597332051 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da903b32-17b4-42ff-849c-deb3e59ce02b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v9qrk" (UID: "da903b32-17b4-42ff-849c-deb3e59ce02b") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:56:31.661070 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:31.661022    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:31.866166 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:31.866133    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:32.275072 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:32.275036    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:32.481730 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:32.481695    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:32.830499 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:32.830465    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bx8zk"
Sep 11 12:56:32.871177 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:32.871144    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:33.264188 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:33.264098    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:33.459799 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:33.459761    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:33.778770 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:33.778697    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:33.879558 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:33.879523    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:34.467443 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:34.467405    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:34.708645 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:34.708612    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:34.809600 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:34.809573    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:34.909279 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:34.909241    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:35.264499 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:35.264406    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:35.882819 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:35.882778    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:36.261507 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:36.261434    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:36.658280 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:36.658242    2547 scope.go:117] "RemoveContainer" containerID="ad22439eb8386b17cf1f01da637c85e5ca800b50da3e72ac1cff4f24fecb2792"
Sep 11 12:56:36.666354 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:36.666331    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:36.966450 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:36.966376    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-b7gsm_b22738d7-e796-4173-8fb4-80f9208b99dd/console-operator/2.log"
Sep 11 12:56:36.966813 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:36.966794    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-b7gsm_b22738d7-e796-4173-8fb4-80f9208b99dd/console-operator/1.log"
Sep 11 12:56:36.966929 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:36.966832    2547 generic.go:356] "Generic (PLEG): container finished" podID="b22738d7-e796-4173-8fb4-80f9208b99dd" containerID="4ec97d5073f8b0094141dc6958f5358c0743a944986743e39f084850113a881e" exitCode=255
Sep 11 12:56:36.966929 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:36.966876    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-b7gsm" event={"ID":"b22738d7-e796-4173-8fb4-80f9208b99dd","Type":"ContainerDied","Data":"4ec97d5073f8b0094141dc6958f5358c0743a944986743e39f084850113a881e"}
Sep 11 12:56:36.967042 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:36.966935    2547 scope.go:117] "RemoveContainer" containerID="ad22439eb8386b17cf1f01da637c85e5ca800b50da3e72ac1cff4f24fecb2792"
Sep 11 12:56:36.967243 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:36.967226    2547 scope.go:117] "RemoveContainer" containerID="4ec97d5073f8b0094141dc6958f5358c0743a944986743e39f084850113a881e"
Sep 11 12:56:36.967443 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:36.967422    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-b7gsm_openshift-console-operator(b22738d7-e796-4173-8fb4-80f9208b99dd)\"" pod="openshift-console-operator/console-operator-696884fb9c-b7gsm" podUID="b22738d7-e796-4173-8fb4-80f9208b99dd"
Sep 11 12:56:36.980931 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:36.980908    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:37.082192 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:37.082159    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:37.186920 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:37.186886    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:37.283898 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:37.283817    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:37.721141 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:37.721105    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:37.970827 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:37.970802    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-b7gsm_b22738d7-e796-4173-8fb4-80f9208b99dd/console-operator/2.log"
Sep 11 12:56:38.176766 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:38.176710    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:38.422891 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:38.422862    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:38.730545 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:38.730512    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:38.809769 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:38.809708    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da903b32-17b4-42ff-849c-deb3e59ce02b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v9qrk\" (UID: \"da903b32-17b4-42ff-849c-deb3e59ce02b\") " pod="openshift-insights/insights-runtime-extractor-v9qrk"
Sep 11 12:56:38.809948 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:38.809864    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da903b32-17b4-42ff-849c-deb3e59ce02b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v9qrk\" (UID: \"da903b32-17b4-42ff-849c-deb3e59ce02b\") " pod="openshift-insights/insights-runtime-extractor-v9qrk"
Sep 11 12:56:38.810003 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:38.809955    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:56:38.810042 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:38.810008    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da903b32-17b4-42ff-849c-deb3e59ce02b-insights-runtime-extractor-tls podName:da903b32-17b4-42ff-849c-deb3e59ce02b nodeName:}" failed. No retries permitted until 2026-09-11 12:56:54.809993845 +0000 UTC m=+81.671468024 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da903b32-17b4-42ff-849c-deb3e59ce02b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v9qrk" (UID: "da903b32-17b4-42ff-849c-deb3e59ce02b") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:56:38.810282 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:38.810262    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da903b32-17b4-42ff-849c-deb3e59ce02b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v9qrk\" (UID: \"da903b32-17b4-42ff-849c-deb3e59ce02b\") " pod="openshift-insights/insights-runtime-extractor-v9qrk"
Sep 11 12:56:39.179892 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:39.179861    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:39.326224 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:39.326191    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:39.414655 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:39.414614    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a0213c0-ea91-46ef-963b-eebfca575f1d-original-pull-secret\") pod \"global-pull-secret-syncer-hw4b9\" (UID: \"4a0213c0-ea91-46ef-963b-eebfca575f1d\") " pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:56:39.414655 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:39.414660    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0be127eb-c133-4cbd-b442-9c8d0ae735aa-metrics-tls\") pod \"dns-default-75kfq\" (UID: \"0be127eb-c133-4cbd-b442-9c8d0ae735aa\") " pod="openshift-dns/dns-default-75kfq"
Sep 11 12:56:39.414928 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:39.414800    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b821e09-a20a-457c-b22d-815df2b09e54-metrics-certs\") pod \"network-metrics-daemon-5jxc9\" (UID: \"4b821e09-a20a-457c-b22d-815df2b09e54\") " pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:56:39.417245 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:39.417224    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0be127eb-c133-4cbd-b442-9c8d0ae735aa-metrics-tls\") pod \"dns-default-75kfq\" (UID: \"0be127eb-c133-4cbd-b442-9c8d0ae735aa\") " pod="openshift-dns/dns-default-75kfq"
Sep 11 12:56:39.420303 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:39.420288    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 12:56:39.422067 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:39.422050    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 12:56:39.427028 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:39.427009    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a0213c0-ea91-46ef-963b-eebfca575f1d-original-pull-secret\") pod \"global-pull-secret-syncer-hw4b9\" (UID: \"4a0213c0-ea91-46ef-963b-eebfca575f1d\") " pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:56:39.427297 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:39.427115    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b821e09-a20a-457c-b22d-815df2b09e54-metrics-certs\") pod \"network-metrics-daemon-5jxc9\" (UID: \"4b821e09-a20a-457c-b22d-815df2b09e54\") " pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:56:39.516058 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:39.515980    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2mbl\" (UniqueName: \"kubernetes.io/projected/bc61a33f-faa2-4646-8197-40627ef9da72-kube-api-access-w2mbl\") pod \"network-check-target-4bvlc\" (UID: \"bc61a33f-faa2-4646-8197-40627ef9da72\") " pod="openshift-network-diagnostics/network-check-target-4bvlc"
Sep 11 12:56:39.518609 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:39.518582    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2mbl\" (UniqueName: \"kubernetes.io/projected/bc61a33f-faa2-4646-8197-40627ef9da72-kube-api-access-w2mbl\") pod \"network-check-target-4bvlc\" (UID: \"bc61a33f-faa2-4646-8197-40627ef9da72\") " pod="openshift-network-diagnostics/network-check-target-4bvlc"
Sep 11 12:56:39.573199 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:39.573171    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w7fbx\""
Sep 11 12:56:39.578131 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:39.578115    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4b9"
Sep 11 12:56:39.580621 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:39.580607    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jxc9"
Sep 11 12:56:39.605383 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:39.605358    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l85nk\""
Sep 11 12:56:39.612432 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:39.612413    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-75kfq"
Sep 11 12:56:39.690289 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:39.690257    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:39.770380 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:39.770299    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7r4pp\""
Sep 11 12:56:39.777761 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:39.777741    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvlc"
Sep 11 12:56:39.891987 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:39.891958    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hw4b9"]
Sep 11 12:56:39.894495 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:39.894457    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5jxc9"]
Sep 11 12:56:39.896337 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:56:39.896314    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a0213c0_ea91_46ef_963b_eebfca575f1d.slice/crio-546fa0cfd432104f161f3bbcf2af160e9dd8faeabd4d1babc673b2ac81a7fcf2 WatchSource:0}: Error finding container 546fa0cfd432104f161f3bbcf2af160e9dd8faeabd4d1babc673b2ac81a7fcf2: Status 404 returned error can't find the container with id 546fa0cfd432104f161f3bbcf2af160e9dd8faeabd4d1babc673b2ac81a7fcf2
Sep 11 12:56:39.897257 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:56:39.897234    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b821e09_a20a_457c_b22d_815df2b09e54.slice/crio-fa36156bd97351ee3ecba13a092cfb82c45c8f4f11fd093867ea468222e100b3 WatchSource:0}: Error finding container fa36156bd97351ee3ecba13a092cfb82c45c8f4f11fd093867ea468222e100b3: Status 404 returned error can't find the container with id fa36156bd97351ee3ecba13a092cfb82c45c8f4f11fd093867ea468222e100b3
Sep 11 12:56:39.908294 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:39.908263    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-75kfq"]
Sep 11 12:56:39.912330 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:56:39.912308    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0be127eb_c133_4cbd_b442_9c8d0ae735aa.slice/crio-7131c8ce1f5a7c86423fdbe4ad1f7e6aeb798f874cd37199f1bb708ebcc94dee WatchSource:0}: Error finding container 7131c8ce1f5a7c86423fdbe4ad1f7e6aeb798f874cd37199f1bb708ebcc94dee: Status 404 returned error can't find the container with id 7131c8ce1f5a7c86423fdbe4ad1f7e6aeb798f874cd37199f1bb708ebcc94dee
Sep 11 12:56:39.978154 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:39.978117    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-75kfq" event={"ID":"0be127eb-c133-4cbd-b442-9c8d0ae735aa","Type":"ContainerStarted","Data":"7131c8ce1f5a7c86423fdbe4ad1f7e6aeb798f874cd37199f1bb708ebcc94dee"}
Sep 11 12:56:39.979307 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:39.979281    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5jxc9" event={"ID":"4b821e09-a20a-457c-b22d-815df2b09e54","Type":"ContainerStarted","Data":"fa36156bd97351ee3ecba13a092cfb82c45c8f4f11fd093867ea468222e100b3"}
Sep 11 12:56:39.980388 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:39.980369    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hw4b9" event={"ID":"4a0213c0-ea91-46ef-963b-eebfca575f1d","Type":"ContainerStarted","Data":"546fa0cfd432104f161f3bbcf2af160e9dd8faeabd4d1babc673b2ac81a7fcf2"}
Sep 11 12:56:40.061970 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:40.061938    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4bvlc"]
Sep 11 12:56:40.067241 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:56:40.067213    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc61a33f_faa2_4646_8197_40627ef9da72.slice/crio-097e3e2e963a89a1e21baa36c61355518b7efa4cf75d49781b55deb04fd8f4b7 WatchSource:0}: Error finding container 097e3e2e963a89a1e21baa36c61355518b7efa4cf75d49781b55deb04fd8f4b7: Status 404 returned error can't find the container with id 097e3e2e963a89a1e21baa36c61355518b7efa4cf75d49781b55deb04fd8f4b7
Sep 11 12:56:40.092365 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:40.092051    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:40.307696 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:40.307661    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:40.986942 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:40.986905    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4bvlc" event={"ID":"bc61a33f-faa2-4646-8197-40627ef9da72","Type":"ContainerStarted","Data":"ebb5c29005cedc9adf95d908cdae6f017d590de7f798fd7eb5d9b213ba4a62c5"}
Sep 11 12:56:40.987417 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:40.986962    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4bvlc" event={"ID":"bc61a33f-faa2-4646-8197-40627ef9da72","Type":"ContainerStarted","Data":"097e3e2e963a89a1e21baa36c61355518b7efa4cf75d49781b55deb04fd8f4b7"}
Sep 11 12:56:40.987417 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:40.987121    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4bvlc"
Sep 11 12:56:41.005993 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:41.005934    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4bvlc" podStartSLOduration=68.005911099 podStartE2EDuration="1m8.005911099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:55:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:41.005740654 +0000 UTC m=+67.867214833" watchObservedRunningTime="2026-09-11 12:56:41.005911099 +0000 UTC m=+67.867385288"
Sep 11 12:56:41.998071 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:41.996808    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-75kfq" event={"ID":"0be127eb-c133-4cbd-b442-9c8d0ae735aa","Type":"ContainerStarted","Data":"ef7dcb1a2faddf76df40572a883fbab8870d9e707e4f5dc4e22e2fa2d0fe6658"}
Sep 11 12:56:42.003022 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:42.002949    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5jxc9" event={"ID":"4b821e09-a20a-457c-b22d-815df2b09e54","Type":"ContainerStarted","Data":"202f1e3604cc0800e3be8e56d5d5fcb01002b30acb01da84adb2d777a970db74"}
Sep 11 12:56:43.009779 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:43.009740    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-75kfq" event={"ID":"0be127eb-c133-4cbd-b442-9c8d0ae735aa","Type":"ContainerStarted","Data":"e1b1f0726b40fc10ec827c30897512b34719a8d5ad2b0eb98d8cf251d84599b2"}
Sep 11 12:56:43.010400 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:43.009845    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-75kfq"
Sep 11 12:56:43.011893 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:43.011865    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5jxc9" event={"ID":"4b821e09-a20a-457c-b22d-815df2b09e54","Type":"ContainerStarted","Data":"1bbdd9771e2646f63bf7c4341fb4833a0ee54f5f37c270992a20b6d21a3937a3"}
Sep 11 12:56:43.033685 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:43.033628    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-75kfq" podStartSLOduration=34.076031298 podStartE2EDuration="36.03361213s" totalImagesPullingTime="1.957580832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:56:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:43.032203094 +0000 UTC m=+69.893677267" watchObservedRunningTime="2026-09-11 12:56:43.03361213 +0000 UTC m=+69.895086318"
Sep 11 12:56:44.020298 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:44.020249    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hw4b9" event={"ID":"4a0213c0-ea91-46ef-963b-eebfca575f1d","Type":"ContainerStarted","Data":"a89de329916a213606e2526ff0a2fa1ed939555e04ffc1117724dd4a541aaa5f"}
Sep 11 12:56:44.039393 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:44.039293    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5jxc9" podStartSLOduration=69.101752378 podStartE2EDuration="1m11.039275111s" totalImagesPullingTime="1.937522733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:55:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:43.057596992 +0000 UTC m=+69.919071182" watchObservedRunningTime="2026-09-11 12:56:44.039275111 +0000 UTC m=+70.900749300"
Sep 11 12:56:44.039577 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:44.039558    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hw4b9" podStartSLOduration=67.147949473 podStartE2EDuration="1m11.039551706s" totalImagesPullingTime="3.891602233s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:55:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:44.03804997 +0000 UTC m=+70.899524170" watchObservedRunningTime="2026-09-11 12:56:44.039551706 +0000 UTC m=+70.901025894"
Sep 11 12:56:44.212908 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:44.212863    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-b7gsm"
Sep 11 12:56:44.213099 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:44.212939    2547 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-b7gsm"
Sep 11 12:56:44.213264 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:44.213249    2547 scope.go:117] "RemoveContainer" containerID="4ec97d5073f8b0094141dc6958f5358c0743a944986743e39f084850113a881e"
Sep 11 12:56:44.213443 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:56:44.213421    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-b7gsm_openshift-console-operator(b22738d7-e796-4173-8fb4-80f9208b99dd)\"" pod="openshift-console-operator/console-operator-696884fb9c-b7gsm" podUID="b22738d7-e796-4173-8fb4-80f9208b99dd"
Sep 11 12:56:45.779322 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:45.779262    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/026870b5-9a92-410e-ad2b-cb6d9a648da6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rmbdd\" (UID: \"026870b5-9a92-410e-ad2b-cb6d9a648da6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rmbdd"
Sep 11 12:56:45.781995 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:45.781971    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/026870b5-9a92-410e-ad2b-cb6d9a648da6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rmbdd\" (UID: \"026870b5-9a92-410e-ad2b-cb6d9a648da6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rmbdd"
Sep 11 12:56:45.880744 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:45.880684    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e83a739-e6de-46d8-b8d2-dc1e247cf5bb-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-knwvb\" (UID: \"4e83a739-e6de-46d8-b8d2-dc1e247cf5bb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-knwvb"
Sep 11 12:56:45.883229 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:45.883201    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e83a739-e6de-46d8-b8d2-dc1e247cf5bb-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-knwvb\" (UID: \"4e83a739-e6de-46d8-b8d2-dc1e247cf5bb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-knwvb"
Sep 11 12:56:45.981512 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:45.981461    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69fdee23-6a53-4095-a856-3e34a64835c3-metrics-certs\") pod \"router-default-7457bf46d8-8fk2h\" (UID: \"69fdee23-6a53-4095-a856-3e34a64835c3\") " pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:45.981696 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:45.981557    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-registry-tls\") pod \"image-registry-b6756f9f8-gn9bv\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") " pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:45.981696 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:45.981599    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69fdee23-6a53-4095-a856-3e34a64835c3-service-ca-bundle\") pod \"router-default-7457bf46d8-8fk2h\" (UID: \"69fdee23-6a53-4095-a856-3e34a64835c3\") " pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:45.982226 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:45.982203    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69fdee23-6a53-4095-a856-3e34a64835c3-service-ca-bundle\") pod \"router-default-7457bf46d8-8fk2h\" (UID: \"69fdee23-6a53-4095-a856-3e34a64835c3\") " pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:45.984120 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:45.984100    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-registry-tls\") pod \"image-registry-b6756f9f8-gn9bv\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") " pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:45.984170 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:45.984134    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69fdee23-6a53-4095-a856-3e34a64835c3-metrics-certs\") pod \"router-default-7457bf46d8-8fk2h\" (UID: \"69fdee23-6a53-4095-a856-3e34a64835c3\") " pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:45.997638 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:45.997614    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-467ng\""
Sep 11 12:56:46.005902 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:46.005884    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rmbdd"
Sep 11 12:56:46.117915 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:46.117881    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wpfvt\""
Sep 11 12:56:46.125910 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:46.125877    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-knwvb"
Sep 11 12:56:46.159602 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:46.159566    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g4h6z\""
Sep 11 12:56:46.167839 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:46.167799    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:46.174865 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:46.174833    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jjgmd\""
Sep 11 12:56:46.182520 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:46.182482    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:46.286296 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:46.286258    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-rmbdd"]
Sep 11 12:56:46.290330 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:56:46.290307    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod026870b5_9a92_410e_ad2b_cb6d9a648da6.slice/crio-70e4c0ac362c814b811dc3aec2ff4f8e183530204057b33a71965a0638033540 WatchSource:0}: Error finding container 70e4c0ac362c814b811dc3aec2ff4f8e183530204057b33a71965a0638033540: Status 404 returned error can't find the container with id 70e4c0ac362c814b811dc3aec2ff4f8e183530204057b33a71965a0638033540
Sep 11 12:56:46.406462 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:46.406429    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-knwvb"]
Sep 11 12:56:46.476288 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:46.476259    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b6756f9f8-gn9bv"]
Sep 11 12:56:46.479171 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:56:46.479147    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda59c6516_8024_4800_9e3e_df32fc1c6967.slice/crio-6163e3c67e75e5d2419a16e5447d09d6102b43b324c39b11c9cad2cc7b794730 WatchSource:0}: Error finding container 6163e3c67e75e5d2419a16e5447d09d6102b43b324c39b11c9cad2cc7b794730: Status 404 returned error can't find the container with id 6163e3c67e75e5d2419a16e5447d09d6102b43b324c39b11c9cad2cc7b794730
Sep 11 12:56:46.520521 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:46.520495    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7457bf46d8-8fk2h"]
Sep 11 12:56:46.523570 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:56:46.523547    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69fdee23_6a53_4095_a856_3e34a64835c3.slice/crio-5c4c9bc819227049e0cf9c35d59928f431c58647e1a73b9479ac5d59d2287251 WatchSource:0}: Error finding container 5c4c9bc819227049e0cf9c35d59928f431c58647e1a73b9479ac5d59d2287251: Status 404 returned error can't find the container with id 5c4c9bc819227049e0cf9c35d59928f431c58647e1a73b9479ac5d59d2287251
Sep 11 12:56:47.032367 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:47.032332    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-knwvb" event={"ID":"4e83a739-e6de-46d8-b8d2-dc1e247cf5bb","Type":"ContainerStarted","Data":"47937ecdbfe259c2bfc55ce091533114321dfe516f99be66a5f1c042963d4680"}
Sep 11 12:56:47.034638 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:47.034604    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7457bf46d8-8fk2h" event={"ID":"69fdee23-6a53-4095-a856-3e34a64835c3","Type":"ContainerStarted","Data":"45c8b1d2f2ffd97be4e47fca0d805f8fe402d582cf679b6fca617eb66717729f"}
Sep 11 12:56:47.034793 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:47.034658    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7457bf46d8-8fk2h" event={"ID":"69fdee23-6a53-4095-a856-3e34a64835c3","Type":"ContainerStarted","Data":"5c4c9bc819227049e0cf9c35d59928f431c58647e1a73b9479ac5d59d2287251"}
Sep 11 12:56:47.037555 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:47.037522    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv" event={"ID":"a59c6516-8024-4800-9e3e-df32fc1c6967","Type":"ContainerStarted","Data":"cf14cbedb9fe8852e252b35c9a8f5cb4d1c8d81250d49a0aa222a8734b4d8826"}
Sep 11 12:56:47.037660 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:47.037570    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv" event={"ID":"a59c6516-8024-4800-9e3e-df32fc1c6967","Type":"ContainerStarted","Data":"6163e3c67e75e5d2419a16e5447d09d6102b43b324c39b11c9cad2cc7b794730"}
Sep 11 12:56:47.038040 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:47.038020    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:56:47.039348 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:47.039321    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rmbdd" event={"ID":"026870b5-9a92-410e-ad2b-cb6d9a648da6","Type":"ContainerStarted","Data":"70e4c0ac362c814b811dc3aec2ff4f8e183530204057b33a71965a0638033540"}
Sep 11 12:56:47.088695 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:47.088631    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7457bf46d8-8fk2h" podStartSLOduration=34.088611944 podStartE2EDuration="34.088611944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:56:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:47.086596389 +0000 UTC m=+73.948070578" watchObservedRunningTime="2026-09-11 12:56:47.088611944 +0000 UTC m=+73.950086123"
Sep 11 12:56:47.163808 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:47.163744    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv" podStartSLOduration=34.163707582 podStartE2EDuration="34.163707582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:56:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:47.16344717 +0000 UTC m=+74.024921359" watchObservedRunningTime="2026-09-11 12:56:47.163707582 +0000 UTC m=+74.025181771"
Sep 11 12:56:47.182730 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:47.182675    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:47.185482 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:47.185453    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:47.604858 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:47.604822    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b6756f9f8-gn9bv"]
Sep 11 12:56:47.700588 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:47.700548    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:47.846014 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:47.845974    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:47.957969 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:47.957883    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:48.044867 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:48.044830    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:48.046061 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:48.046036    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7457bf46d8-8fk2h"
Sep 11 12:56:48.073826 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:48.073786    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:48.268030 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:48.267930    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:48.433644 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:48.433581    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:49.017030 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:49.016995    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:49.049488 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:49.049450    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-knwvb" event={"ID":"4e83a739-e6de-46d8-b8d2-dc1e247cf5bb","Type":"ContainerStarted","Data":"36fb2d2f5113328b2504563a37e8c4aa34660352294654ebcc370c486cc0b182"}
Sep 11 12:56:49.049987 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:49.049550    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-knwvb" event={"ID":"4e83a739-e6de-46d8-b8d2-dc1e247cf5bb","Type":"ContainerStarted","Data":"21b99f245aacff18c782d443bbd5ba2bbe28d7a60bf2c5088620d924a545d004"}
Sep 11 12:56:49.051139 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:49.051116    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rmbdd" event={"ID":"026870b5-9a92-410e-ad2b-cb6d9a648da6","Type":"ContainerStarted","Data":"b9dfbd42276f0cbb97b38897c35572b4b0d6341b2ff46f051c0d948417ada0cd"}
Sep 11 12:56:49.099495 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:49.099445    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-knwvb" podStartSLOduration=34.027643103 podStartE2EDuration="36.099430274s" totalImagesPullingTime="2.071787171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:56:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:49.097978106 +0000 UTC m=+75.959452294" watchObservedRunningTime="2026-09-11 12:56:49.099430274 +0000 UTC m=+75.960904462"
Sep 11 12:56:49.144560 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:49.144504    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rmbdd" podStartSLOduration=33.924474964 podStartE2EDuration="36.144484411s" totalImagesPullingTime="2.220009447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:56:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:49.144453156 +0000 UTC m=+76.005927345" watchObservedRunningTime="2026-09-11 12:56:49.144484411 +0000 UTC m=+76.005958602"
Sep 11 12:56:49.162791 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:49.162764    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:49.368889 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:49.368842    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:49.548978 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:49.548941    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:49.983709 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:49.983673    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:50.163875 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:50.163819    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:51.997085 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:51.997043    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:52.077106 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:52.077072    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:52.424418 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:52.424366    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:52.643793 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:52.643756    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:52.834857 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:52.834828    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:53.022764 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:53.022732    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-75kfq"
Sep 11 12:56:54.858694 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:54.858557    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da903b32-17b4-42ff-849c-deb3e59ce02b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v9qrk\" (UID: \"da903b32-17b4-42ff-849c-deb3e59ce02b\") " pod="openshift-insights/insights-runtime-extractor-v9qrk"
Sep 11 12:56:54.861130 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:54.861106    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da903b32-17b4-42ff-849c-deb3e59ce02b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v9qrk\" (UID: \"da903b32-17b4-42ff-849c-deb3e59ce02b\") " pod="openshift-insights/insights-runtime-extractor-v9qrk"
Sep 11 12:56:55.025283 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:55.025249    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-22vc9\""
Sep 11 12:56:55.033472 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:55.033451    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v9qrk"
Sep 11 12:56:55.103939 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:55.103902    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:55.347761 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:55.347645    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v9qrk"]
Sep 11 12:56:55.350332 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:56:55.350303    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda903b32_17b4_42ff_849c_deb3e59ce02b.slice/crio-772e437364514f5f7459d18b28009cd3939d3cb359f550d06730566e2f9b47ce WatchSource:0}: Error finding container 772e437364514f5f7459d18b28009cd3939d3cb359f550d06730566e2f9b47ce: Status 404 returned error can't find the container with id 772e437364514f5f7459d18b28009cd3939d3cb359f550d06730566e2f9b47ce
Sep 11 12:56:56.080592 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:56.080558    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v9qrk" event={"ID":"da903b32-17b4-42ff-849c-deb3e59ce02b","Type":"ContainerStarted","Data":"f440a23b8cc1d0c96f52095758a05f8cb548f5aa98061a3dfa14fa2f1db3b714"}
Sep 11 12:56:56.080942 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:56.080623    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v9qrk" event={"ID":"da903b32-17b4-42ff-849c-deb3e59ce02b","Type":"ContainerStarted","Data":"c22257896b1540b4fbf66ad0a963139486a36e34052ee9543ef7aa7fcae9e3dd"}
Sep 11 12:56:56.080942 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:56.080652    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v9qrk" event={"ID":"da903b32-17b4-42ff-849c-deb3e59ce02b","Type":"ContainerStarted","Data":"772e437364514f5f7459d18b28009cd3939d3cb359f550d06730566e2f9b47ce"}
Sep 11 12:56:56.100207 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:56.100173    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:56.220837 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:56.220803    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:57.659002 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:57.658907    2547 scope.go:117] "RemoveContainer" containerID="4ec97d5073f8b0094141dc6958f5358c0743a944986743e39f084850113a881e"
Sep 11 12:56:57.791205 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:57.791168    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:58.055381 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.055339    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:58.091431 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.091393    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v9qrk" event={"ID":"da903b32-17b4-42ff-849c-deb3e59ce02b","Type":"ContainerStarted","Data":"bcee99185c02e8928fc63f16f529e0593f16b90cbb412bfeef19922e91892757"}
Sep 11 12:56:58.093624 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.093590    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-b7gsm_b22738d7-e796-4173-8fb4-80f9208b99dd/console-operator/2.log"
Sep 11 12:56:58.093780 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.093659    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-b7gsm" event={"ID":"b22738d7-e796-4173-8fb4-80f9208b99dd","Type":"ContainerStarted","Data":"498afe3f90d67ea3be5f121476a10610e4954d4e9ae3f3178078e1511765787d"}
Sep 11 12:56:58.094049 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.094017    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-b7gsm"
Sep 11 12:56:58.115818 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.115793    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-8fbg6"]
Sep 11 12:56:58.118195 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.118169    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8fbg6"
Sep 11 12:56:58.125036 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.125015    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 11 12:56:58.125550 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.125531    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 11 12:56:58.126617 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.126584    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 12:56:58.126819 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.126796    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 11 12:56:58.126893 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.126854    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-8czlg\""
Sep 11 12:56:58.136538 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.136499    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-v9qrk" podStartSLOduration=34.228377784 podStartE2EDuration="36.136484357s" totalImagesPullingTime="1.908106573s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:56:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:58.131062578 +0000 UTC m=+84.992536771" watchObservedRunningTime="2026-09-11 12:56:58.136484357 +0000 UTC m=+84.997958545"
Sep 11 12:56:58.137535 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.137517    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-8fbg6"]
Sep 11 12:56:58.167992 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.167950    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-b7gsm" podStartSLOduration=38.682027236 podStartE2EDuration="45.167936534s" totalImagesPullingTime="6.485909298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:56:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:58.166045558 +0000 UTC m=+85.027519746" watchObservedRunningTime="2026-09-11 12:56:58.167936534 +0000 UTC m=+85.029410722"
Sep 11 12:56:58.287167 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.287125    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d631454d-ff93-43ea-8807-f1f633d724ea-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-8fbg6\" (UID: \"d631454d-ff93-43ea-8807-f1f633d724ea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8fbg6"
Sep 11 12:56:58.287167 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.287167    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d631454d-ff93-43ea-8807-f1f633d724ea-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-8fbg6\" (UID: \"d631454d-ff93-43ea-8807-f1f633d724ea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8fbg6"
Sep 11 12:56:58.287355 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.287263    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d631454d-ff93-43ea-8807-f1f633d724ea-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-8fbg6\" (UID: \"d631454d-ff93-43ea-8807-f1f633d724ea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8fbg6"
Sep 11 12:56:58.287355 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.287290    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d631454d-ff93-43ea-8807-f1f633d724ea-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-8fbg6\" (UID: \"d631454d-ff93-43ea-8807-f1f633d724ea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8fbg6"
Sep 11 12:56:58.287355 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.287321    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d631454d-ff93-43ea-8807-f1f633d724ea-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-8fbg6\" (UID: \"d631454d-ff93-43ea-8807-f1f633d724ea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8fbg6"
Sep 11 12:56:58.287469 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.287369    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhtk9\" (UniqueName: \"kubernetes.io/projected/d631454d-ff93-43ea-8807-f1f633d724ea-kube-api-access-zhtk9\") pod \"kube-state-metrics-59fbdd77d-8fbg6\" (UID: \"d631454d-ff93-43ea-8807-f1f633d724ea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8fbg6"
Sep 11 12:56:58.333219 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.333138    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-htlmm"]
Sep 11 12:56:58.335500 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.335480    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-htlmm"
Sep 11 12:56:58.338551 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.338529    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 12:56:58.339636 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.339616    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 12:56:58.339772 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.339665    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 12:56:58.340646 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.340629    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4jg94\""
Sep 11 12:56:58.343310 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.343280    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:58.388450 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.388421    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d631454d-ff93-43ea-8807-f1f633d724ea-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-8fbg6\" (UID: \"d631454d-ff93-43ea-8807-f1f633d724ea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8fbg6"
Sep 11 12:56:58.388450 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.388451    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d631454d-ff93-43ea-8807-f1f633d724ea-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-8fbg6\" (UID: \"d631454d-ff93-43ea-8807-f1f633d724ea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8fbg6"
Sep 11 12:56:58.388683 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.388478    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d631454d-ff93-43ea-8807-f1f633d724ea-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-8fbg6\" (UID: \"d631454d-ff93-43ea-8807-f1f633d724ea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8fbg6"
Sep 11 12:56:58.388683 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.388511    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhtk9\" (UniqueName: \"kubernetes.io/projected/d631454d-ff93-43ea-8807-f1f633d724ea-kube-api-access-zhtk9\") pod \"kube-state-metrics-59fbdd77d-8fbg6\" (UID: \"d631454d-ff93-43ea-8807-f1f633d724ea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8fbg6"
Sep 11 12:56:58.388683 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.388532    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d631454d-ff93-43ea-8807-f1f633d724ea-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-8fbg6\" (UID: \"d631454d-ff93-43ea-8807-f1f633d724ea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8fbg6"
Sep 11 12:56:58.388683 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.388547    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d631454d-ff93-43ea-8807-f1f633d724ea-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-8fbg6\" (UID: \"d631454d-ff93-43ea-8807-f1f633d724ea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8fbg6"
Sep 11 12:56:58.389073 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.389021    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d631454d-ff93-43ea-8807-f1f633d724ea-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-8fbg6\" (UID: \"d631454d-ff93-43ea-8807-f1f633d724ea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8fbg6"
Sep 11 12:56:58.389290 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.389271    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d631454d-ff93-43ea-8807-f1f633d724ea-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-8fbg6\" (UID: \"d631454d-ff93-43ea-8807-f1f633d724ea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8fbg6"
Sep 11 12:56:58.389699 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.389674    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d631454d-ff93-43ea-8807-f1f633d724ea-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-8fbg6\" (UID: \"d631454d-ff93-43ea-8807-f1f633d724ea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8fbg6"
Sep 11 12:56:58.391188 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.391166    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d631454d-ff93-43ea-8807-f1f633d724ea-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-8fbg6\" (UID: \"d631454d-ff93-43ea-8807-f1f633d724ea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8fbg6"
Sep 11 12:56:58.391342 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.391325    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d631454d-ff93-43ea-8807-f1f633d724ea-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-8fbg6\" (UID: \"d631454d-ff93-43ea-8807-f1f633d724ea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8fbg6"
Sep 11 12:56:58.409708 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.409687    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhtk9\" (UniqueName: \"kubernetes.io/projected/d631454d-ff93-43ea-8807-f1f633d724ea-kube-api-access-zhtk9\") pod \"kube-state-metrics-59fbdd77d-8fbg6\" (UID: \"d631454d-ff93-43ea-8807-f1f633d724ea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8fbg6"
Sep 11 12:56:58.429736 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.429412    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8fbg6"
Sep 11 12:56:58.489279 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.489255    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46hkm\" (UniqueName: \"kubernetes.io/projected/4513137d-518a-45a7-9ea4-84db18a11c39-kube-api-access-46hkm\") pod \"node-exporter-htlmm\" (UID: \"4513137d-518a-45a7-9ea4-84db18a11c39\") " pod="openshift-monitoring/node-exporter-htlmm"
Sep 11 12:56:58.489370 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.489300    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4513137d-518a-45a7-9ea4-84db18a11c39-metrics-client-ca\") pod \"node-exporter-htlmm\" (UID: \"4513137d-518a-45a7-9ea4-84db18a11c39\") " pod="openshift-monitoring/node-exporter-htlmm"
Sep 11 12:56:58.489370 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.489360    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4513137d-518a-45a7-9ea4-84db18a11c39-sys\") pod \"node-exporter-htlmm\" (UID: \"4513137d-518a-45a7-9ea4-84db18a11c39\") " pod="openshift-monitoring/node-exporter-htlmm"
Sep 11 12:56:58.489461 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.489377    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4513137d-518a-45a7-9ea4-84db18a11c39-node-exporter-wtmp\") pod \"node-exporter-htlmm\" (UID: \"4513137d-518a-45a7-9ea4-84db18a11c39\") " pod="openshift-monitoring/node-exporter-htlmm"
Sep 11 12:56:58.489461 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.489397    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4513137d-518a-45a7-9ea4-84db18a11c39-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-htlmm\" (UID: \"4513137d-518a-45a7-9ea4-84db18a11c39\") " pod="openshift-monitoring/node-exporter-htlmm"
Sep 11 12:56:58.489461 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.489419    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4513137d-518a-45a7-9ea4-84db18a11c39-node-exporter-accelerators-collector-config\") pod \"node-exporter-htlmm\" (UID: \"4513137d-518a-45a7-9ea4-84db18a11c39\") " pod="openshift-monitoring/node-exporter-htlmm"
Sep 11 12:56:58.489566 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.489481    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4513137d-518a-45a7-9ea4-84db18a11c39-node-exporter-textfile\") pod \"node-exporter-htlmm\" (UID: \"4513137d-518a-45a7-9ea4-84db18a11c39\") " pod="openshift-monitoring/node-exporter-htlmm"
Sep 11 12:56:58.489566 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.489504    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4513137d-518a-45a7-9ea4-84db18a11c39-node-exporter-tls\") pod \"node-exporter-htlmm\" (UID: \"4513137d-518a-45a7-9ea4-84db18a11c39\") " pod="openshift-monitoring/node-exporter-htlmm"
Sep 11 12:56:58.489566 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.489543    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4513137d-518a-45a7-9ea4-84db18a11c39-root\") pod \"node-exporter-htlmm\" (UID: \"4513137d-518a-45a7-9ea4-84db18a11c39\") " pod="openshift-monitoring/node-exporter-htlmm"
Sep 11 12:56:58.507808 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.507687    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:58.521828 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.521793    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-b7gsm"
Sep 11 12:56:58.590829 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.590690    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4513137d-518a-45a7-9ea4-84db18a11c39-metrics-client-ca\") pod \"node-exporter-htlmm\" (UID: \"4513137d-518a-45a7-9ea4-84db18a11c39\") " pod="openshift-monitoring/node-exporter-htlmm"
Sep 11 12:56:58.590829 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.590781    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4513137d-518a-45a7-9ea4-84db18a11c39-sys\") pod \"node-exporter-htlmm\" (UID: \"4513137d-518a-45a7-9ea4-84db18a11c39\") " pod="openshift-monitoring/node-exporter-htlmm"
Sep 11 12:56:58.590829 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.590810    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4513137d-518a-45a7-9ea4-84db18a11c39-node-exporter-wtmp\") pod \"node-exporter-htlmm\" (UID: \"4513137d-518a-45a7-9ea4-84db18a11c39\") " pod="openshift-monitoring/node-exporter-htlmm"
Sep 11 12:56:58.591124 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.590842    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4513137d-518a-45a7-9ea4-84db18a11c39-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-htlmm\" (UID: \"4513137d-518a-45a7-9ea4-84db18a11c39\") " pod="openshift-monitoring/node-exporter-htlmm"
Sep 11 12:56:58.591124 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.590872    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4513137d-518a-45a7-9ea4-84db18a11c39-node-exporter-accelerators-collector-config\") pod \"node-exporter-htlmm\" (UID: \"4513137d-518a-45a7-9ea4-84db18a11c39\") " pod="openshift-monitoring/node-exporter-htlmm"
Sep 11 12:56:58.591124 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.590912    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4513137d-518a-45a7-9ea4-84db18a11c39-node-exporter-textfile\") pod \"node-exporter-htlmm\" (UID: \"4513137d-518a-45a7-9ea4-84db18a11c39\") " pod="openshift-monitoring/node-exporter-htlmm"
Sep 11 12:56:58.591124 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.590936    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4513137d-518a-45a7-9ea4-84db18a11c39-node-exporter-tls\") pod \"node-exporter-htlmm\" (UID: \"4513137d-518a-45a7-9ea4-84db18a11c39\") " pod="openshift-monitoring/node-exporter-htlmm"
Sep 11 12:56:58.591124 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.590988    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4513137d-518a-45a7-9ea4-84db18a11c39-root\") pod \"node-exporter-htlmm\" (UID: \"4513137d-518a-45a7-9ea4-84db18a11c39\") " pod="openshift-monitoring/node-exporter-htlmm"
Sep 11 12:56:58.591124 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.591042    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46hkm\" (UniqueName: \"kubernetes.io/projected/4513137d-518a-45a7-9ea4-84db18a11c39-kube-api-access-46hkm\") pod \"node-exporter-htlmm\" (UID: \"4513137d-518a-45a7-9ea4-84db18a11c39\") " pod="openshift-monitoring/node-exporter-htlmm"
Sep 11 12:56:58.591408 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.591380    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4513137d-518a-45a7-9ea4-84db18a11c39-node-exporter-wtmp\") pod \"node-exporter-htlmm\" (UID: \"4513137d-518a-45a7-9ea4-84db18a11c39\") " pod="openshift-monitoring/node-exporter-htlmm"
Sep 11 12:56:58.591467 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.591433    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4513137d-518a-45a7-9ea4-84db18a11c39-metrics-client-ca\") pod \"node-exporter-htlmm\" (UID: \"4513137d-518a-45a7-9ea4-84db18a11c39\") " pod="openshift-monitoring/node-exporter-htlmm"
Sep 11 12:56:58.591467 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.591446    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4513137d-518a-45a7-9ea4-84db18a11c39-sys\") pod \"node-exporter-htlmm\" (UID: \"4513137d-518a-45a7-9ea4-84db18a11c39\") " pod="openshift-monitoring/node-exporter-htlmm"
Sep 11 12:56:58.591737 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.591690    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4513137d-518a-45a7-9ea4-84db18a11c39-node-exporter-accelerators-collector-config\") pod \"node-exporter-htlmm\" (UID: \"4513137d-518a-45a7-9ea4-84db18a11c39\") " pod="openshift-monitoring/node-exporter-htlmm"
Sep 11 12:56:58.591829 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.591689    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4513137d-518a-45a7-9ea4-84db18a11c39-node-exporter-textfile\") pod \"node-exporter-htlmm\" (UID: \"4513137d-518a-45a7-9ea4-84db18a11c39\") " pod="openshift-monitoring/node-exporter-htlmm"
Sep 11 12:56:58.591829 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.591761    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4513137d-518a-45a7-9ea4-84db18a11c39-root\") pod \"node-exporter-htlmm\" (UID: \"4513137d-518a-45a7-9ea4-84db18a11c39\") " pod="openshift-monitoring/node-exporter-htlmm"
Sep 11 12:56:58.594463 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.594436    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4513137d-518a-45a7-9ea4-84db18a11c39-node-exporter-tls\") pod \"node-exporter-htlmm\" (UID: \"4513137d-518a-45a7-9ea4-84db18a11c39\") " pod="openshift-monitoring/node-exporter-htlmm"
Sep 11 12:56:58.594597 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.594563    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4513137d-518a-45a7-9ea4-84db18a11c39-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-htlmm\" (UID: \"4513137d-518a-45a7-9ea4-84db18a11c39\") " pod="openshift-monitoring/node-exporter-htlmm"
Sep 11 12:56:58.615875 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.615844    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46hkm\" (UniqueName: \"kubernetes.io/projected/4513137d-518a-45a7-9ea4-84db18a11c39-kube-api-access-46hkm\") pod \"node-exporter-htlmm\" (UID: \"4513137d-518a-45a7-9ea4-84db18a11c39\") " pod="openshift-monitoring/node-exporter-htlmm"
Sep 11 12:56:58.646373 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.646346    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-htlmm"
Sep 11 12:56:58.657527 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:56:58.657501    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4513137d_518a_45a7_9ea4_84db18a11c39.slice/crio-c5ed390b861cc409b01bca96744a41bca7e7204e39c1c678ed2df3c7416e64a1 WatchSource:0}: Error finding container c5ed390b861cc409b01bca96744a41bca7e7204e39c1c678ed2df3c7416e64a1: Status 404 returned error can't find the container with id c5ed390b861cc409b01bca96744a41bca7e7204e39c1c678ed2df3c7416e64a1
Sep 11 12:56:58.727079 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:56:58.727048    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd631454d_ff93_43ea_8807_f1f633d724ea.slice/crio-4c5a2ae5ae7ae10aff28dc0851a064c3fc6ae2a1e9e842ae5bbc285107d87907 WatchSource:0}: Error finding container 4c5a2ae5ae7ae10aff28dc0851a064c3fc6ae2a1e9e842ae5bbc285107d87907: Status 404 returned error can't find the container with id 4c5a2ae5ae7ae10aff28dc0851a064c3fc6ae2a1e9e842ae5bbc285107d87907
Sep 11 12:56:58.731135 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.731108    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-8fbg6"]
Sep 11 12:56:58.815424 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.815386    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:58.995705 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:58.995625    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:59.098688 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:59.098649    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-htlmm" event={"ID":"4513137d-518a-45a7-9ea4-84db18a11c39","Type":"ContainerStarted","Data":"c5ed390b861cc409b01bca96744a41bca7e7204e39c1c678ed2df3c7416e64a1"}
Sep 11 12:56:59.100002 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:59.099973    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8fbg6" event={"ID":"d631454d-ff93-43ea-8807-f1f633d724ea","Type":"ContainerStarted","Data":"4c5a2ae5ae7ae10aff28dc0851a064c3fc6ae2a1e9e842ae5bbc285107d87907"}
Sep 11 12:56:59.159479 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:59.159446    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:59.419558 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:59.419521    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:59.847256 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:56:59.847216    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:00.078643 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:00.078579    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:00.106411 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:00.106381    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-htlmm" event={"ID":"4513137d-518a-45a7-9ea4-84db18a11c39","Type":"ContainerStarted","Data":"f3ba62f9d122c7fbf7d803151ec968822c3a1a82c01e11a07422d2f086cfabe0"}
Sep 11 12:57:00.109137 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:00.109104    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8fbg6" event={"ID":"d631454d-ff93-43ea-8807-f1f633d724ea","Type":"ContainerStarted","Data":"fac0c7f5bb692d5c688112519ca77833e876ce387c8c03a5bb577d0f8b245809"}
Sep 11 12:57:00.546910 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:00.546868    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:00.683019 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:00.682966    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:00.810078 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:00.810039    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:00.922754 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:00.922699    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:01.114614 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:01.114530    2547 generic.go:356] "Generic (PLEG): container finished" podID="4513137d-518a-45a7-9ea4-84db18a11c39" containerID="f3ba62f9d122c7fbf7d803151ec968822c3a1a82c01e11a07422d2f086cfabe0" exitCode=0
Sep 11 12:57:01.114783 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:01.114624    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-htlmm" event={"ID":"4513137d-518a-45a7-9ea4-84db18a11c39","Type":"ContainerDied","Data":"f3ba62f9d122c7fbf7d803151ec968822c3a1a82c01e11a07422d2f086cfabe0"}
Sep 11 12:57:01.117196 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:01.117172    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8fbg6" event={"ID":"d631454d-ff93-43ea-8807-f1f633d724ea","Type":"ContainerStarted","Data":"22dfa47b3f2628d4df74e20a9853fd2cb219528059d99ed8de3e8f6422216c99"}
Sep 11 12:57:01.117311 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:01.117226    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8fbg6" event={"ID":"d631454d-ff93-43ea-8807-f1f633d724ea","Type":"ContainerStarted","Data":"3c1f690164b0a3fa411189927dd15a2a31f7b1bf1e7c7fe4e886c40d9838b823"}
Sep 11 12:57:01.193093 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:01.193043    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8fbg6" podStartSLOduration=1.886777787 podStartE2EDuration="3.193020882s" totalImagesPullingTime="1.306243095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:56:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:57:01.191994687 +0000 UTC m=+88.053468876" watchObservedRunningTime="2026-09-11 12:57:01.193020882 +0000 UTC m=+88.054495071"
Sep 11 12:57:01.363296 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:01.363266    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:01.673846 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:01.673819    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:01.964667 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:01.964565    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:02.124525 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:02.124488    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-htlmm" event={"ID":"4513137d-518a-45a7-9ea4-84db18a11c39","Type":"ContainerStarted","Data":"8942ff062d83d1d7a847f113887f6a1a5664e6a4b833b1635369391ae20f5266"}
Sep 11 12:57:02.124698 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:02.124555    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-htlmm" event={"ID":"4513137d-518a-45a7-9ea4-84db18a11c39","Type":"ContainerStarted","Data":"46c6d3e8be503cb7fd5adbf3de03b3cbcfc382726817bc792eccf9efd7d3050a"}
Sep 11 12:57:02.198670 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:02.198614    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-htlmm" podStartSLOduration=3.086801382 podStartE2EDuration="4.198592088s" totalImagesPullingTime="1.019392362s" totalInitContainerRuntime="92.398344ms" isStatefulPod=true podCreationTimestamp="2026-09-11 12:56:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:57:02.197776447 +0000 UTC m=+89.059250635" watchObservedRunningTime="2026-09-11 12:57:02.198592088 +0000 UTC m=+89.060066277"
Sep 11 12:57:02.271633 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:02.271539    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:02.790491 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:02.790457    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:02.804876 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:02.804827    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-h7s4s"]
Sep 11 12:57:02.807085 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:02.807069    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-h7s4s"
Sep 11 12:57:02.813480 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:02.813140    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 11 12:57:02.813480 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:02.813160    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-j25md\""
Sep 11 12:57:02.833750 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:02.829359    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-h7s4s"]
Sep 11 12:57:02.930956 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:02.930916    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckbdq\" (UniqueName: \"kubernetes.io/projected/e366bf09-f550-467a-a7ef-351e61bc1386-kube-api-access-ckbdq\") pod \"monitoring-plugin-5d85778b9d-h7s4s\" (UID: \"e366bf09-f550-467a-a7ef-351e61bc1386\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-h7s4s"
Sep 11 12:57:02.931127 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:02.930971    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e366bf09-f550-467a-a7ef-351e61bc1386-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-h7s4s\" (UID: \"e366bf09-f550-467a-a7ef-351e61bc1386\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-h7s4s"
Sep 11 12:57:02.937734 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:02.937688    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:03.031662 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:03.031625    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckbdq\" (UniqueName: \"kubernetes.io/projected/e366bf09-f550-467a-a7ef-351e61bc1386-kube-api-access-ckbdq\") pod \"monitoring-plugin-5d85778b9d-h7s4s\" (UID: \"e366bf09-f550-467a-a7ef-351e61bc1386\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-h7s4s"
Sep 11 12:57:03.032077 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:03.031679    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e366bf09-f550-467a-a7ef-351e61bc1386-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-h7s4s\" (UID: \"e366bf09-f550-467a-a7ef-351e61bc1386\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-h7s4s"
Sep 11 12:57:03.032077 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:57:03.031808    2547 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 11 12:57:03.032077 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:57:03.031871    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e366bf09-f550-467a-a7ef-351e61bc1386-monitoring-plugin-cert podName:e366bf09-f550-467a-a7ef-351e61bc1386 nodeName:}" failed. No retries permitted until 2026-09-11 12:57:03.531850618 +0000 UTC m=+90.393324803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/e366bf09-f550-467a-a7ef-351e61bc1386-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-h7s4s" (UID: "e366bf09-f550-467a-a7ef-351e61bc1386") : secret "monitoring-plugin-cert" not found
Sep 11 12:57:03.046330 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:03.046269    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckbdq\" (UniqueName: \"kubernetes.io/projected/e366bf09-f550-467a-a7ef-351e61bc1386-kube-api-access-ckbdq\") pod \"monitoring-plugin-5d85778b9d-h7s4s\" (UID: \"e366bf09-f550-467a-a7ef-351e61bc1386\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-h7s4s"
Sep 11 12:57:03.362899 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:03.362857    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:03.535423 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:03.535380    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e366bf09-f550-467a-a7ef-351e61bc1386-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-h7s4s\" (UID: \"e366bf09-f550-467a-a7ef-351e61bc1386\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-h7s4s"
Sep 11 12:57:03.538066 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:03.538036    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e366bf09-f550-467a-a7ef-351e61bc1386-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-h7s4s\" (UID: \"e366bf09-f550-467a-a7ef-351e61bc1386\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-h7s4s"
Sep 11 12:57:03.716526 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:03.716442    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-h7s4s"
Sep 11 12:57:03.996309 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:03.996285    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-h7s4s"]
Sep 11 12:57:03.998700 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:57:03.998673    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode366bf09_f550_467a_a7ef_351e61bc1386.slice/crio-86d2d4ad4c6d1e1f397c7575c3c8181c483ac736c30374391193b36c53e6f564 WatchSource:0}: Error finding container 86d2d4ad4c6d1e1f397c7575c3c8181c483ac736c30374391193b36c53e6f564: Status 404 returned error can't find the container with id 86d2d4ad4c6d1e1f397c7575c3c8181c483ac736c30374391193b36c53e6f564
Sep 11 12:57:04.133349 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:04.133316    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-h7s4s" event={"ID":"e366bf09-f550-467a-a7ef-351e61bc1386","Type":"ContainerStarted","Data":"86d2d4ad4c6d1e1f397c7575c3c8181c483ac736c30374391193b36c53e6f564"}
Sep 11 12:57:04.967708 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:04.967662    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:06.145905 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:06.145860    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-h7s4s" event={"ID":"e366bf09-f550-467a-a7ef-351e61bc1386","Type":"ContainerStarted","Data":"d6fcecc35ed3a0a5f3efabb16e79b3a2d9199153546b003c8e00cd88380125c2"}
Sep 11 12:57:06.146375 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:06.146071    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-h7s4s"
Sep 11 12:57:06.150792 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:06.150770    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-h7s4s"
Sep 11 12:57:06.193736 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:06.193656    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-h7s4s" podStartSLOduration=2.8370562120000002 podStartE2EDuration="4.193637431s" totalImagesPullingTime="1.356581219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:57:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:57:06.192598536 +0000 UTC m=+93.054072726" watchObservedRunningTime="2026-09-11 12:57:06.193637431 +0000 UTC m=+93.055111618"
Sep 11 12:57:07.191044 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:07.191001    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:07.294468 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:07.294435    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:07.653202 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:07.653166    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:07.742177 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:07.742148    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:08.568996 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:08.568963    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66657d8687-z7czd"]
Sep 11 12:57:08.571313 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:08.571285    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66657d8687-z7czd"
Sep 11 12:57:08.573969 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:08.573936    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 12:57:08.573969 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:08.573950    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mbg28\""
Sep 11 12:57:08.574957 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:08.574886    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 12:57:08.574957 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:08.574909    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 12:57:08.574957 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:08.574893    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 12:57:08.574957 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:08.574958    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 12:57:08.575192 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:08.574919    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 12:57:08.575192 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:08.575139    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 12:57:08.585017 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:08.584997    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66657d8687-z7czd"]
Sep 11 12:57:08.668928 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:08.668898    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e99cd6d-e9a0-4473-98ef-23d411396dd8-service-ca\") pod \"console-66657d8687-z7czd\" (UID: \"3e99cd6d-e9a0-4473-98ef-23d411396dd8\") " pod="openshift-console/console-66657d8687-z7czd"
Sep 11 12:57:08.669070 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:08.668938    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e99cd6d-e9a0-4473-98ef-23d411396dd8-console-config\") pod \"console-66657d8687-z7czd\" (UID: \"3e99cd6d-e9a0-4473-98ef-23d411396dd8\") " pod="openshift-console/console-66657d8687-z7czd"
Sep 11 12:57:08.669070 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:08.669039    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e99cd6d-e9a0-4473-98ef-23d411396dd8-oauth-serving-cert\") pod \"console-66657d8687-z7czd\" (UID: \"3e99cd6d-e9a0-4473-98ef-23d411396dd8\") " pod="openshift-console/console-66657d8687-z7czd"
Sep 11 12:57:08.669070 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:08.669065    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e99cd6d-e9a0-4473-98ef-23d411396dd8-console-oauth-config\") pod \"console-66657d8687-z7czd\" (UID: \"3e99cd6d-e9a0-4473-98ef-23d411396dd8\") " pod="openshift-console/console-66657d8687-z7czd"
Sep 11 12:57:08.669167 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:08.669086    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4lzt\" (UniqueName: \"kubernetes.io/projected/3e99cd6d-e9a0-4473-98ef-23d411396dd8-kube-api-access-q4lzt\") pod \"console-66657d8687-z7czd\" (UID: \"3e99cd6d-e9a0-4473-98ef-23d411396dd8\") " pod="openshift-console/console-66657d8687-z7czd"
Sep 11 12:57:08.669167 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:08.669112    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e99cd6d-e9a0-4473-98ef-23d411396dd8-console-serving-cert\") pod \"console-66657d8687-z7czd\" (UID: \"3e99cd6d-e9a0-4473-98ef-23d411396dd8\") " pod="openshift-console/console-66657d8687-z7czd"
Sep 11 12:57:08.769809 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:08.769779    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e99cd6d-e9a0-4473-98ef-23d411396dd8-console-serving-cert\") pod \"console-66657d8687-z7czd\" (UID: \"3e99cd6d-e9a0-4473-98ef-23d411396dd8\") " pod="openshift-console/console-66657d8687-z7czd"
Sep 11 12:57:08.769924 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:08.769819    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e99cd6d-e9a0-4473-98ef-23d411396dd8-service-ca\") pod \"console-66657d8687-z7czd\" (UID: \"3e99cd6d-e9a0-4473-98ef-23d411396dd8\") " pod="openshift-console/console-66657d8687-z7czd"
Sep 11 12:57:08.769924 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:08.769846    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e99cd6d-e9a0-4473-98ef-23d411396dd8-console-config\") pod \"console-66657d8687-z7czd\" (UID: \"3e99cd6d-e9a0-4473-98ef-23d411396dd8\") " pod="openshift-console/console-66657d8687-z7czd"
Sep 11 12:57:08.769924 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:08.769889    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e99cd6d-e9a0-4473-98ef-23d411396dd8-oauth-serving-cert\") pod \"console-66657d8687-z7czd\" (UID: \"3e99cd6d-e9a0-4473-98ef-23d411396dd8\") " pod="openshift-console/console-66657d8687-z7czd"
Sep 11 12:57:08.769924 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:08.769907    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e99cd6d-e9a0-4473-98ef-23d411396dd8-console-oauth-config\") pod \"console-66657d8687-z7czd\" (UID: \"3e99cd6d-e9a0-4473-98ef-23d411396dd8\") " pod="openshift-console/console-66657d8687-z7czd"
Sep 11 12:57:08.769924 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:08.769924    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4lzt\" (UniqueName: \"kubernetes.io/projected/3e99cd6d-e9a0-4473-98ef-23d411396dd8-kube-api-access-q4lzt\") pod \"console-66657d8687-z7czd\" (UID: \"3e99cd6d-e9a0-4473-98ef-23d411396dd8\") " pod="openshift-console/console-66657d8687-z7czd"
Sep 11 12:57:08.770520 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:08.770491    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e99cd6d-e9a0-4473-98ef-23d411396dd8-service-ca\") pod \"console-66657d8687-z7czd\" (UID: \"3e99cd6d-e9a0-4473-98ef-23d411396dd8\") " pod="openshift-console/console-66657d8687-z7czd"
Sep 11 12:57:08.770811 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:08.770553    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e99cd6d-e9a0-4473-98ef-23d411396dd8-console-config\") pod \"console-66657d8687-z7czd\" (UID: \"3e99cd6d-e9a0-4473-98ef-23d411396dd8\") " pod="openshift-console/console-66657d8687-z7czd"
Sep 11 12:57:08.770811 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:08.770596    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e99cd6d-e9a0-4473-98ef-23d411396dd8-oauth-serving-cert\") pod \"console-66657d8687-z7czd\" (UID: \"3e99cd6d-e9a0-4473-98ef-23d411396dd8\") " pod="openshift-console/console-66657d8687-z7czd"
Sep 11 12:57:08.772513 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:08.772493    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e99cd6d-e9a0-4473-98ef-23d411396dd8-console-serving-cert\") pod \"console-66657d8687-z7czd\" (UID: \"3e99cd6d-e9a0-4473-98ef-23d411396dd8\") " pod="openshift-console/console-66657d8687-z7czd"
Sep 11 12:57:08.772513 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:08.772503    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e99cd6d-e9a0-4473-98ef-23d411396dd8-console-oauth-config\") pod \"console-66657d8687-z7czd\" (UID: \"3e99cd6d-e9a0-4473-98ef-23d411396dd8\") " pod="openshift-console/console-66657d8687-z7czd"
Sep 11 12:57:08.781448 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:08.781425    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4lzt\" (UniqueName: \"kubernetes.io/projected/3e99cd6d-e9a0-4473-98ef-23d411396dd8-kube-api-access-q4lzt\") pod \"console-66657d8687-z7czd\" (UID: \"3e99cd6d-e9a0-4473-98ef-23d411396dd8\") " pod="openshift-console/console-66657d8687-z7czd"
Sep 11 12:57:08.880427 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:08.880335    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66657d8687-z7czd"
Sep 11 12:57:09.057086 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:09.057057    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:57:09.166311 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:09.166231    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66657d8687-z7czd"]
Sep 11 12:57:09.169259 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:57:09.169230    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e99cd6d_e9a0_4473_98ef_23d411396dd8.slice/crio-f8cc451c40c4c0f1dd9ad45432557ba6e30cb9b9e50f6f7c3b9c0c779140e889 WatchSource:0}: Error finding container f8cc451c40c4c0f1dd9ad45432557ba6e30cb9b9e50f6f7c3b9c0c779140e889: Status 404 returned error can't find the container with id f8cc451c40c4c0f1dd9ad45432557ba6e30cb9b9e50f6f7c3b9c0c779140e889
Sep 11 12:57:09.889561 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:09.889527    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:09.988566 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:09.988518    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:10.082883 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:10.082846    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:10.154413 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:10.154323    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:10.162064 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:10.162035    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66657d8687-z7czd" event={"ID":"3e99cd6d-e9a0-4473-98ef-23d411396dd8","Type":"ContainerStarted","Data":"f8cc451c40c4c0f1dd9ad45432557ba6e30cb9b9e50f6f7c3b9c0c779140e889"}
Sep 11 12:57:12.006231 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:12.006197    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4bvlc"
Sep 11 12:57:12.632107 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:12.632056    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:13.066751 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:13.066696    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:13.173158 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:13.173128    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:13.175572 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:13.175549    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66657d8687-z7czd" event={"ID":"3e99cd6d-e9a0-4473-98ef-23d411396dd8","Type":"ContainerStarted","Data":"9b90c0a23ddab19a8c7554ab0f902646e1a0311ee6ab0ae1c5fda212092ca10b"}
Sep 11 12:57:13.201393 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:13.201345    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66657d8687-z7czd" podStartSLOduration=2.203709844 podStartE2EDuration="5.201330531s" totalImagesPullingTime="2.997620687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:57:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:57:13.200815292 +0000 UTC m=+100.062289481" watchObservedRunningTime="2026-09-11 12:57:13.201330531 +0000 UTC m=+100.062804753"
Sep 11 12:57:14.070004 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:14.069957    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv" podUID="a59c6516-8024-4800-9e3e-df32fc1c6967" containerName="registry" containerID="cri-o://cf14cbedb9fe8852e252b35c9a8f5cb4d1c8d81250d49a0aa222a8734b4d8826" gracePeriod=30
Sep 11 12:57:14.314959 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:14.314933    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:57:14.414654 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:14.414565    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a59c6516-8024-4800-9e3e-df32fc1c6967-trusted-ca\") pod \"a59c6516-8024-4800-9e3e-df32fc1c6967\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") "
Sep 11 12:57:14.414654 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:14.414622    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-registry-tls\") pod \"a59c6516-8024-4800-9e3e-df32fc1c6967\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") "
Sep 11 12:57:14.414902 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:14.414665    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmfhm\" (UniqueName: \"kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-kube-api-access-vmfhm\") pod \"a59c6516-8024-4800-9e3e-df32fc1c6967\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") "
Sep 11 12:57:14.414902 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:14.414688    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a59c6516-8024-4800-9e3e-df32fc1c6967-image-registry-private-configuration\") pod \"a59c6516-8024-4800-9e3e-df32fc1c6967\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") "
Sep 11 12:57:14.414902 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:14.414742    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a59c6516-8024-4800-9e3e-df32fc1c6967-ca-trust-extracted\") pod \"a59c6516-8024-4800-9e3e-df32fc1c6967\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") "
Sep 11 12:57:14.414902 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:14.414784    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a59c6516-8024-4800-9e3e-df32fc1c6967-registry-certificates\") pod \"a59c6516-8024-4800-9e3e-df32fc1c6967\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") "
Sep 11 12:57:14.414902 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:14.414809    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-bound-sa-token\") pod \"a59c6516-8024-4800-9e3e-df32fc1c6967\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") "
Sep 11 12:57:14.414902 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:14.414831    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a59c6516-8024-4800-9e3e-df32fc1c6967-installation-pull-secrets\") pod \"a59c6516-8024-4800-9e3e-df32fc1c6967\" (UID: \"a59c6516-8024-4800-9e3e-df32fc1c6967\") "
Sep 11 12:57:14.415188 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:14.415129    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a59c6516-8024-4800-9e3e-df32fc1c6967-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a59c6516-8024-4800-9e3e-df32fc1c6967" (UID: "a59c6516-8024-4800-9e3e-df32fc1c6967"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:57:14.415328 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:14.415297    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a59c6516-8024-4800-9e3e-df32fc1c6967-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a59c6516-8024-4800-9e3e-df32fc1c6967" (UID: "a59c6516-8024-4800-9e3e-df32fc1c6967"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:57:14.417442 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:14.417412    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a59c6516-8024-4800-9e3e-df32fc1c6967-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a59c6516-8024-4800-9e3e-df32fc1c6967" (UID: "a59c6516-8024-4800-9e3e-df32fc1c6967"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:57:14.417547 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:14.417430    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a59c6516-8024-4800-9e3e-df32fc1c6967" (UID: "a59c6516-8024-4800-9e3e-df32fc1c6967"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:57:14.417547 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:14.417493    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a59c6516-8024-4800-9e3e-df32fc1c6967-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a59c6516-8024-4800-9e3e-df32fc1c6967" (UID: "a59c6516-8024-4800-9e3e-df32fc1c6967"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:57:14.417731 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:14.417694    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-kube-api-access-vmfhm" (OuterVolumeSpecName: "kube-api-access-vmfhm") pod "a59c6516-8024-4800-9e3e-df32fc1c6967" (UID: "a59c6516-8024-4800-9e3e-df32fc1c6967"). InnerVolumeSpecName "kube-api-access-vmfhm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:57:14.417866 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:14.417849    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a59c6516-8024-4800-9e3e-df32fc1c6967" (UID: "a59c6516-8024-4800-9e3e-df32fc1c6967"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:57:14.426428 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:14.426404    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a59c6516-8024-4800-9e3e-df32fc1c6967-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a59c6516-8024-4800-9e3e-df32fc1c6967" (UID: "a59c6516-8024-4800-9e3e-df32fc1c6967"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:57:14.515484 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:14.515455    2547 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a59c6516-8024-4800-9e3e-df32fc1c6967-registry-certificates\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 12:57:14.515484 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:14.515478    2547 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-bound-sa-token\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 12:57:14.515484 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:14.515487    2547 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a59c6516-8024-4800-9e3e-df32fc1c6967-installation-pull-secrets\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 12:57:14.515683 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:14.515495    2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a59c6516-8024-4800-9e3e-df32fc1c6967-trusted-ca\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 12:57:14.515683 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:14.515504    2547 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-registry-tls\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 12:57:14.515683 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:14.515512    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmfhm\" (UniqueName: \"kubernetes.io/projected/a59c6516-8024-4800-9e3e-df32fc1c6967-kube-api-access-vmfhm\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 12:57:14.515683 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:14.515523    2547 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a59c6516-8024-4800-9e3e-df32fc1c6967-image-registry-private-configuration\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 12:57:14.515683 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:14.515532    2547 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a59c6516-8024-4800-9e3e-df32fc1c6967-ca-trust-extracted\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 12:57:15.184452 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:15.184418    2547 generic.go:356] "Generic (PLEG): container finished" podID="a59c6516-8024-4800-9e3e-df32fc1c6967" containerID="cf14cbedb9fe8852e252b35c9a8f5cb4d1c8d81250d49a0aa222a8734b4d8826" exitCode=0
Sep 11 12:57:15.184958 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:15.184478    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv"
Sep 11 12:57:15.184958 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:15.184507    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv" event={"ID":"a59c6516-8024-4800-9e3e-df32fc1c6967","Type":"ContainerDied","Data":"cf14cbedb9fe8852e252b35c9a8f5cb4d1c8d81250d49a0aa222a8734b4d8826"}
Sep 11 12:57:15.184958 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:15.184562    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b6756f9f8-gn9bv" event={"ID":"a59c6516-8024-4800-9e3e-df32fc1c6967","Type":"ContainerDied","Data":"6163e3c67e75e5d2419a16e5447d09d6102b43b324c39b11c9cad2cc7b794730"}
Sep 11 12:57:15.184958 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:15.184585    2547 scope.go:117] "RemoveContainer" containerID="cf14cbedb9fe8852e252b35c9a8f5cb4d1c8d81250d49a0aa222a8734b4d8826"
Sep 11 12:57:15.193378 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:15.193363    2547 scope.go:117] "RemoveContainer" containerID="cf14cbedb9fe8852e252b35c9a8f5cb4d1c8d81250d49a0aa222a8734b4d8826"
Sep 11 12:57:15.193656 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:57:15.193639    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf14cbedb9fe8852e252b35c9a8f5cb4d1c8d81250d49a0aa222a8734b4d8826\": container with ID starting with cf14cbedb9fe8852e252b35c9a8f5cb4d1c8d81250d49a0aa222a8734b4d8826 not found: ID does not exist" containerID="cf14cbedb9fe8852e252b35c9a8f5cb4d1c8d81250d49a0aa222a8734b4d8826"
Sep 11 12:57:15.193699 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:15.193664    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf14cbedb9fe8852e252b35c9a8f5cb4d1c8d81250d49a0aa222a8734b4d8826"} err="failed to get container status \"cf14cbedb9fe8852e252b35c9a8f5cb4d1c8d81250d49a0aa222a8734b4d8826\": rpc error: code = NotFound desc = could not find container \"cf14cbedb9fe8852e252b35c9a8f5cb4d1c8d81250d49a0aa222a8734b4d8826\": container with ID starting with cf14cbedb9fe8852e252b35c9a8f5cb4d1c8d81250d49a0aa222a8734b4d8826 not found: ID does not exist"
Sep 11 12:57:15.209005 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:15.207843    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b6756f9f8-gn9bv"]
Sep 11 12:57:15.211383 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:15.211361    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-b6756f9f8-gn9bv"]
Sep 11 12:57:15.662160 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:15.662130    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a59c6516-8024-4800-9e3e-df32fc1c6967" path="/var/lib/kubelet/pods/a59c6516-8024-4800-9e3e-df32fc1c6967/volumes"
Sep 11 12:57:16.831517 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:16.831477    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d67d78b79-wlwsr"]
Sep 11 12:57:16.831892 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:16.831794    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a59c6516-8024-4800-9e3e-df32fc1c6967" containerName="registry"
Sep 11 12:57:16.831892 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:16.831808    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a59c6516-8024-4800-9e3e-df32fc1c6967" containerName="registry"
Sep 11 12:57:16.831892 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:16.831869    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="a59c6516-8024-4800-9e3e-df32fc1c6967" containerName="registry"
Sep 11 12:57:16.872101 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:16.872069    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d67d78b79-wlwsr"]
Sep 11 12:57:16.872245 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:16.872182    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d67d78b79-wlwsr"
Sep 11 12:57:16.880095 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:16.880061    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 12:57:16.932440 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:16.932405    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-console-serving-cert\") pod \"console-d67d78b79-wlwsr\" (UID: \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\") " pod="openshift-console/console-d67d78b79-wlwsr"
Sep 11 12:57:16.932440 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:16.932443    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-console-oauth-config\") pod \"console-d67d78b79-wlwsr\" (UID: \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\") " pod="openshift-console/console-d67d78b79-wlwsr"
Sep 11 12:57:16.932617 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:16.932501    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-console-config\") pod \"console-d67d78b79-wlwsr\" (UID: \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\") " pod="openshift-console/console-d67d78b79-wlwsr"
Sep 11 12:57:16.932617 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:16.932527    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-service-ca\") pod \"console-d67d78b79-wlwsr\" (UID: \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\") " pod="openshift-console/console-d67d78b79-wlwsr"
Sep 11 12:57:16.932617 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:16.932549    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-oauth-serving-cert\") pod \"console-d67d78b79-wlwsr\" (UID: \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\") " pod="openshift-console/console-d67d78b79-wlwsr"
Sep 11 12:57:16.932617 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:16.932587    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69bx6\" (UniqueName: \"kubernetes.io/projected/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-kube-api-access-69bx6\") pod \"console-d67d78b79-wlwsr\" (UID: \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\") " pod="openshift-console/console-d67d78b79-wlwsr"
Sep 11 12:57:16.932767 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:16.932620    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-trusted-ca-bundle\") pod \"console-d67d78b79-wlwsr\" (UID: \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\") " pod="openshift-console/console-d67d78b79-wlwsr"
Sep 11 12:57:17.033454 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:17.033417    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-console-config\") pod \"console-d67d78b79-wlwsr\" (UID: \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\") " pod="openshift-console/console-d67d78b79-wlwsr"
Sep 11 12:57:17.033454 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:17.033450    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-service-ca\") pod \"console-d67d78b79-wlwsr\" (UID: \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\") " pod="openshift-console/console-d67d78b79-wlwsr"
Sep 11 12:57:17.033665 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:17.033474    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-oauth-serving-cert\") pod \"console-d67d78b79-wlwsr\" (UID: \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\") " pod="openshift-console/console-d67d78b79-wlwsr"
Sep 11 12:57:17.033665 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:17.033492    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69bx6\" (UniqueName: \"kubernetes.io/projected/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-kube-api-access-69bx6\") pod \"console-d67d78b79-wlwsr\" (UID: \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\") " pod="openshift-console/console-d67d78b79-wlwsr"
Sep 11 12:57:17.033665 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:17.033524    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-trusted-ca-bundle\") pod \"console-d67d78b79-wlwsr\" (UID: \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\") " pod="openshift-console/console-d67d78b79-wlwsr"
Sep 11 12:57:17.033665 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:17.033570    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-console-serving-cert\") pod \"console-d67d78b79-wlwsr\" (UID: \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\") " pod="openshift-console/console-d67d78b79-wlwsr"
Sep 11 12:57:17.033665 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:17.033591    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-console-oauth-config\") pod \"console-d67d78b79-wlwsr\" (UID: \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\") " pod="openshift-console/console-d67d78b79-wlwsr"
Sep 11 12:57:17.034353 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:17.034325    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-service-ca\") pod \"console-d67d78b79-wlwsr\" (UID: \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\") " pod="openshift-console/console-d67d78b79-wlwsr"
Sep 11 12:57:17.034463 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:17.034326    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-oauth-serving-cert\") pod \"console-d67d78b79-wlwsr\" (UID: \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\") " pod="openshift-console/console-d67d78b79-wlwsr"
Sep 11 12:57:17.034463 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:17.034423    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-trusted-ca-bundle\") pod \"console-d67d78b79-wlwsr\" (UID: \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\") " pod="openshift-console/console-d67d78b79-wlwsr"
Sep 11 12:57:17.034463 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:17.034419    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-console-config\") pod \"console-d67d78b79-wlwsr\" (UID: \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\") " pod="openshift-console/console-d67d78b79-wlwsr"
Sep 11 12:57:17.036617 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:17.036593    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-console-oauth-config\") pod \"console-d67d78b79-wlwsr\" (UID: \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\") " pod="openshift-console/console-d67d78b79-wlwsr"
Sep 11 12:57:17.036751 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:17.036731    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-console-serving-cert\") pod \"console-d67d78b79-wlwsr\" (UID: \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\") " pod="openshift-console/console-d67d78b79-wlwsr"
Sep 11 12:57:17.043378 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:17.043358    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69bx6\" (UniqueName: \"kubernetes.io/projected/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-kube-api-access-69bx6\") pod \"console-d67d78b79-wlwsr\" (UID: \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\") " pod="openshift-console/console-d67d78b79-wlwsr"
Sep 11 12:57:17.059212 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:17.059186    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:17.163023 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:17.162955    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:17.181883 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:17.181858    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d67d78b79-wlwsr"
Sep 11 12:57:17.489353 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:17.489330    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d67d78b79-wlwsr"]
Sep 11 12:57:17.491825 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:57:17.491798    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3656f1b6_75ef_46bc_9a9e_6dde502a0e81.slice/crio-69b2732931196df5c25f80838d4238cbf0424ce06eac37cd881df85f03cc464e WatchSource:0}: Error finding container 69b2732931196df5c25f80838d4238cbf0424ce06eac37cd881df85f03cc464e: Status 404 returned error can't find the container with id 69b2732931196df5c25f80838d4238cbf0424ce06eac37cd881df85f03cc464e
Sep 11 12:57:18.197853 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:18.197815    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d67d78b79-wlwsr" event={"ID":"3656f1b6-75ef-46bc-9a9e-6dde502a0e81","Type":"ContainerStarted","Data":"82ff639b1da4b44f80bc8de90d1b400a7d42b0908213f0c6d42fa151fa9f5714"}
Sep 11 12:57:18.198233 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:18.197867    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d67d78b79-wlwsr" event={"ID":"3656f1b6-75ef-46bc-9a9e-6dde502a0e81","Type":"ContainerStarted","Data":"69b2732931196df5c25f80838d4238cbf0424ce06eac37cd881df85f03cc464e"}
Sep 11 12:57:18.243799 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:18.243745    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d67d78b79-wlwsr" podStartSLOduration=2.243708808 podStartE2EDuration="2.243708808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:57:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:57:18.243066206 +0000 UTC m=+105.104540394" watchObservedRunningTime="2026-09-11 12:57:18.243708808 +0000 UTC m=+105.105182996"
Sep 11 12:57:18.261422 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:18.261388    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:18.465499 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:18.465413    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:18.880907 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:18.880864    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66657d8687-z7czd"
Sep 11 12:57:18.881186 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:18.881171    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66657d8687-z7czd"
Sep 11 12:57:18.885773 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:18.885749    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66657d8687-z7czd"
Sep 11 12:57:19.209487 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:19.209410    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66657d8687-z7czd"
Sep 11 12:57:19.313776 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:19.313738    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:19.387488 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:19.387452    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:23.652220 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:23.652188    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:23.731097 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:23.731055    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:27.182894 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:27.182854    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d67d78b79-wlwsr"
Sep 11 12:57:27.183350 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:27.182931    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d67d78b79-wlwsr"
Sep 11 12:57:27.188558 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:27.188529    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d67d78b79-wlwsr"
Sep 11 12:57:27.234685 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:27.234662    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d67d78b79-wlwsr"
Sep 11 12:57:27.236178 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:27.236151    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:27.279552 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:27.279519    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66657d8687-z7czd"]
Sep 11 12:57:27.305131 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:27.304898    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:27.637505 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:27.637464    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:27.831064 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:27.831025    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:28.057773 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:28.057735    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:28.137755 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:28.137698    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:28.577213 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:28.577182    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:28.647688 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:28.647654    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:32.251062 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:32.251030    2547 generic.go:356] "Generic (PLEG): container finished" podID="4bdb12c4-f42d-4cc2-aa3f-26e5294459f6" containerID="eadedb1f881cbc1b044930ac1ec30f868076f13ba6297d75b8bb45ca0d800de0" exitCode=0
Sep 11 12:57:32.251447 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:32.251100    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-m29lj" event={"ID":"4bdb12c4-f42d-4cc2-aa3f-26e5294459f6","Type":"ContainerDied","Data":"eadedb1f881cbc1b044930ac1ec30f868076f13ba6297d75b8bb45ca0d800de0"}
Sep 11 12:57:32.251447 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:32.251423    2547 scope.go:117] "RemoveContainer" containerID="eadedb1f881cbc1b044930ac1ec30f868076f13ba6297d75b8bb45ca0d800de0"
Sep 11 12:57:33.257446 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:33.257413    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-m29lj" event={"ID":"4bdb12c4-f42d-4cc2-aa3f-26e5294459f6","Type":"ContainerStarted","Data":"41aff05e772d75380c13c7e60b8bc317f19420fd85e73ef9c5e54e1ed9d804ad"}
Sep 11 12:57:34.295167 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:34.295129    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:34.395415 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:34.395377    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:35.827448 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:35.827414    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:35.885602 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:35.885573    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:42.294589 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:42.294551    2547 generic.go:356] "Generic (PLEG): container finished" podID="1585ba00-5e8f-42ec-bcd3-a18167f281ea" containerID="dcc360e18353a76629c34a18b3679c4f1aa858bfc492fe77a9c83d070edf60bb" exitCode=0
Sep 11 12:57:42.294967 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:42.294629    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-6h8mp" event={"ID":"1585ba00-5e8f-42ec-bcd3-a18167f281ea","Type":"ContainerDied","Data":"dcc360e18353a76629c34a18b3679c4f1aa858bfc492fe77a9c83d070edf60bb"}
Sep 11 12:57:42.295020 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:42.295007    2547 scope.go:117] "RemoveContainer" containerID="dcc360e18353a76629c34a18b3679c4f1aa858bfc492fe77a9c83d070edf60bb"
Sep 11 12:57:43.299483 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:43.299448    2547 generic.go:356] "Generic (PLEG): container finished" podID="f56aabf6-4343-4870-9aaf-1bf4745b686e" containerID="15f74967fa25d0215fd1532a42ff9148e8a4607eb5766d07d2c1d52300c98425" exitCode=0
Sep 11 12:57:43.299978 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:43.299526    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-nml2c" event={"ID":"f56aabf6-4343-4870-9aaf-1bf4745b686e","Type":"ContainerDied","Data":"15f74967fa25d0215fd1532a42ff9148e8a4607eb5766d07d2c1d52300c98425"}
Sep 11 12:57:43.299978 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:43.299920    2547 scope.go:117] "RemoveContainer" containerID="15f74967fa25d0215fd1532a42ff9148e8a4607eb5766d07d2c1d52300c98425"
Sep 11 12:57:43.301565 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:43.301536    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-6h8mp" event={"ID":"1585ba00-5e8f-42ec-bcd3-a18167f281ea","Type":"ContainerStarted","Data":"7a4b137b335a1defb931fccd1d83ac6527a96f5123dcd1138a295df2e31c8db2"}
Sep 11 12:57:43.725154 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:43.725113    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:43.841172 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:43.841131    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:44.307014 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:44.306978    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-nml2c" event={"ID":"f56aabf6-4343-4870-9aaf-1bf4745b686e","Type":"ContainerStarted","Data":"cc09396cd6bb6f9fcbb7fd002d497d3000df43482029c7237b8ca1cc0fdf5511"}
Sep 11 12:57:52.306441 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:52.306379    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66657d8687-z7czd" podUID="3e99cd6d-e9a0-4473-98ef-23d411396dd8" containerName="console" containerID="cri-o://9b90c0a23ddab19a8c7554ab0f902646e1a0311ee6ab0ae1c5fda212092ca10b" gracePeriod=15
Sep 11 12:57:52.547407 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:52.547383    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66657d8687-z7czd"
Sep 11 12:57:52.623397 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:52.623316    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e99cd6d-e9a0-4473-98ef-23d411396dd8-console-config\") pod \"3e99cd6d-e9a0-4473-98ef-23d411396dd8\" (UID: \"3e99cd6d-e9a0-4473-98ef-23d411396dd8\") "
Sep 11 12:57:52.623397 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:52.623376    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e99cd6d-e9a0-4473-98ef-23d411396dd8-console-serving-cert\") pod \"3e99cd6d-e9a0-4473-98ef-23d411396dd8\" (UID: \"3e99cd6d-e9a0-4473-98ef-23d411396dd8\") "
Sep 11 12:57:52.623621 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:52.623415    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e99cd6d-e9a0-4473-98ef-23d411396dd8-console-oauth-config\") pod \"3e99cd6d-e9a0-4473-98ef-23d411396dd8\" (UID: \"3e99cd6d-e9a0-4473-98ef-23d411396dd8\") "
Sep 11 12:57:52.623621 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:52.623454    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e99cd6d-e9a0-4473-98ef-23d411396dd8-oauth-serving-cert\") pod \"3e99cd6d-e9a0-4473-98ef-23d411396dd8\" (UID: \"3e99cd6d-e9a0-4473-98ef-23d411396dd8\") "
Sep 11 12:57:52.623621 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:52.623484    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e99cd6d-e9a0-4473-98ef-23d411396dd8-service-ca\") pod \"3e99cd6d-e9a0-4473-98ef-23d411396dd8\" (UID: \"3e99cd6d-e9a0-4473-98ef-23d411396dd8\") "
Sep 11 12:57:52.623621 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:52.623560    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4lzt\" (UniqueName: \"kubernetes.io/projected/3e99cd6d-e9a0-4473-98ef-23d411396dd8-kube-api-access-q4lzt\") pod \"3e99cd6d-e9a0-4473-98ef-23d411396dd8\" (UID: \"3e99cd6d-e9a0-4473-98ef-23d411396dd8\") "
Sep 11 12:57:52.623855 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:52.623821    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e99cd6d-e9a0-4473-98ef-23d411396dd8-console-config" (OuterVolumeSpecName: "console-config") pod "3e99cd6d-e9a0-4473-98ef-23d411396dd8" (UID: "3e99cd6d-e9a0-4473-98ef-23d411396dd8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:57:52.624010 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:52.623972    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e99cd6d-e9a0-4473-98ef-23d411396dd8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3e99cd6d-e9a0-4473-98ef-23d411396dd8" (UID: "3e99cd6d-e9a0-4473-98ef-23d411396dd8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:57:52.624010 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:52.623995    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e99cd6d-e9a0-4473-98ef-23d411396dd8-service-ca" (OuterVolumeSpecName: "service-ca") pod "3e99cd6d-e9a0-4473-98ef-23d411396dd8" (UID: "3e99cd6d-e9a0-4473-98ef-23d411396dd8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:57:52.625875 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:52.625854    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e99cd6d-e9a0-4473-98ef-23d411396dd8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3e99cd6d-e9a0-4473-98ef-23d411396dd8" (UID: "3e99cd6d-e9a0-4473-98ef-23d411396dd8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:57:52.625952 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:52.625891    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e99cd6d-e9a0-4473-98ef-23d411396dd8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3e99cd6d-e9a0-4473-98ef-23d411396dd8" (UID: "3e99cd6d-e9a0-4473-98ef-23d411396dd8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:57:52.626002 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:52.625984    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e99cd6d-e9a0-4473-98ef-23d411396dd8-kube-api-access-q4lzt" (OuterVolumeSpecName: "kube-api-access-q4lzt") pod "3e99cd6d-e9a0-4473-98ef-23d411396dd8" (UID: "3e99cd6d-e9a0-4473-98ef-23d411396dd8"). InnerVolumeSpecName "kube-api-access-q4lzt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:57:52.724309 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:52.724272    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4lzt\" (UniqueName: \"kubernetes.io/projected/3e99cd6d-e9a0-4473-98ef-23d411396dd8-kube-api-access-q4lzt\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 12:57:52.724309 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:52.724302    2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e99cd6d-e9a0-4473-98ef-23d411396dd8-console-config\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 12:57:52.724309 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:52.724312    2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e99cd6d-e9a0-4473-98ef-23d411396dd8-console-serving-cert\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 12:57:52.724550 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:52.724320    2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e99cd6d-e9a0-4473-98ef-23d411396dd8-console-oauth-config\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 12:57:52.724550 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:52.724335    2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e99cd6d-e9a0-4473-98ef-23d411396dd8-oauth-serving-cert\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 12:57:52.724550 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:52.724345    2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e99cd6d-e9a0-4473-98ef-23d411396dd8-service-ca\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 12:57:53.341978 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:53.341943    2547 generic.go:356] "Generic (PLEG): container finished" podID="3e99cd6d-e9a0-4473-98ef-23d411396dd8" containerID="9b90c0a23ddab19a8c7554ab0f902646e1a0311ee6ab0ae1c5fda212092ca10b" exitCode=0
Sep 11 12:57:53.342409 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:53.341990    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66657d8687-z7czd"
Sep 11 12:57:53.342409 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:53.342029    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66657d8687-z7czd" event={"ID":"3e99cd6d-e9a0-4473-98ef-23d411396dd8","Type":"ContainerDied","Data":"9b90c0a23ddab19a8c7554ab0f902646e1a0311ee6ab0ae1c5fda212092ca10b"}
Sep 11 12:57:53.342409 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:53.342085    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66657d8687-z7czd" event={"ID":"3e99cd6d-e9a0-4473-98ef-23d411396dd8","Type":"ContainerDied","Data":"f8cc451c40c4c0f1dd9ad45432557ba6e30cb9b9e50f6f7c3b9c0c779140e889"}
Sep 11 12:57:53.342409 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:53.342105    2547 scope.go:117] "RemoveContainer" containerID="9b90c0a23ddab19a8c7554ab0f902646e1a0311ee6ab0ae1c5fda212092ca10b"
Sep 11 12:57:53.350924 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:53.350907    2547 scope.go:117] "RemoveContainer" containerID="9b90c0a23ddab19a8c7554ab0f902646e1a0311ee6ab0ae1c5fda212092ca10b"
Sep 11 12:57:53.351201 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:57:53.351183    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b90c0a23ddab19a8c7554ab0f902646e1a0311ee6ab0ae1c5fda212092ca10b\": container with ID starting with 9b90c0a23ddab19a8c7554ab0f902646e1a0311ee6ab0ae1c5fda212092ca10b not found: ID does not exist" containerID="9b90c0a23ddab19a8c7554ab0f902646e1a0311ee6ab0ae1c5fda212092ca10b"
Sep 11 12:57:53.351261 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:53.351215    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b90c0a23ddab19a8c7554ab0f902646e1a0311ee6ab0ae1c5fda212092ca10b"} err="failed to get container status \"9b90c0a23ddab19a8c7554ab0f902646e1a0311ee6ab0ae1c5fda212092ca10b\": rpc error: code = NotFound desc = could not find container \"9b90c0a23ddab19a8c7554ab0f902646e1a0311ee6ab0ae1c5fda212092ca10b\": container with ID starting with 9b90c0a23ddab19a8c7554ab0f902646e1a0311ee6ab0ae1c5fda212092ca10b not found: ID does not exist"
Sep 11 12:57:53.361687 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:53.361664    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66657d8687-z7czd"]
Sep 11 12:57:53.365864 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:53.365841    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66657d8687-z7czd"]
Sep 11 12:57:53.662919 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:57:53.662840    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e99cd6d-e9a0-4473-98ef-23d411396dd8" path="/var/lib/kubelet/pods/3e99cd6d-e9a0-4473-98ef-23d411396dd8/volumes"
Sep 11 12:58:17.901402 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:17.901351    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:17.989221 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:17.989185    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:24.077936 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:24.077897    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:27.773172 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:27.773086    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7598c74b6d-dqdrx"]
Sep 11 12:58:27.774112 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:27.774082    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e99cd6d-e9a0-4473-98ef-23d411396dd8" containerName="console"
Sep 11 12:58:27.774112 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:27.774111    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e99cd6d-e9a0-4473-98ef-23d411396dd8" containerName="console"
Sep 11 12:58:27.774305 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:27.774169    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e99cd6d-e9a0-4473-98ef-23d411396dd8" containerName="console"
Sep 11 12:58:27.777026 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:27.777008    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7598c74b6d-dqdrx"
Sep 11 12:58:27.793223 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:27.793184    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7598c74b6d-dqdrx"]
Sep 11 12:58:27.822561 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:27.822527    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b408ad1-6764-44b0-8b46-e2067234f398-trusted-ca-bundle\") pod \"console-7598c74b6d-dqdrx\" (UID: \"3b408ad1-6764-44b0-8b46-e2067234f398\") " pod="openshift-console/console-7598c74b6d-dqdrx"
Sep 11 12:58:27.822788 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:27.822604    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b408ad1-6764-44b0-8b46-e2067234f398-console-serving-cert\") pod \"console-7598c74b6d-dqdrx\" (UID: \"3b408ad1-6764-44b0-8b46-e2067234f398\") " pod="openshift-console/console-7598c74b6d-dqdrx"
Sep 11 12:58:27.822788 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:27.822629    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw9nf\" (UniqueName: \"kubernetes.io/projected/3b408ad1-6764-44b0-8b46-e2067234f398-kube-api-access-nw9nf\") pod \"console-7598c74b6d-dqdrx\" (UID: \"3b408ad1-6764-44b0-8b46-e2067234f398\") " pod="openshift-console/console-7598c74b6d-dqdrx"
Sep 11 12:58:27.822788 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:27.822651    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b408ad1-6764-44b0-8b46-e2067234f398-console-oauth-config\") pod \"console-7598c74b6d-dqdrx\" (UID: \"3b408ad1-6764-44b0-8b46-e2067234f398\") " pod="openshift-console/console-7598c74b6d-dqdrx"
Sep 11 12:58:27.822788 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:27.822680    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b408ad1-6764-44b0-8b46-e2067234f398-console-config\") pod \"console-7598c74b6d-dqdrx\" (UID: \"3b408ad1-6764-44b0-8b46-e2067234f398\") " pod="openshift-console/console-7598c74b6d-dqdrx"
Sep 11 12:58:27.822788 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:27.822741    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b408ad1-6764-44b0-8b46-e2067234f398-oauth-serving-cert\") pod \"console-7598c74b6d-dqdrx\" (UID: \"3b408ad1-6764-44b0-8b46-e2067234f398\") " pod="openshift-console/console-7598c74b6d-dqdrx"
Sep 11 12:58:27.822788 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:27.822777    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b408ad1-6764-44b0-8b46-e2067234f398-service-ca\") pod \"console-7598c74b6d-dqdrx\" (UID: \"3b408ad1-6764-44b0-8b46-e2067234f398\") " pod="openshift-console/console-7598c74b6d-dqdrx"
Sep 11 12:58:27.837682 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:27.837646    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:27.924020 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:27.923986    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b408ad1-6764-44b0-8b46-e2067234f398-trusted-ca-bundle\") pod \"console-7598c74b6d-dqdrx\" (UID: \"3b408ad1-6764-44b0-8b46-e2067234f398\") " pod="openshift-console/console-7598c74b6d-dqdrx"
Sep 11 12:58:27.924184 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:27.924040    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b408ad1-6764-44b0-8b46-e2067234f398-console-serving-cert\") pod \"console-7598c74b6d-dqdrx\" (UID: \"3b408ad1-6764-44b0-8b46-e2067234f398\") " pod="openshift-console/console-7598c74b6d-dqdrx"
Sep 11 12:58:27.924184 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:27.924089    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw9nf\" (UniqueName: \"kubernetes.io/projected/3b408ad1-6764-44b0-8b46-e2067234f398-kube-api-access-nw9nf\") pod \"console-7598c74b6d-dqdrx\" (UID: \"3b408ad1-6764-44b0-8b46-e2067234f398\") " pod="openshift-console/console-7598c74b6d-dqdrx"
Sep 11 12:58:27.924184 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:27.924108    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b408ad1-6764-44b0-8b46-e2067234f398-console-oauth-config\") pod \"console-7598c74b6d-dqdrx\" (UID: \"3b408ad1-6764-44b0-8b46-e2067234f398\") " pod="openshift-console/console-7598c74b6d-dqdrx"
Sep 11 12:58:27.924184 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:27.924142    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b408ad1-6764-44b0-8b46-e2067234f398-console-config\") pod \"console-7598c74b6d-dqdrx\" (UID: \"3b408ad1-6764-44b0-8b46-e2067234f398\") " pod="openshift-console/console-7598c74b6d-dqdrx"
Sep 11 12:58:27.924356 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:27.924304    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b408ad1-6764-44b0-8b46-e2067234f398-oauth-serving-cert\") pod \"console-7598c74b6d-dqdrx\" (UID: \"3b408ad1-6764-44b0-8b46-e2067234f398\") " pod="openshift-console/console-7598c74b6d-dqdrx"
Sep 11 12:58:27.924412 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:27.924365    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b408ad1-6764-44b0-8b46-e2067234f398-service-ca\") pod \"console-7598c74b6d-dqdrx\" (UID: \"3b408ad1-6764-44b0-8b46-e2067234f398\") " pod="openshift-console/console-7598c74b6d-dqdrx"
Sep 11 12:58:27.924881 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:27.924853    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b408ad1-6764-44b0-8b46-e2067234f398-console-config\") pod \"console-7598c74b6d-dqdrx\" (UID: \"3b408ad1-6764-44b0-8b46-e2067234f398\") " pod="openshift-console/console-7598c74b6d-dqdrx"
Sep 11 12:58:27.925073 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:27.925055    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b408ad1-6764-44b0-8b46-e2067234f398-service-ca\") pod \"console-7598c74b6d-dqdrx\" (UID: \"3b408ad1-6764-44b0-8b46-e2067234f398\") " pod="openshift-console/console-7598c74b6d-dqdrx"
Sep 11 12:58:27.925211 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:27.925188    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b408ad1-6764-44b0-8b46-e2067234f398-oauth-serving-cert\") pod \"console-7598c74b6d-dqdrx\" (UID: \"3b408ad1-6764-44b0-8b46-e2067234f398\") " pod="openshift-console/console-7598c74b6d-dqdrx"
Sep 11 12:58:27.925272 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:27.925250    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b408ad1-6764-44b0-8b46-e2067234f398-trusted-ca-bundle\") pod \"console-7598c74b6d-dqdrx\" (UID: \"3b408ad1-6764-44b0-8b46-e2067234f398\") " pod="openshift-console/console-7598c74b6d-dqdrx"
Sep 11 12:58:27.926879 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:27.926857    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b408ad1-6764-44b0-8b46-e2067234f398-console-oauth-config\") pod \"console-7598c74b6d-dqdrx\" (UID: \"3b408ad1-6764-44b0-8b46-e2067234f398\") " pod="openshift-console/console-7598c74b6d-dqdrx"
Sep 11 12:58:27.926966 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:27.926918    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b408ad1-6764-44b0-8b46-e2067234f398-console-serving-cert\") pod \"console-7598c74b6d-dqdrx\" (UID: \"3b408ad1-6764-44b0-8b46-e2067234f398\") " pod="openshift-console/console-7598c74b6d-dqdrx"
Sep 11 12:58:27.934766 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:27.934745    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw9nf\" (UniqueName: \"kubernetes.io/projected/3b408ad1-6764-44b0-8b46-e2067234f398-kube-api-access-nw9nf\") pod \"console-7598c74b6d-dqdrx\" (UID: \"3b408ad1-6764-44b0-8b46-e2067234f398\") " pod="openshift-console/console-7598c74b6d-dqdrx"
Sep 11 12:58:27.973154 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:27.973119    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:28.073995 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:28.073954    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:28.093028 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:28.092992    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7598c74b6d-dqdrx"
Sep 11 12:58:28.371580 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:28.371555    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7598c74b6d-dqdrx"]
Sep 11 12:58:28.373895 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:58:28.373866    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b408ad1_6764_44b0_8b46_e2067234f398.slice/crio-4ab3e94d238db7aba558fff4a23a2a8e6d50be46ec4a082c44480b4d9d0173f1 WatchSource:0}: Error finding container 4ab3e94d238db7aba558fff4a23a2a8e6d50be46ec4a082c44480b4d9d0173f1: Status 404 returned error can't find the container with id 4ab3e94d238db7aba558fff4a23a2a8e6d50be46ec4a082c44480b4d9d0173f1
Sep 11 12:58:28.478591 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:28.478555    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7598c74b6d-dqdrx" event={"ID":"3b408ad1-6764-44b0-8b46-e2067234f398","Type":"ContainerStarted","Data":"696aba9828ed83ffc5f35b5893d1ad6f858fe729fc7722b764a2a5c691ac2465"}
Sep 11 12:58:28.478789 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:28.478611    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7598c74b6d-dqdrx" event={"ID":"3b408ad1-6764-44b0-8b46-e2067234f398","Type":"ContainerStarted","Data":"4ab3e94d238db7aba558fff4a23a2a8e6d50be46ec4a082c44480b4d9d0173f1"}
Sep 11 12:58:28.504262 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:28.504212    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7598c74b6d-dqdrx" podStartSLOduration=1.5041945860000001 podStartE2EDuration="1.504194586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:58:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:58:28.502124447 +0000 UTC m=+175.363598635" watchObservedRunningTime="2026-09-11 12:58:28.504194586 +0000 UTC m=+175.365668774"
Sep 11 12:58:28.585917 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:28.585881    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:38.093479 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:38.093428    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7598c74b6d-dqdrx"
Sep 11 12:58:38.093914 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:38.093502    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7598c74b6d-dqdrx"
Sep 11 12:58:38.098429 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:38.098401    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7598c74b6d-dqdrx"
Sep 11 12:58:38.522525 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:38.522450    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7598c74b6d-dqdrx"
Sep 11 12:58:38.581123 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:38.581088    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d67d78b79-wlwsr"]
Sep 11 12:58:38.716047 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:38.716005    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:38.814953 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:38.814921    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:38.942547 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:58:38.942517    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:03.603240 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:03.603190    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d67d78b79-wlwsr" podUID="3656f1b6-75ef-46bc-9a9e-6dde502a0e81" containerName="console" containerID="cri-o://82ff639b1da4b44f80bc8de90d1b400a7d42b0908213f0c6d42fa151fa9f5714" gracePeriod=15
Sep 11 12:59:03.842491 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:03.842463    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d67d78b79-wlwsr"
Sep 11 12:59:03.923881 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:03.923776    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-console-config\") pod \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\" (UID: \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\") "
Sep 11 12:59:03.923881 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:03.923807    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-service-ca\") pod \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\" (UID: \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\") "
Sep 11 12:59:03.923881 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:03.923868    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-console-serving-cert\") pod \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\" (UID: \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\") "
Sep 11 12:59:03.924200 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:03.923895    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-console-oauth-config\") pod \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\" (UID: \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\") "
Sep 11 12:59:03.924200 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:03.923923    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69bx6\" (UniqueName: \"kubernetes.io/projected/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-kube-api-access-69bx6\") pod \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\" (UID: \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\") "
Sep 11 12:59:03.924200 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:03.923945    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-trusted-ca-bundle\") pod \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\" (UID: \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\") "
Sep 11 12:59:03.924200 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:03.923981    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-oauth-serving-cert\") pod \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\" (UID: \"3656f1b6-75ef-46bc-9a9e-6dde502a0e81\") "
Sep 11 12:59:03.924200 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:03.924183    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-console-config" (OuterVolumeSpecName: "console-config") pod "3656f1b6-75ef-46bc-9a9e-6dde502a0e81" (UID: "3656f1b6-75ef-46bc-9a9e-6dde502a0e81"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:59:03.924526 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:03.924234    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-service-ca" (OuterVolumeSpecName: "service-ca") pod "3656f1b6-75ef-46bc-9a9e-6dde502a0e81" (UID: "3656f1b6-75ef-46bc-9a9e-6dde502a0e81"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:59:03.924526 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:03.924479    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3656f1b6-75ef-46bc-9a9e-6dde502a0e81" (UID: "3656f1b6-75ef-46bc-9a9e-6dde502a0e81"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:59:03.924526 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:03.924520    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3656f1b6-75ef-46bc-9a9e-6dde502a0e81" (UID: "3656f1b6-75ef-46bc-9a9e-6dde502a0e81"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:59:03.926288 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:03.926264    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3656f1b6-75ef-46bc-9a9e-6dde502a0e81" (UID: "3656f1b6-75ef-46bc-9a9e-6dde502a0e81"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:59:03.926390 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:03.926301    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-kube-api-access-69bx6" (OuterVolumeSpecName: "kube-api-access-69bx6") pod "3656f1b6-75ef-46bc-9a9e-6dde502a0e81" (UID: "3656f1b6-75ef-46bc-9a9e-6dde502a0e81"). InnerVolumeSpecName "kube-api-access-69bx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:59:03.926535 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:03.926518    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3656f1b6-75ef-46bc-9a9e-6dde502a0e81" (UID: "3656f1b6-75ef-46bc-9a9e-6dde502a0e81"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:59:04.025017 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:04.024983    2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-console-serving-cert\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 12:59:04.025017 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:04.025008    2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-console-oauth-config\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 12:59:04.025017 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:04.025019    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69bx6\" (UniqueName: \"kubernetes.io/projected/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-kube-api-access-69bx6\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 12:59:04.025017 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:04.025028    2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-trusted-ca-bundle\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 12:59:04.025284 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:04.025037    2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-oauth-serving-cert\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 12:59:04.025284 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:04.025045    2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-console-config\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 12:59:04.025284 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:04.025053    2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3656f1b6-75ef-46bc-9a9e-6dde502a0e81-service-ca\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 12:59:04.618366 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:04.618334    2547 generic.go:356] "Generic (PLEG): container finished" podID="3656f1b6-75ef-46bc-9a9e-6dde502a0e81" containerID="82ff639b1da4b44f80bc8de90d1b400a7d42b0908213f0c6d42fa151fa9f5714" exitCode=0
Sep 11 12:59:04.618802 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:04.618376    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d67d78b79-wlwsr"
Sep 11 12:59:04.618802 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:04.618390    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d67d78b79-wlwsr" event={"ID":"3656f1b6-75ef-46bc-9a9e-6dde502a0e81","Type":"ContainerDied","Data":"82ff639b1da4b44f80bc8de90d1b400a7d42b0908213f0c6d42fa151fa9f5714"}
Sep 11 12:59:04.618802 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:04.618434    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d67d78b79-wlwsr" event={"ID":"3656f1b6-75ef-46bc-9a9e-6dde502a0e81","Type":"ContainerDied","Data":"69b2732931196df5c25f80838d4238cbf0424ce06eac37cd881df85f03cc464e"}
Sep 11 12:59:04.618802 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:04.618452    2547 scope.go:117] "RemoveContainer" containerID="82ff639b1da4b44f80bc8de90d1b400a7d42b0908213f0c6d42fa151fa9f5714"
Sep 11 12:59:04.627765 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:04.627731    2547 scope.go:117] "RemoveContainer" containerID="82ff639b1da4b44f80bc8de90d1b400a7d42b0908213f0c6d42fa151fa9f5714"
Sep 11 12:59:04.628044 ip-10-0-133-79 kubenswrapper[2547]: E0911 12:59:04.628023    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82ff639b1da4b44f80bc8de90d1b400a7d42b0908213f0c6d42fa151fa9f5714\": container with ID starting with 82ff639b1da4b44f80bc8de90d1b400a7d42b0908213f0c6d42fa151fa9f5714 not found: ID does not exist" containerID="82ff639b1da4b44f80bc8de90d1b400a7d42b0908213f0c6d42fa151fa9f5714"
Sep 11 12:59:04.628118 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:04.628053    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82ff639b1da4b44f80bc8de90d1b400a7d42b0908213f0c6d42fa151fa9f5714"} err="failed to get container status \"82ff639b1da4b44f80bc8de90d1b400a7d42b0908213f0c6d42fa151fa9f5714\": rpc error: code = NotFound desc = could not find container \"82ff639b1da4b44f80bc8de90d1b400a7d42b0908213f0c6d42fa151fa9f5714\": container with ID starting with 82ff639b1da4b44f80bc8de90d1b400a7d42b0908213f0c6d42fa151fa9f5714 not found: ID does not exist"
Sep 11 12:59:04.639658 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:04.639634    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d67d78b79-wlwsr"]
Sep 11 12:59:04.643107 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:04.643085    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d67d78b79-wlwsr"]
Sep 11 12:59:05.662504 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:05.662472    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3656f1b6-75ef-46bc-9a9e-6dde502a0e81" path="/var/lib/kubelet/pods/3656f1b6-75ef-46bc-9a9e-6dde502a0e81/volumes"
Sep 11 12:59:13.372593 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:13.372555    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:13.487928 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:13.487885    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:33.200279 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:33.200247    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:33.257111 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:33.257066    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:34.382145 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:34.382106    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:36.070055 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.070020    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b87575865-72br6"]
Sep 11 12:59:36.070475 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.070294    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3656f1b6-75ef-46bc-9a9e-6dde502a0e81" containerName="console"
Sep 11 12:59:36.070475 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.070306    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="3656f1b6-75ef-46bc-9a9e-6dde502a0e81" containerName="console"
Sep 11 12:59:36.070475 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.070370    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="3656f1b6-75ef-46bc-9a9e-6dde502a0e81" containerName="console"
Sep 11 12:59:36.074532 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.074496    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b87575865-72br6"
Sep 11 12:59:36.085208 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.084788    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b87575865-72br6"]
Sep 11 12:59:36.129734 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.129682    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:36.157220 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.157184    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-console-serving-cert\") pod \"console-6b87575865-72br6\" (UID: \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\") " pod="openshift-console/console-6b87575865-72br6"
Sep 11 12:59:36.157220 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.157219    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-oauth-serving-cert\") pod \"console-6b87575865-72br6\" (UID: \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\") " pod="openshift-console/console-6b87575865-72br6"
Sep 11 12:59:36.157427 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.157237    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-service-ca\") pod \"console-6b87575865-72br6\" (UID: \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\") " pod="openshift-console/console-6b87575865-72br6"
Sep 11 12:59:36.157427 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.157289    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-console-oauth-config\") pod \"console-6b87575865-72br6\" (UID: \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\") " pod="openshift-console/console-6b87575865-72br6"
Sep 11 12:59:36.157427 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.157323    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-trusted-ca-bundle\") pod \"console-6b87575865-72br6\" (UID: \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\") " pod="openshift-console/console-6b87575865-72br6"
Sep 11 12:59:36.157427 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.157375    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q4jr\" (UniqueName: \"kubernetes.io/projected/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-kube-api-access-8q4jr\") pod \"console-6b87575865-72br6\" (UID: \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\") " pod="openshift-console/console-6b87575865-72br6"
Sep 11 12:59:36.157427 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.157414    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-console-config\") pod \"console-6b87575865-72br6\" (UID: \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\") " pod="openshift-console/console-6b87575865-72br6"
Sep 11 12:59:36.184734 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.184680    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:36.258778 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.258739    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-console-oauth-config\") pod \"console-6b87575865-72br6\" (UID: \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\") " pod="openshift-console/console-6b87575865-72br6"
Sep 11 12:59:36.258778 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.258784    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-trusted-ca-bundle\") pod \"console-6b87575865-72br6\" (UID: \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\") " pod="openshift-console/console-6b87575865-72br6"
Sep 11 12:59:36.259129 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.258827    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q4jr\" (UniqueName: \"kubernetes.io/projected/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-kube-api-access-8q4jr\") pod \"console-6b87575865-72br6\" (UID: \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\") " pod="openshift-console/console-6b87575865-72br6"
Sep 11 12:59:36.259129 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.258869    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-console-config\") pod \"console-6b87575865-72br6\" (UID: \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\") " pod="openshift-console/console-6b87575865-72br6"
Sep 11 12:59:36.259129 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.258903    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-console-serving-cert\") pod \"console-6b87575865-72br6\" (UID: \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\") " pod="openshift-console/console-6b87575865-72br6"
Sep 11 12:59:36.259129 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.258920    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-oauth-serving-cert\") pod \"console-6b87575865-72br6\" (UID: \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\") " pod="openshift-console/console-6b87575865-72br6"
Sep 11 12:59:36.259129 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.258942    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-service-ca\") pod \"console-6b87575865-72br6\" (UID: \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\") " pod="openshift-console/console-6b87575865-72br6"
Sep 11 12:59:36.259987 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.259957    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-console-config\") pod \"console-6b87575865-72br6\" (UID: \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\") " pod="openshift-console/console-6b87575865-72br6"
Sep 11 12:59:36.260110 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.259957    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-service-ca\") pod \"console-6b87575865-72br6\" (UID: \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\") " pod="openshift-console/console-6b87575865-72br6"
Sep 11 12:59:36.260110 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.260085    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-oauth-serving-cert\") pod \"console-6b87575865-72br6\" (UID: \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\") " pod="openshift-console/console-6b87575865-72br6"
Sep 11 12:59:36.260192 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.260162    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-trusted-ca-bundle\") pod \"console-6b87575865-72br6\" (UID: \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\") " pod="openshift-console/console-6b87575865-72br6"
Sep 11 12:59:36.261536 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.261502    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-console-serving-cert\") pod \"console-6b87575865-72br6\" (UID: \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\") " pod="openshift-console/console-6b87575865-72br6"
Sep 11 12:59:36.261536 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.261527    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-console-oauth-config\") pod \"console-6b87575865-72br6\" (UID: \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\") " pod="openshift-console/console-6b87575865-72br6"
Sep 11 12:59:36.266616 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.266590    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q4jr\" (UniqueName: \"kubernetes.io/projected/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-kube-api-access-8q4jr\") pod \"console-6b87575865-72br6\" (UID: \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\") " pod="openshift-console/console-6b87575865-72br6"
Sep 11 12:59:36.268698 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.268673    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:36.330254 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.330162    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:36.385779 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.385702    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b87575865-72br6"
Sep 11 12:59:36.656338 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.656262    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b87575865-72br6"]
Sep 11 12:59:36.659123 ip-10-0-133-79 kubenswrapper[2547]: W0911 12:59:36.659094    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12daf3d9_4f01_4ff9_b31d_cfc5294797ac.slice/crio-03f3bea46819e9ed3263f163bc160f1326fb0b69c701757e1a14c4d93ee83153 WatchSource:0}: Error finding container 03f3bea46819e9ed3263f163bc160f1326fb0b69c701757e1a14c4d93ee83153: Status 404 returned error can't find the container with id 03f3bea46819e9ed3263f163bc160f1326fb0b69c701757e1a14c4d93ee83153
Sep 11 12:59:36.741123 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.740637    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b87575865-72br6" event={"ID":"12daf3d9-4f01-4ff9-b31d-cfc5294797ac","Type":"ContainerStarted","Data":"2f52d218ec74eddd8d99455a1c177407acbe775c692c51c5a7a72aeab6a7155f"}
Sep 11 12:59:36.741123 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.740700    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b87575865-72br6" event={"ID":"12daf3d9-4f01-4ff9-b31d-cfc5294797ac","Type":"ContainerStarted","Data":"03f3bea46819e9ed3263f163bc160f1326fb0b69c701757e1a14c4d93ee83153"}
Sep 11 12:59:36.758772 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.758697    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b87575865-72br6" podStartSLOduration=0.758679182 podStartE2EDuration="758.679182ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:59:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:59:36.756914048 +0000 UTC m=+243.618388260" watchObservedRunningTime="2026-09-11 12:59:36.758679182 +0000 UTC m=+243.620153369"
Sep 11 12:59:36.895455 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.895415    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:36.951476 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:36.951394    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:45.201967 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:45.201925    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:45.271165 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:45.271120    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:46.386206 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:46.386172    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b87575865-72br6"
Sep 11 12:59:46.386648 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:46.386230    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b87575865-72br6"
Sep 11 12:59:46.391304 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:46.391281    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b87575865-72br6"
Sep 11 12:59:46.783331 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:46.783252    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b87575865-72br6"
Sep 11 12:59:46.828380 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:46.828341    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7598c74b6d-dqdrx"]
Sep 11 12:59:46.931351 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:46.931323    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:46.999230 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:46.999197    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:49.305099 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:49.305049    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:49.408767 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:49.408732    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:49.509018 ip-10-0-133-79 kubenswrapper[2547]: I0911 12:59:49.508984    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:08.685343 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:08.685262    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:08.778757 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:08.778707    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:09.408460 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:09.408426    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp"]
Sep 11 13:00:09.411901 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:09.411884    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp"
Sep 11 13:00:09.414252 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:09.414231    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 13:00:09.414346 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:09.414276    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 13:00:09.414346 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:09.414300    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pmvq6\""
Sep 11 13:00:09.420860 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:09.420839    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp"]
Sep 11 13:00:09.528743 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:09.528681    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56d5def1-17e2-4527-9908-c55d34a6107d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp\" (UID: \"56d5def1-17e2-4527-9908-c55d34a6107d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp"
Sep 11 13:00:09.528956 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:09.528825    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56d5def1-17e2-4527-9908-c55d34a6107d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp\" (UID: \"56d5def1-17e2-4527-9908-c55d34a6107d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp"
Sep 11 13:00:09.528956 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:09.528869    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbxgt\" (UniqueName: \"kubernetes.io/projected/56d5def1-17e2-4527-9908-c55d34a6107d-kube-api-access-nbxgt\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp\" (UID: \"56d5def1-17e2-4527-9908-c55d34a6107d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp"
Sep 11 13:00:09.629793 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:09.629755    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56d5def1-17e2-4527-9908-c55d34a6107d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp\" (UID: \"56d5def1-17e2-4527-9908-c55d34a6107d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp"
Sep 11 13:00:09.629793 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:09.629794    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbxgt\" (UniqueName: \"kubernetes.io/projected/56d5def1-17e2-4527-9908-c55d34a6107d-kube-api-access-nbxgt\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp\" (UID: \"56d5def1-17e2-4527-9908-c55d34a6107d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp"
Sep 11 13:00:09.630045 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:09.629837    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56d5def1-17e2-4527-9908-c55d34a6107d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp\" (UID: \"56d5def1-17e2-4527-9908-c55d34a6107d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp"
Sep 11 13:00:09.630163 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:09.630145    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56d5def1-17e2-4527-9908-c55d34a6107d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp\" (UID: \"56d5def1-17e2-4527-9908-c55d34a6107d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp"
Sep 11 13:00:09.630229 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:09.630169    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56d5def1-17e2-4527-9908-c55d34a6107d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp\" (UID: \"56d5def1-17e2-4527-9908-c55d34a6107d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp"
Sep 11 13:00:09.637773 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:09.637743    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbxgt\" (UniqueName: \"kubernetes.io/projected/56d5def1-17e2-4527-9908-c55d34a6107d-kube-api-access-nbxgt\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp\" (UID: \"56d5def1-17e2-4527-9908-c55d34a6107d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp"
Sep 11 13:00:09.722497 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:09.722415    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp"
Sep 11 13:00:09.991854 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:09.991830    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp"]
Sep 11 13:00:09.994429 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:00:09.994404    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d5def1_17e2_4527_9908_c55d34a6107d.slice/crio-29482e33e8872132e8eb39c36830f3759a52547cbb7f7de88fb5507044ff2b2e WatchSource:0}: Error finding container 29482e33e8872132e8eb39c36830f3759a52547cbb7f7de88fb5507044ff2b2e: Status 404 returned error can't find the container with id 29482e33e8872132e8eb39c36830f3759a52547cbb7f7de88fb5507044ff2b2e
Sep 11 13:00:10.869251 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:10.869214    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp" event={"ID":"56d5def1-17e2-4527-9908-c55d34a6107d","Type":"ContainerStarted","Data":"29482e33e8872132e8eb39c36830f3759a52547cbb7f7de88fb5507044ff2b2e"}
Sep 11 13:00:11.851823 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:11.851741    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7598c74b6d-dqdrx" podUID="3b408ad1-6764-44b0-8b46-e2067234f398" containerName="console" containerID="cri-o://696aba9828ed83ffc5f35b5893d1ad6f858fe729fc7722b764a2a5c691ac2465" gracePeriod=15
Sep 11 13:00:12.124912 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:12.124877    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7598c74b6d-dqdrx"
Sep 11 13:00:12.253427 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:12.253391    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b408ad1-6764-44b0-8b46-e2067234f398-console-oauth-config\") pod \"3b408ad1-6764-44b0-8b46-e2067234f398\" (UID: \"3b408ad1-6764-44b0-8b46-e2067234f398\") "
Sep 11 13:00:12.253613 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:12.253479    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nw9nf\" (UniqueName: \"kubernetes.io/projected/3b408ad1-6764-44b0-8b46-e2067234f398-kube-api-access-nw9nf\") pod \"3b408ad1-6764-44b0-8b46-e2067234f398\" (UID: \"3b408ad1-6764-44b0-8b46-e2067234f398\") "
Sep 11 13:00:12.253613 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:12.253525    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b408ad1-6764-44b0-8b46-e2067234f398-console-serving-cert\") pod \"3b408ad1-6764-44b0-8b46-e2067234f398\" (UID: \"3b408ad1-6764-44b0-8b46-e2067234f398\") "
Sep 11 13:00:12.253754 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:12.253637    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b408ad1-6764-44b0-8b46-e2067234f398-trusted-ca-bundle\") pod \"3b408ad1-6764-44b0-8b46-e2067234f398\" (UID: \"3b408ad1-6764-44b0-8b46-e2067234f398\") "
Sep 11 13:00:12.253754 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:12.253694    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b408ad1-6764-44b0-8b46-e2067234f398-console-config\") pod \"3b408ad1-6764-44b0-8b46-e2067234f398\" (UID: \"3b408ad1-6764-44b0-8b46-e2067234f398\") "
Sep 11 13:00:12.253754 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:12.253741    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b408ad1-6764-44b0-8b46-e2067234f398-oauth-serving-cert\") pod \"3b408ad1-6764-44b0-8b46-e2067234f398\" (UID: \"3b408ad1-6764-44b0-8b46-e2067234f398\") "
Sep 11 13:00:12.253915 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:12.253775    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b408ad1-6764-44b0-8b46-e2067234f398-service-ca\") pod \"3b408ad1-6764-44b0-8b46-e2067234f398\" (UID: \"3b408ad1-6764-44b0-8b46-e2067234f398\") "
Sep 11 13:00:12.254326 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:12.254294    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b408ad1-6764-44b0-8b46-e2067234f398-console-config" (OuterVolumeSpecName: "console-config") pod "3b408ad1-6764-44b0-8b46-e2067234f398" (UID: "3b408ad1-6764-44b0-8b46-e2067234f398"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:00:12.254326 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:12.254307    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b408ad1-6764-44b0-8b46-e2067234f398-service-ca" (OuterVolumeSpecName: "service-ca") pod "3b408ad1-6764-44b0-8b46-e2067234f398" (UID: "3b408ad1-6764-44b0-8b46-e2067234f398"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:00:12.254540 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:12.254431    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b408ad1-6764-44b0-8b46-e2067234f398-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3b408ad1-6764-44b0-8b46-e2067234f398" (UID: "3b408ad1-6764-44b0-8b46-e2067234f398"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:00:12.254540 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:12.254471    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b408ad1-6764-44b0-8b46-e2067234f398-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3b408ad1-6764-44b0-8b46-e2067234f398" (UID: "3b408ad1-6764-44b0-8b46-e2067234f398"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:00:12.256101 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:12.256056    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b408ad1-6764-44b0-8b46-e2067234f398-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3b408ad1-6764-44b0-8b46-e2067234f398" (UID: "3b408ad1-6764-44b0-8b46-e2067234f398"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:00:12.256353 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:12.256323    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b408ad1-6764-44b0-8b46-e2067234f398-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3b408ad1-6764-44b0-8b46-e2067234f398" (UID: "3b408ad1-6764-44b0-8b46-e2067234f398"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:00:12.256582 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:12.256561    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b408ad1-6764-44b0-8b46-e2067234f398-kube-api-access-nw9nf" (OuterVolumeSpecName: "kube-api-access-nw9nf") pod "3b408ad1-6764-44b0-8b46-e2067234f398" (UID: "3b408ad1-6764-44b0-8b46-e2067234f398"). InnerVolumeSpecName "kube-api-access-nw9nf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:00:12.354543 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:12.354468    2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b408ad1-6764-44b0-8b46-e2067234f398-trusted-ca-bundle\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:00:12.354543 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:12.354497    2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b408ad1-6764-44b0-8b46-e2067234f398-console-config\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:00:12.354543 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:12.354506    2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b408ad1-6764-44b0-8b46-e2067234f398-oauth-serving-cert\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:00:12.354543 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:12.354515    2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b408ad1-6764-44b0-8b46-e2067234f398-service-ca\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:00:12.354543 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:12.354523    2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b408ad1-6764-44b0-8b46-e2067234f398-console-oauth-config\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:00:12.354543 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:12.354531    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nw9nf\" (UniqueName: \"kubernetes.io/projected/3b408ad1-6764-44b0-8b46-e2067234f398-kube-api-access-nw9nf\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:00:12.354543 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:12.354539    2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b408ad1-6764-44b0-8b46-e2067234f398-console-serving-cert\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:00:12.879668 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:12.879636    2547 generic.go:356] "Generic (PLEG): container finished" podID="3b408ad1-6764-44b0-8b46-e2067234f398" containerID="696aba9828ed83ffc5f35b5893d1ad6f858fe729fc7722b764a2a5c691ac2465" exitCode=0
Sep 11 13:00:12.879898 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:12.879685    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7598c74b6d-dqdrx"
Sep 11 13:00:12.879898 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:12.879748    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7598c74b6d-dqdrx" event={"ID":"3b408ad1-6764-44b0-8b46-e2067234f398","Type":"ContainerDied","Data":"696aba9828ed83ffc5f35b5893d1ad6f858fe729fc7722b764a2a5c691ac2465"}
Sep 11 13:00:12.879898 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:12.879812    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7598c74b6d-dqdrx" event={"ID":"3b408ad1-6764-44b0-8b46-e2067234f398","Type":"ContainerDied","Data":"4ab3e94d238db7aba558fff4a23a2a8e6d50be46ec4a082c44480b4d9d0173f1"}
Sep 11 13:00:12.879898 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:12.879844    2547 scope.go:117] "RemoveContainer" containerID="696aba9828ed83ffc5f35b5893d1ad6f858fe729fc7722b764a2a5c691ac2465"
Sep 11 13:00:12.890652 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:12.890635    2547 scope.go:117] "RemoveContainer" containerID="696aba9828ed83ffc5f35b5893d1ad6f858fe729fc7722b764a2a5c691ac2465"
Sep 11 13:00:12.890992 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:00:12.890967    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"696aba9828ed83ffc5f35b5893d1ad6f858fe729fc7722b764a2a5c691ac2465\": container with ID starting with 696aba9828ed83ffc5f35b5893d1ad6f858fe729fc7722b764a2a5c691ac2465 not found: ID does not exist" containerID="696aba9828ed83ffc5f35b5893d1ad6f858fe729fc7722b764a2a5c691ac2465"
Sep 11 13:00:12.891073 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:12.891007    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"696aba9828ed83ffc5f35b5893d1ad6f858fe729fc7722b764a2a5c691ac2465"} err="failed to get container status \"696aba9828ed83ffc5f35b5893d1ad6f858fe729fc7722b764a2a5c691ac2465\": rpc error: code = NotFound desc = could not find container \"696aba9828ed83ffc5f35b5893d1ad6f858fe729fc7722b764a2a5c691ac2465\": container with ID starting with 696aba9828ed83ffc5f35b5893d1ad6f858fe729fc7722b764a2a5c691ac2465 not found: ID does not exist"
Sep 11 13:00:12.902815 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:12.902794    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7598c74b6d-dqdrx"]
Sep 11 13:00:12.906344 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:12.906315    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7598c74b6d-dqdrx"]
Sep 11 13:00:13.665025 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:13.664986    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b408ad1-6764-44b0-8b46-e2067234f398" path="/var/lib/kubelet/pods/3b408ad1-6764-44b0-8b46-e2067234f398/volumes"
Sep 11 13:00:15.900433 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:15.900396    2547 generic.go:356] "Generic (PLEG): container finished" podID="56d5def1-17e2-4527-9908-c55d34a6107d" containerID="1dc018384e0afa256ebeafb736c46b8b602ce6861b2b3d688f1716a932938019" exitCode=0
Sep 11 13:00:15.900848 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:15.900486    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp" event={"ID":"56d5def1-17e2-4527-9908-c55d34a6107d","Type":"ContainerDied","Data":"1dc018384e0afa256ebeafb736c46b8b602ce6861b2b3d688f1716a932938019"}
Sep 11 13:00:18.914784 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:18.914741    2547 generic.go:356] "Generic (PLEG): container finished" podID="56d5def1-17e2-4527-9908-c55d34a6107d" containerID="9bc097c09a5e5cfbb0e633dcbac32e51518a41eb8be3c43bf4d68cd53941de88" exitCode=0
Sep 11 13:00:18.915198 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:18.914808    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp" event={"ID":"56d5def1-17e2-4527-9908-c55d34a6107d","Type":"ContainerDied","Data":"9bc097c09a5e5cfbb0e633dcbac32e51518a41eb8be3c43bf4d68cd53941de88"}
Sep 11 13:00:19.815353 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:19.815309    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:24.943481 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:24.943411    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp" event={"ID":"56d5def1-17e2-4527-9908-c55d34a6107d","Type":"ContainerStarted","Data":"58b530b1f9a5b2c77bd9902b836cf87af9f6dc9ba77c072c3fbf85e684318b35"}
Sep 11 13:00:24.965569 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:24.965520    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp" podStartSLOduration=2.58582003 podStartE2EDuration="15.965501178s" totalImagesPullingTime="13.379681148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:00:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:00:24.964216019 +0000 UTC m=+291.825690207" watchObservedRunningTime="2026-09-11 13:00:24.965501178 +0000 UTC m=+291.826975368"
Sep 11 13:00:25.949267 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:25.949233    2547 generic.go:356] "Generic (PLEG): container finished" podID="56d5def1-17e2-4527-9908-c55d34a6107d" containerID="58b530b1f9a5b2c77bd9902b836cf87af9f6dc9ba77c072c3fbf85e684318b35" exitCode=0
Sep 11 13:00:25.949730 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:25.949288    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp" event={"ID":"56d5def1-17e2-4527-9908-c55d34a6107d","Type":"ContainerDied","Data":"58b530b1f9a5b2c77bd9902b836cf87af9f6dc9ba77c072c3fbf85e684318b35"}
Sep 11 13:00:27.127373 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:27.127337    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp"
Sep 11 13:00:27.168796 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:27.168763    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbxgt\" (UniqueName: \"kubernetes.io/projected/56d5def1-17e2-4527-9908-c55d34a6107d-kube-api-access-nbxgt\") pod \"56d5def1-17e2-4527-9908-c55d34a6107d\" (UID: \"56d5def1-17e2-4527-9908-c55d34a6107d\") "
Sep 11 13:00:27.169040 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:27.168819    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56d5def1-17e2-4527-9908-c55d34a6107d-util\") pod \"56d5def1-17e2-4527-9908-c55d34a6107d\" (UID: \"56d5def1-17e2-4527-9908-c55d34a6107d\") "
Sep 11 13:00:27.169040 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:27.168945    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56d5def1-17e2-4527-9908-c55d34a6107d-bundle\") pod \"56d5def1-17e2-4527-9908-c55d34a6107d\" (UID: \"56d5def1-17e2-4527-9908-c55d34a6107d\") "
Sep 11 13:00:27.169498 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:27.169475    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56d5def1-17e2-4527-9908-c55d34a6107d-bundle" (OuterVolumeSpecName: "bundle") pod "56d5def1-17e2-4527-9908-c55d34a6107d" (UID: "56d5def1-17e2-4527-9908-c55d34a6107d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:00:27.171211 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:27.171186    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56d5def1-17e2-4527-9908-c55d34a6107d-kube-api-access-nbxgt" (OuterVolumeSpecName: "kube-api-access-nbxgt") pod "56d5def1-17e2-4527-9908-c55d34a6107d" (UID: "56d5def1-17e2-4527-9908-c55d34a6107d"). InnerVolumeSpecName "kube-api-access-nbxgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:00:27.173032 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:27.173011    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56d5def1-17e2-4527-9908-c55d34a6107d-util" (OuterVolumeSpecName: "util") pod "56d5def1-17e2-4527-9908-c55d34a6107d" (UID: "56d5def1-17e2-4527-9908-c55d34a6107d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:00:27.270040 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:27.269957    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56d5def1-17e2-4527-9908-c55d34a6107d-bundle\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:00:27.270040 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:27.269987    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbxgt\" (UniqueName: \"kubernetes.io/projected/56d5def1-17e2-4527-9908-c55d34a6107d-kube-api-access-nbxgt\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:00:27.270040 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:27.269996    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56d5def1-17e2-4527-9908-c55d34a6107d-util\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:00:27.958358 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:27.958272    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp" event={"ID":"56d5def1-17e2-4527-9908-c55d34a6107d","Type":"ContainerDied","Data":"29482e33e8872132e8eb39c36830f3759a52547cbb7f7de88fb5507044ff2b2e"}
Sep 11 13:00:27.958358 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:27.958300    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gz6kp"
Sep 11 13:00:27.958358 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:27.958323    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29482e33e8872132e8eb39c36830f3759a52547cbb7f7de88fb5507044ff2b2e"
Sep 11 13:00:30.638536 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:30.638505    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:31.098282 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:31.098247    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:32.876060 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:32.876027    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hjd8h"]
Sep 11 13:00:32.877125 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:32.877101    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56d5def1-17e2-4527-9908-c55d34a6107d" containerName="extract"
Sep 11 13:00:32.877272 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:32.877261    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="56d5def1-17e2-4527-9908-c55d34a6107d" containerName="extract"
Sep 11 13:00:32.877374 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:32.877365    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56d5def1-17e2-4527-9908-c55d34a6107d" containerName="pull"
Sep 11 13:00:32.877439 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:32.877431    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="56d5def1-17e2-4527-9908-c55d34a6107d" containerName="pull"
Sep 11 13:00:32.877520 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:32.877512    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b408ad1-6764-44b0-8b46-e2067234f398" containerName="console"
Sep 11 13:00:32.877586 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:32.877578    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b408ad1-6764-44b0-8b46-e2067234f398" containerName="console"
Sep 11 13:00:32.877658 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:32.877648    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56d5def1-17e2-4527-9908-c55d34a6107d" containerName="util"
Sep 11 13:00:32.877746 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:32.877737    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="56d5def1-17e2-4527-9908-c55d34a6107d" containerName="util"
Sep 11 13:00:32.877971 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:32.877959    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b408ad1-6764-44b0-8b46-e2067234f398" containerName="console"
Sep 11 13:00:32.878057 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:32.878040    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="56d5def1-17e2-4527-9908-c55d34a6107d" containerName="extract"
Sep 11 13:00:32.880830 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:32.880807    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hjd8h"
Sep 11 13:00:32.883655 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:32.883637    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-zfgk7\""
Sep 11 13:00:32.883780 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:32.883668    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 11 13:00:32.884091 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:32.884064    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 11 13:00:32.893258 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:32.893235    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hjd8h"]
Sep 11 13:00:32.913486 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:32.913463    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1bade1bb-a961-41f1-87a4-dda31e4ffe87-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hjd8h\" (UID: \"1bade1bb-a961-41f1-87a4-dda31e4ffe87\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hjd8h"
Sep 11 13:00:32.913601 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:32.913505    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbq2x\" (UniqueName: \"kubernetes.io/projected/1bade1bb-a961-41f1-87a4-dda31e4ffe87-kube-api-access-tbq2x\") pod \"cert-manager-operator-controller-manager-55c444bf86-hjd8h\" (UID: \"1bade1bb-a961-41f1-87a4-dda31e4ffe87\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hjd8h"
Sep 11 13:00:33.013997 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:33.013968    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1bade1bb-a961-41f1-87a4-dda31e4ffe87-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hjd8h\" (UID: \"1bade1bb-a961-41f1-87a4-dda31e4ffe87\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hjd8h"
Sep 11 13:00:33.014158 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:33.014015    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbq2x\" (UniqueName: \"kubernetes.io/projected/1bade1bb-a961-41f1-87a4-dda31e4ffe87-kube-api-access-tbq2x\") pod \"cert-manager-operator-controller-manager-55c444bf86-hjd8h\" (UID: \"1bade1bb-a961-41f1-87a4-dda31e4ffe87\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hjd8h"
Sep 11 13:00:33.014383 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:33.014363    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1bade1bb-a961-41f1-87a4-dda31e4ffe87-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hjd8h\" (UID: \"1bade1bb-a961-41f1-87a4-dda31e4ffe87\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hjd8h"
Sep 11 13:00:33.023676 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:33.023658    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbq2x\" (UniqueName: \"kubernetes.io/projected/1bade1bb-a961-41f1-87a4-dda31e4ffe87-kube-api-access-tbq2x\") pod \"cert-manager-operator-controller-manager-55c444bf86-hjd8h\" (UID: \"1bade1bb-a961-41f1-87a4-dda31e4ffe87\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hjd8h"
Sep 11 13:00:33.189656 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:33.189585    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hjd8h"
Sep 11 13:00:33.477644 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:33.477621    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hjd8h"]
Sep 11 13:00:33.479326 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:00:33.479301    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bade1bb_a961_41f1_87a4_dda31e4ffe87.slice/crio-7cb83cea6257a803a4c2d1334faad5a225847c31bbd3e5167ccd213f8717ea78 WatchSource:0}: Error finding container 7cb83cea6257a803a4c2d1334faad5a225847c31bbd3e5167ccd213f8717ea78: Status 404 returned error can't find the container with id 7cb83cea6257a803a4c2d1334faad5a225847c31bbd3e5167ccd213f8717ea78
Sep 11 13:00:33.564967 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:33.564940    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-b7gsm_b22738d7-e796-4173-8fb4-80f9208b99dd/console-operator/2.log"
Sep 11 13:00:33.568603 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:33.568583    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-b7gsm_b22738d7-e796-4173-8fb4-80f9208b99dd/console-operator/2.log"
Sep 11 13:00:33.575658 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:33.575640    2547 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 13:00:33.982440 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:33.982404    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hjd8h" event={"ID":"1bade1bb-a961-41f1-87a4-dda31e4ffe87","Type":"ContainerStarted","Data":"7cb83cea6257a803a4c2d1334faad5a225847c31bbd3e5167ccd213f8717ea78"}
Sep 11 13:00:34.691930 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:34.691871    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:35.993443 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:35.993411    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hjd8h" event={"ID":"1bade1bb-a961-41f1-87a4-dda31e4ffe87","Type":"ContainerStarted","Data":"38d8660c0121472a16765d045a6c2905ae8b48050ae1d206e0a32013670912b1"}
Sep 11 13:00:36.769408 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:36.769371    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:36.918460 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:36.918409    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hjd8h" podStartSLOduration=3.256472106 podStartE2EDuration="4.918392025s" totalImagesPullingTime="1.661919919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:00:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:00:36.026042277 +0000 UTC m=+302.887516462" watchObservedRunningTime="2026-09-11 13:00:36.918392025 +0000 UTC m=+303.779866211"
Sep 11 13:00:36.919876 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:36.919854    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmkmxb"]
Sep 11 13:00:36.922524 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:36.922507    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmkmxb"
Sep 11 13:00:36.933185 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:36.933164    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 13:00:36.933964 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:36.933949    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 13:00:36.934020 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:36.933950    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pmvq6\""
Sep 11 13:00:36.959896 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:36.959864    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmkmxb"]
Sep 11 13:00:36.977004 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:36.976968    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:37.050413 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:37.050334    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/165b7915-826c-4f65-8e74-46864585c43f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmkmxb\" (UID: \"165b7915-826c-4f65-8e74-46864585c43f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmkmxb"
Sep 11 13:00:37.050413 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:37.050372    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/165b7915-826c-4f65-8e74-46864585c43f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmkmxb\" (UID: \"165b7915-826c-4f65-8e74-46864585c43f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmkmxb"
Sep 11 13:00:37.050413 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:37.050388    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz86r\" (UniqueName: \"kubernetes.io/projected/165b7915-826c-4f65-8e74-46864585c43f-kube-api-access-vz86r\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmkmxb\" (UID: \"165b7915-826c-4f65-8e74-46864585c43f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmkmxb"
Sep 11 13:00:37.151306 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:37.151268    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/165b7915-826c-4f65-8e74-46864585c43f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmkmxb\" (UID: \"165b7915-826c-4f65-8e74-46864585c43f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmkmxb"
Sep 11 13:00:37.151496 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:37.151315    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/165b7915-826c-4f65-8e74-46864585c43f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmkmxb\" (UID: \"165b7915-826c-4f65-8e74-46864585c43f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmkmxb"
Sep 11 13:00:37.151496 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:37.151340    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz86r\" (UniqueName: \"kubernetes.io/projected/165b7915-826c-4f65-8e74-46864585c43f-kube-api-access-vz86r\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmkmxb\" (UID: \"165b7915-826c-4f65-8e74-46864585c43f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmkmxb"
Sep 11 13:00:37.151610 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:37.151592    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/165b7915-826c-4f65-8e74-46864585c43f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmkmxb\" (UID: \"165b7915-826c-4f65-8e74-46864585c43f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmkmxb"
Sep 11 13:00:37.151664 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:37.151611    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/165b7915-826c-4f65-8e74-46864585c43f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmkmxb\" (UID: \"165b7915-826c-4f65-8e74-46864585c43f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmkmxb"
Sep 11 13:00:37.158354 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:37.158316    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:37.179343 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:37.179314    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz86r\" (UniqueName: \"kubernetes.io/projected/165b7915-826c-4f65-8e74-46864585c43f-kube-api-access-vz86r\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmkmxb\" (UID: \"165b7915-826c-4f65-8e74-46864585c43f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmkmxb"
Sep 11 13:00:37.231376 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:37.231350    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmkmxb"
Sep 11 13:00:37.323418 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:37.323391    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gbttp"]
Sep 11 13:00:37.325608 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:37.325588    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-gbttp"
Sep 11 13:00:37.328458 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:37.328436    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 13:00:37.328593 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:37.328491    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-m4969\""
Sep 11 13:00:37.329025 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:37.328841    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 13:00:37.349124 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:37.349101    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gbttp"]
Sep 11 13:00:37.454085 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:37.454049    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xghxj\" (UniqueName: \"kubernetes.io/projected/68931407-934f-4045-a6ad-b7dc462ea4e5-kube-api-access-xghxj\") pod \"cert-manager-webhook-6486ffd997-gbttp\" (UID: \"68931407-934f-4045-a6ad-b7dc462ea4e5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gbttp"
Sep 11 13:00:37.454243 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:37.454093    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68931407-934f-4045-a6ad-b7dc462ea4e5-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gbttp\" (UID: \"68931407-934f-4045-a6ad-b7dc462ea4e5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gbttp"
Sep 11 13:00:37.537379 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:37.537358    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmkmxb"]
Sep 11 13:00:37.539545 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:00:37.539520    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod165b7915_826c_4f65_8e74_46864585c43f.slice/crio-bae423b072de51685ea4eab93409e50855c3175ccd00c450f02f603e28032ef9 WatchSource:0}: Error finding container bae423b072de51685ea4eab93409e50855c3175ccd00c450f02f603e28032ef9: Status 404 returned error can't find the container with id bae423b072de51685ea4eab93409e50855c3175ccd00c450f02f603e28032ef9
Sep 11 13:00:37.554433 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:37.554409    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xghxj\" (UniqueName: \"kubernetes.io/projected/68931407-934f-4045-a6ad-b7dc462ea4e5-kube-api-access-xghxj\") pod \"cert-manager-webhook-6486ffd997-gbttp\" (UID: \"68931407-934f-4045-a6ad-b7dc462ea4e5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gbttp"
Sep 11 13:00:37.554522 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:37.554453    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68931407-934f-4045-a6ad-b7dc462ea4e5-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gbttp\" (UID: \"68931407-934f-4045-a6ad-b7dc462ea4e5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gbttp"
Sep 11 13:00:37.571443 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:37.571397    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68931407-934f-4045-a6ad-b7dc462ea4e5-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gbttp\" (UID: \"68931407-934f-4045-a6ad-b7dc462ea4e5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gbttp"
Sep 11 13:00:37.573229 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:37.573208    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xghxj\" (UniqueName: \"kubernetes.io/projected/68931407-934f-4045-a6ad-b7dc462ea4e5-kube-api-access-xghxj\") pod \"cert-manager-webhook-6486ffd997-gbttp\" (UID: \"68931407-934f-4045-a6ad-b7dc462ea4e5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gbttp"
Sep 11 13:00:37.659908 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:37.659885    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-gbttp"
Sep 11 13:00:37.929883 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:37.929861    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gbttp"]
Sep 11 13:00:37.931051 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:00:37.931030    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68931407_934f_4045_a6ad_b7dc462ea4e5.slice/crio-1686302965eba91dabff79d2315d3cc9cc0a2cde5093a57dca7ebdeb8a0b3982 WatchSource:0}: Error finding container 1686302965eba91dabff79d2315d3cc9cc0a2cde5093a57dca7ebdeb8a0b3982: Status 404 returned error can't find the container with id 1686302965eba91dabff79d2315d3cc9cc0a2cde5093a57dca7ebdeb8a0b3982
Sep 11 13:00:37.932980 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:37.932964    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 13:00:38.002298 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:38.002266    2547 generic.go:356] "Generic (PLEG): container finished" podID="165b7915-826c-4f65-8e74-46864585c43f" containerID="ba93b8fbe446bebddc1fca808183d80bccd3e4f209ca92274bf21748ed1df12a" exitCode=0
Sep 11 13:00:38.002457 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:38.002356    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmkmxb" event={"ID":"165b7915-826c-4f65-8e74-46864585c43f","Type":"ContainerDied","Data":"ba93b8fbe446bebddc1fca808183d80bccd3e4f209ca92274bf21748ed1df12a"}
Sep 11 13:00:38.002457 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:38.002415    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmkmxb" event={"ID":"165b7915-826c-4f65-8e74-46864585c43f","Type":"ContainerStarted","Data":"bae423b072de51685ea4eab93409e50855c3175ccd00c450f02f603e28032ef9"}
Sep 11 13:00:38.003819 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:38.003702    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-gbttp" event={"ID":"68931407-934f-4045-a6ad-b7dc462ea4e5","Type":"ContainerStarted","Data":"1686302965eba91dabff79d2315d3cc9cc0a2cde5093a57dca7ebdeb8a0b3982"}
Sep 11 13:00:39.296098 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:39.296052    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:39.455332 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:39.455287    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:39.657263 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:39.657227    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ffqhp"]
Sep 11 13:00:39.659440 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:39.659419    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ffqhp"
Sep 11 13:00:39.662088 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:39.662070    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-gb757\""
Sep 11 13:00:39.669394 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:39.669371    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ffqhp"]
Sep 11 13:00:39.773571 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:39.773545    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f11ce97-a1a6-438d-942c-5e063a1e9f5b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ffqhp\" (UID: \"5f11ce97-a1a6-438d-942c-5e063a1e9f5b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ffqhp"
Sep 11 13:00:39.773658 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:39.773610    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lghnr\" (UniqueName: \"kubernetes.io/projected/5f11ce97-a1a6-438d-942c-5e063a1e9f5b-kube-api-access-lghnr\") pod \"cert-manager-cainjector-559cdd8c87-ffqhp\" (UID: \"5f11ce97-a1a6-438d-942c-5e063a1e9f5b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ffqhp"
Sep 11 13:00:39.874351 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:39.874323    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f11ce97-a1a6-438d-942c-5e063a1e9f5b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ffqhp\" (UID: \"5f11ce97-a1a6-438d-942c-5e063a1e9f5b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ffqhp"
Sep 11 13:00:39.874468 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:39.874367    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lghnr\" (UniqueName: \"kubernetes.io/projected/5f11ce97-a1a6-438d-942c-5e063a1e9f5b-kube-api-access-lghnr\") pod \"cert-manager-cainjector-559cdd8c87-ffqhp\" (UID: \"5f11ce97-a1a6-438d-942c-5e063a1e9f5b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ffqhp"
Sep 11 13:00:39.883137 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:39.883108    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lghnr\" (UniqueName: \"kubernetes.io/projected/5f11ce97-a1a6-438d-942c-5e063a1e9f5b-kube-api-access-lghnr\") pod \"cert-manager-cainjector-559cdd8c87-ffqhp\" (UID: \"5f11ce97-a1a6-438d-942c-5e063a1e9f5b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ffqhp"
Sep 11 13:00:39.883370 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:39.883354    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f11ce97-a1a6-438d-942c-5e063a1e9f5b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ffqhp\" (UID: \"5f11ce97-a1a6-438d-942c-5e063a1e9f5b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ffqhp"
Sep 11 13:00:39.969757 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:39.969678    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ffqhp"
Sep 11 13:00:40.016123 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:40.016055    2547 generic.go:356] "Generic (PLEG): container finished" podID="165b7915-826c-4f65-8e74-46864585c43f" containerID="1317fd8fa666b9a0b180857d2d8af31afab4b753e57b7b89841e8297f1bcfd16" exitCode=0
Sep 11 13:00:40.016123 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:40.016107    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmkmxb" event={"ID":"165b7915-826c-4f65-8e74-46864585c43f","Type":"ContainerDied","Data":"1317fd8fa666b9a0b180857d2d8af31afab4b753e57b7b89841e8297f1bcfd16"}
Sep 11 13:00:40.255119 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:40.255091    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ffqhp"]
Sep 11 13:00:40.257498 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:00:40.257474    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f11ce97_a1a6_438d_942c_5e063a1e9f5b.slice/crio-3e74790ca5e367320007dfcc6546b328b264b97e2894110970dadab05a6d398c WatchSource:0}: Error finding container 3e74790ca5e367320007dfcc6546b328b264b97e2894110970dadab05a6d398c: Status 404 returned error can't find the container with id 3e74790ca5e367320007dfcc6546b328b264b97e2894110970dadab05a6d398c
Sep 11 13:00:40.835817 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:40.835767    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:40.906194 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:40.906157    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:41.024004 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:41.023973    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ffqhp" event={"ID":"5f11ce97-a1a6-438d-942c-5e063a1e9f5b","Type":"ContainerStarted","Data":"3e74790ca5e367320007dfcc6546b328b264b97e2894110970dadab05a6d398c"}
Sep 11 13:00:41.025889 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:41.025865    2547 generic.go:356] "Generic (PLEG): container finished" podID="165b7915-826c-4f65-8e74-46864585c43f" containerID="035b28f1424281cba5cfb157382e6a15ca2cb8d3d8d8ee97d2b3176df1aaf7ff" exitCode=0
Sep 11 13:00:41.025999 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:41.025903    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmkmxb" event={"ID":"165b7915-826c-4f65-8e74-46864585c43f","Type":"ContainerDied","Data":"035b28f1424281cba5cfb157382e6a15ca2cb8d3d8d8ee97d2b3176df1aaf7ff"}
Sep 11 13:00:42.150738 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:42.150689    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmkmxb"
Sep 11 13:00:42.296161 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:42.296057    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vz86r\" (UniqueName: \"kubernetes.io/projected/165b7915-826c-4f65-8e74-46864585c43f-kube-api-access-vz86r\") pod \"165b7915-826c-4f65-8e74-46864585c43f\" (UID: \"165b7915-826c-4f65-8e74-46864585c43f\") "
Sep 11 13:00:42.296161 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:42.296115    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/165b7915-826c-4f65-8e74-46864585c43f-util\") pod \"165b7915-826c-4f65-8e74-46864585c43f\" (UID: \"165b7915-826c-4f65-8e74-46864585c43f\") "
Sep 11 13:00:42.296161 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:42.296165    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/165b7915-826c-4f65-8e74-46864585c43f-bundle\") pod \"165b7915-826c-4f65-8e74-46864585c43f\" (UID: \"165b7915-826c-4f65-8e74-46864585c43f\") "
Sep 11 13:00:42.296600 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:42.296564    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/165b7915-826c-4f65-8e74-46864585c43f-bundle" (OuterVolumeSpecName: "bundle") pod "165b7915-826c-4f65-8e74-46864585c43f" (UID: "165b7915-826c-4f65-8e74-46864585c43f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:00:42.298450 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:42.298430    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/165b7915-826c-4f65-8e74-46864585c43f-kube-api-access-vz86r" (OuterVolumeSpecName: "kube-api-access-vz86r") pod "165b7915-826c-4f65-8e74-46864585c43f" (UID: "165b7915-826c-4f65-8e74-46864585c43f"). InnerVolumeSpecName "kube-api-access-vz86r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:00:42.301911 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:42.301879    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/165b7915-826c-4f65-8e74-46864585c43f-util" (OuterVolumeSpecName: "util") pod "165b7915-826c-4f65-8e74-46864585c43f" (UID: "165b7915-826c-4f65-8e74-46864585c43f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:00:42.397113 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:42.397079    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/165b7915-826c-4f65-8e74-46864585c43f-util\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:00:42.397113 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:42.397105    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/165b7915-826c-4f65-8e74-46864585c43f-bundle\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:00:42.397113 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:42.397115    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vz86r\" (UniqueName: \"kubernetes.io/projected/165b7915-826c-4f65-8e74-46864585c43f-kube-api-access-vz86r\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:00:43.036374 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:43.036348    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmkmxb"
Sep 11 13:00:43.036536 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:43.036338    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmkmxb" event={"ID":"165b7915-826c-4f65-8e74-46864585c43f","Type":"ContainerDied","Data":"bae423b072de51685ea4eab93409e50855c3175ccd00c450f02f603e28032ef9"}
Sep 11 13:00:43.036536 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:43.036467    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bae423b072de51685ea4eab93409e50855c3175ccd00c450f02f603e28032ef9"
Sep 11 13:00:46.444113 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:46.444066    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:47.066272 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:47.066233    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:47.174839 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:47.174802    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:48.301874 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:48.301839    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-gwgct"]
Sep 11 13:00:48.302396 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:48.302262    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="165b7915-826c-4f65-8e74-46864585c43f" containerName="extract"
Sep 11 13:00:48.302396 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:48.302280    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="165b7915-826c-4f65-8e74-46864585c43f" containerName="extract"
Sep 11 13:00:48.302396 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:48.302315    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="165b7915-826c-4f65-8e74-46864585c43f" containerName="pull"
Sep 11 13:00:48.302396 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:48.302322    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="165b7915-826c-4f65-8e74-46864585c43f" containerName="pull"
Sep 11 13:00:48.302396 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:48.302336    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="165b7915-826c-4f65-8e74-46864585c43f" containerName="util"
Sep 11 13:00:48.302396 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:48.302344    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="165b7915-826c-4f65-8e74-46864585c43f" containerName="util"
Sep 11 13:00:48.302696 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:48.302423    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="165b7915-826c-4f65-8e74-46864585c43f" containerName="extract"
Sep 11 13:00:48.304518 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:48.304496    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-gwgct"
Sep 11 13:00:48.308308 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:48.308286    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-qkdxs\""
Sep 11 13:00:48.321601 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:48.321578    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-gwgct"]
Sep 11 13:00:48.446049 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:48.446012    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnrf2\" (UniqueName: \"kubernetes.io/projected/9324b588-32a5-4caa-9670-fe582ab410de-kube-api-access-fnrf2\") pod \"cert-manager-55b4d954d5-gwgct\" (UID: \"9324b588-32a5-4caa-9670-fe582ab410de\") " pod="cert-manager/cert-manager-55b4d954d5-gwgct"
Sep 11 13:00:48.446049 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:48.446057    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9324b588-32a5-4caa-9670-fe582ab410de-bound-sa-token\") pod \"cert-manager-55b4d954d5-gwgct\" (UID: \"9324b588-32a5-4caa-9670-fe582ab410de\") " pod="cert-manager/cert-manager-55b4d954d5-gwgct"
Sep 11 13:00:48.546806 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:48.546770    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnrf2\" (UniqueName: \"kubernetes.io/projected/9324b588-32a5-4caa-9670-fe582ab410de-kube-api-access-fnrf2\") pod \"cert-manager-55b4d954d5-gwgct\" (UID: \"9324b588-32a5-4caa-9670-fe582ab410de\") " pod="cert-manager/cert-manager-55b4d954d5-gwgct"
Sep 11 13:00:48.546806 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:48.546807    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9324b588-32a5-4caa-9670-fe582ab410de-bound-sa-token\") pod \"cert-manager-55b4d954d5-gwgct\" (UID: \"9324b588-32a5-4caa-9670-fe582ab410de\") " pod="cert-manager/cert-manager-55b4d954d5-gwgct"
Sep 11 13:00:48.556689 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:48.556664    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnrf2\" (UniqueName: \"kubernetes.io/projected/9324b588-32a5-4caa-9670-fe582ab410de-kube-api-access-fnrf2\") pod \"cert-manager-55b4d954d5-gwgct\" (UID: \"9324b588-32a5-4caa-9670-fe582ab410de\") " pod="cert-manager/cert-manager-55b4d954d5-gwgct"
Sep 11 13:00:48.557172 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:48.557154    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9324b588-32a5-4caa-9670-fe582ab410de-bound-sa-token\") pod \"cert-manager-55b4d954d5-gwgct\" (UID: \"9324b588-32a5-4caa-9670-fe582ab410de\") " pod="cert-manager/cert-manager-55b4d954d5-gwgct"
Sep 11 13:00:48.614292 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:48.614251    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-gwgct"
Sep 11 13:00:48.893553 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:48.893530    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-gwgct"]
Sep 11 13:00:48.895340 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:00:48.895306    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9324b588_32a5_4caa_9670_fe582ab410de.slice/crio-ec77c3de6b4fcbae64305dcc271f332d8430ac365b109971258b30070f0c41b4 WatchSource:0}: Error finding container ec77c3de6b4fcbae64305dcc271f332d8430ac365b109971258b30070f0c41b4: Status 404 returned error can't find the container with id ec77c3de6b4fcbae64305dcc271f332d8430ac365b109971258b30070f0c41b4
Sep 11 13:00:49.068246 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:49.068212    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-gwgct" event={"ID":"9324b588-32a5-4caa-9670-fe582ab410de","Type":"ContainerStarted","Data":"ec77c3de6b4fcbae64305dcc271f332d8430ac365b109971258b30070f0c41b4"}
Sep 11 13:00:52.087663 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:52.087625    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-gwgct" event={"ID":"9324b588-32a5-4caa-9670-fe582ab410de","Type":"ContainerStarted","Data":"e3533c293292f8ba924cf076c715d182d48de0e6aec7485b884099f85609fc31"}
Sep 11 13:00:52.089350 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:52.089325    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-gbttp" event={"ID":"68931407-934f-4045-a6ad-b7dc462ea4e5","Type":"ContainerStarted","Data":"8728c6ccb5007ffb902a68fc70b55a7443f050bfb38943e59b4636d91049bf02"}
Sep 11 13:00:52.089480 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:52.089441    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-gbttp"
Sep 11 13:00:52.104915 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:52.104817    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-gwgct" podStartSLOduration=1.450427961 podStartE2EDuration="4.104798345s" totalImagesPullingTime="2.654370384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:00:52.104186488 +0000 UTC m=+318.965660689" watchObservedRunningTime="2026-09-11 13:00:52.104798345 +0000 UTC m=+318.966272533"
Sep 11 13:00:52.126294 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:52.126219    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-gbttp" podStartSLOduration=1.518948594 podStartE2EDuration="15.126199079s" totalImagesPullingTime="13.607250485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:00:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:00:52.12388338 +0000 UTC m=+318.985357578" watchObservedRunningTime="2026-09-11 13:00:52.126199079 +0000 UTC m=+318.987673268"
Sep 11 13:00:52.954190 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:52.954147    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:53.055445 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:53.055406    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:53.095131 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:53.095100    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ffqhp" event={"ID":"5f11ce97-a1a6-438d-942c-5e063a1e9f5b","Type":"ContainerStarted","Data":"3a46831e778d66d9427ec22ab88cc2c1bfa71907dbe97aec529d66f40d119bd0"}
Sep 11 13:00:53.127850 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:53.127804    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ffqhp" podStartSLOduration=2.246098607 podStartE2EDuration="14.127787884s" totalImagesPullingTime="11.881689277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:00:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:00:53.126096251 +0000 UTC m=+319.987570449" watchObservedRunningTime="2026-09-11 13:00:53.127787884 +0000 UTC m=+319.989262070"
Sep 11 13:00:54.719960 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:54.719918    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:54.822940 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:54.822899    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:56.675728 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:56.675687    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af665v4"]
Sep 11 13:00:56.690290 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:56.690252    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af665v4"
Sep 11 13:00:56.692509 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:56.692484    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af665v4"]
Sep 11 13:00:56.693396 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:56.693377    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 13:00:56.693764 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:56.693747    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pmvq6\""
Sep 11 13:00:56.693850 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:56.693751    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 13:00:56.783837 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:56.783803    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:56.815638 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:56.815612    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cc33f2b-f15c-499e-a330-68063d7553a4-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af665v4\" (UID: \"4cc33f2b-f15c-499e-a330-68063d7553a4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af665v4"
Sep 11 13:00:56.815814 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:56.815665    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cc33f2b-f15c-499e-a330-68063d7553a4-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af665v4\" (UID: \"4cc33f2b-f15c-499e-a330-68063d7553a4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af665v4"
Sep 11 13:00:56.815814 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:56.815751    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmp5z\" (UniqueName: \"kubernetes.io/projected/4cc33f2b-f15c-499e-a330-68063d7553a4-kube-api-access-fmp5z\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af665v4\" (UID: \"4cc33f2b-f15c-499e-a330-68063d7553a4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af665v4"
Sep 11 13:00:56.916457 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:56.916422    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cc33f2b-f15c-499e-a330-68063d7553a4-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af665v4\" (UID: \"4cc33f2b-f15c-499e-a330-68063d7553a4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af665v4"
Sep 11 13:00:56.916636 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:56.916467    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmp5z\" (UniqueName: \"kubernetes.io/projected/4cc33f2b-f15c-499e-a330-68063d7553a4-kube-api-access-fmp5z\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af665v4\" (UID: \"4cc33f2b-f15c-499e-a330-68063d7553a4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af665v4"
Sep 11 13:00:56.916636 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:56.916512    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cc33f2b-f15c-499e-a330-68063d7553a4-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af665v4\" (UID: \"4cc33f2b-f15c-499e-a330-68063d7553a4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af665v4"
Sep 11 13:00:56.916829 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:56.916810    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cc33f2b-f15c-499e-a330-68063d7553a4-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af665v4\" (UID: \"4cc33f2b-f15c-499e-a330-68063d7553a4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af665v4"
Sep 11 13:00:56.916901 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:56.916876    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cc33f2b-f15c-499e-a330-68063d7553a4-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af665v4\" (UID: \"4cc33f2b-f15c-499e-a330-68063d7553a4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af665v4"
Sep 11 13:00:56.928913 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:56.928839    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmp5z\" (UniqueName: \"kubernetes.io/projected/4cc33f2b-f15c-499e-a330-68063d7553a4-kube-api-access-fmp5z\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af665v4\" (UID: \"4cc33f2b-f15c-499e-a330-68063d7553a4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af665v4"
Sep 11 13:00:57.000663 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:57.000614    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af665v4"
Sep 11 13:00:57.293515 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:57.293439    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af665v4"]
Sep 11 13:00:57.296384 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:00:57.296359    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cc33f2b_f15c_499e_a330_68063d7553a4.slice/crio-bcba499df34dc5328b5ed1d3ee4c4f0bf3633d25651428179779b1ae9438dc78 WatchSource:0}: Error finding container bcba499df34dc5328b5ed1d3ee4c4f0bf3633d25651428179779b1ae9438dc78: Status 404 returned error can't find the container with id bcba499df34dc5328b5ed1d3ee4c4f0bf3633d25651428179779b1ae9438dc78
Sep 11 13:00:58.097871 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:58.097842    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-gbttp"
Sep 11 13:00:58.119288 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:58.119255    2547 generic.go:356] "Generic (PLEG): container finished" podID="4cc33f2b-f15c-499e-a330-68063d7553a4" containerID="bfd9a2059e31d81968829036d76e0acc669cf3c6ffd5ef0d5416fb2e49487475" exitCode=0
Sep 11 13:00:58.119443 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:58.119297    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af665v4" event={"ID":"4cc33f2b-f15c-499e-a330-68063d7553a4","Type":"ContainerDied","Data":"bfd9a2059e31d81968829036d76e0acc669cf3c6ffd5ef0d5416fb2e49487475"}
Sep 11 13:00:58.119443 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:58.119328    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af665v4" event={"ID":"4cc33f2b-f15c-499e-a330-68063d7553a4","Type":"ContainerStarted","Data":"bcba499df34dc5328b5ed1d3ee4c4f0bf3633d25651428179779b1ae9438dc78"}
Sep 11 13:00:59.126869 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:59.126840    2547 generic.go:356] "Generic (PLEG): container finished" podID="4cc33f2b-f15c-499e-a330-68063d7553a4" containerID="1fc0be7999169a428a49873c5abbcfa09744b2b81f1b2b7dbe0016317d6498d7" exitCode=0
Sep 11 13:00:59.127201 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:00:59.126927    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af665v4" event={"ID":"4cc33f2b-f15c-499e-a330-68063d7553a4","Type":"ContainerDied","Data":"1fc0be7999169a428a49873c5abbcfa09744b2b81f1b2b7dbe0016317d6498d7"}
Sep 11 13:01:00.133683 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:00.133655    2547 generic.go:356] "Generic (PLEG): container finished" podID="4cc33f2b-f15c-499e-a330-68063d7553a4" containerID="97e5831ada1460584af3f8a81c401709d2bdc6cbc26d3a9c994956ac62912ff2" exitCode=0
Sep 11 13:01:00.134071 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:00.133732    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af665v4" event={"ID":"4cc33f2b-f15c-499e-a330-68063d7553a4","Type":"ContainerDied","Data":"97e5831ada1460584af3f8a81c401709d2bdc6cbc26d3a9c994956ac62912ff2"}
Sep 11 13:01:01.257828 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:01.257804    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af665v4"
Sep 11 13:01:01.355410 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:01.355373    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cc33f2b-f15c-499e-a330-68063d7553a4-bundle\") pod \"4cc33f2b-f15c-499e-a330-68063d7553a4\" (UID: \"4cc33f2b-f15c-499e-a330-68063d7553a4\") "
Sep 11 13:01:01.355610 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:01.355441    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cc33f2b-f15c-499e-a330-68063d7553a4-util\") pod \"4cc33f2b-f15c-499e-a330-68063d7553a4\" (UID: \"4cc33f2b-f15c-499e-a330-68063d7553a4\") "
Sep 11 13:01:01.355610 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:01.355491    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmp5z\" (UniqueName: \"kubernetes.io/projected/4cc33f2b-f15c-499e-a330-68063d7553a4-kube-api-access-fmp5z\") pod \"4cc33f2b-f15c-499e-a330-68063d7553a4\" (UID: \"4cc33f2b-f15c-499e-a330-68063d7553a4\") "
Sep 11 13:01:01.356149 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:01.356113    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cc33f2b-f15c-499e-a330-68063d7553a4-bundle" (OuterVolumeSpecName: "bundle") pod "4cc33f2b-f15c-499e-a330-68063d7553a4" (UID: "4cc33f2b-f15c-499e-a330-68063d7553a4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:01:01.357747 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:01.357703    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cc33f2b-f15c-499e-a330-68063d7553a4-kube-api-access-fmp5z" (OuterVolumeSpecName: "kube-api-access-fmp5z") pod "4cc33f2b-f15c-499e-a330-68063d7553a4" (UID: "4cc33f2b-f15c-499e-a330-68063d7553a4"). InnerVolumeSpecName "kube-api-access-fmp5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:01:01.361456 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:01.361434    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cc33f2b-f15c-499e-a330-68063d7553a4-util" (OuterVolumeSpecName: "util") pod "4cc33f2b-f15c-499e-a330-68063d7553a4" (UID: "4cc33f2b-f15c-499e-a330-68063d7553a4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:01:01.456856 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:01.456772    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmp5z\" (UniqueName: \"kubernetes.io/projected/4cc33f2b-f15c-499e-a330-68063d7553a4-kube-api-access-fmp5z\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:01:01.456856 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:01.456800    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cc33f2b-f15c-499e-a330-68063d7553a4-bundle\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:01:01.456856 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:01.456810    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cc33f2b-f15c-499e-a330-68063d7553a4-util\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:01:02.151094 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:02.151062    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af665v4" event={"ID":"4cc33f2b-f15c-499e-a330-68063d7553a4","Type":"ContainerDied","Data":"bcba499df34dc5328b5ed1d3ee4c4f0bf3633d25651428179779b1ae9438dc78"}
Sep 11 13:01:02.151270 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:02.151128    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bcba499df34dc5328b5ed1d3ee4c4f0bf3633d25651428179779b1ae9438dc78"
Sep 11 13:01:02.151270 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:02.151069    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af665v4"
Sep 11 13:01:11.964863 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:11.964829    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rv7z4"]
Sep 11 13:01:11.965269 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:11.965104    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cc33f2b-f15c-499e-a330-68063d7553a4" containerName="util"
Sep 11 13:01:11.965269 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:11.965115    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cc33f2b-f15c-499e-a330-68063d7553a4" containerName="util"
Sep 11 13:01:11.965269 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:11.965129    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cc33f2b-f15c-499e-a330-68063d7553a4" containerName="pull"
Sep 11 13:01:11.965269 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:11.965134    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cc33f2b-f15c-499e-a330-68063d7553a4" containerName="pull"
Sep 11 13:01:11.965269 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:11.965147    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cc33f2b-f15c-499e-a330-68063d7553a4" containerName="extract"
Sep 11 13:01:11.965269 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:11.965151    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cc33f2b-f15c-499e-a330-68063d7553a4" containerName="extract"
Sep 11 13:01:11.965269 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:11.965201    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cc33f2b-f15c-499e-a330-68063d7553a4" containerName="extract"
Sep 11 13:01:11.971051 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:11.971033    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rv7z4"
Sep 11 13:01:11.973467 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:11.973440    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 13:01:11.973574 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:11.973502    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pmvq6\""
Sep 11 13:01:11.974290 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:11.974271    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 13:01:11.979817 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:11.979795    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rv7z4"]
Sep 11 13:01:12.040455 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:12.040422    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfgj5\" (UniqueName: \"kubernetes.io/projected/6207b30d-1940-4d43-a570-7c839fa70758-kube-api-access-xfgj5\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rv7z4\" (UID: \"6207b30d-1940-4d43-a570-7c839fa70758\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rv7z4"
Sep 11 13:01:12.040634 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:12.040461    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6207b30d-1940-4d43-a570-7c839fa70758-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rv7z4\" (UID: \"6207b30d-1940-4d43-a570-7c839fa70758\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rv7z4"
Sep 11 13:01:12.040634 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:12.040525    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6207b30d-1940-4d43-a570-7c839fa70758-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rv7z4\" (UID: \"6207b30d-1940-4d43-a570-7c839fa70758\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rv7z4"
Sep 11 13:01:12.079424 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:12.079389    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:12.141185 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:12.141150    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfgj5\" (UniqueName: \"kubernetes.io/projected/6207b30d-1940-4d43-a570-7c839fa70758-kube-api-access-xfgj5\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rv7z4\" (UID: \"6207b30d-1940-4d43-a570-7c839fa70758\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rv7z4"
Sep 11 13:01:12.141378 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:12.141208    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6207b30d-1940-4d43-a570-7c839fa70758-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rv7z4\" (UID: \"6207b30d-1940-4d43-a570-7c839fa70758\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rv7z4"
Sep 11 13:01:12.141378 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:12.141268    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6207b30d-1940-4d43-a570-7c839fa70758-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rv7z4\" (UID: \"6207b30d-1940-4d43-a570-7c839fa70758\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rv7z4"
Sep 11 13:01:12.141600 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:12.141576    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6207b30d-1940-4d43-a570-7c839fa70758-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rv7z4\" (UID: \"6207b30d-1940-4d43-a570-7c839fa70758\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rv7z4"
Sep 11 13:01:12.141642 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:12.141602    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6207b30d-1940-4d43-a570-7c839fa70758-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rv7z4\" (UID: \"6207b30d-1940-4d43-a570-7c839fa70758\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rv7z4"
Sep 11 13:01:12.168500 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:12.168468    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfgj5\" (UniqueName: \"kubernetes.io/projected/6207b30d-1940-4d43-a570-7c839fa70758-kube-api-access-xfgj5\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rv7z4\" (UID: \"6207b30d-1940-4d43-a570-7c839fa70758\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rv7z4"
Sep 11 13:01:12.196467 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:12.196435    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:12.281224 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:12.281131    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rv7z4"
Sep 11 13:01:12.562312 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:12.562287    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rv7z4"]
Sep 11 13:01:12.563979 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:01:12.563953    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6207b30d_1940_4d43_a570_7c839fa70758.slice/crio-648807fa4a2a6bb90d47631a786689ffdab4b63879b7af6801216fc9a6f2a6df WatchSource:0}: Error finding container 648807fa4a2a6bb90d47631a786689ffdab4b63879b7af6801216fc9a6f2a6df: Status 404 returned error can't find the container with id 648807fa4a2a6bb90d47631a786689ffdab4b63879b7af6801216fc9a6f2a6df
Sep 11 13:01:12.667116 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:12.667073    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:13.202773 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.202736    2547 generic.go:356] "Generic (PLEG): container finished" podID="6207b30d-1940-4d43-a570-7c839fa70758" containerID="476dedfa35e588178a57289634c9263c1e94f8e3eeb6359d6649566a342fe039" exitCode=0
Sep 11 13:01:13.203215 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.202812    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rv7z4" event={"ID":"6207b30d-1940-4d43-a570-7c839fa70758","Type":"ContainerDied","Data":"476dedfa35e588178a57289634c9263c1e94f8e3eeb6359d6649566a342fe039"}
Sep 11 13:01:13.203215 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.202892    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rv7z4" event={"ID":"6207b30d-1940-4d43-a570-7c839fa70758","Type":"ContainerStarted","Data":"648807fa4a2a6bb90d47631a786689ffdab4b63879b7af6801216fc9a6f2a6df"}
Sep 11 13:01:13.392198 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.392160    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:13.536826 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.536736    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:13.603261 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.603227    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56f55dc566-skp7s"]
Sep 11 13:01:13.606530 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.606512    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-skp7s"
Sep 11 13:01:13.609639 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.609618    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 13:01:13.609993 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.609956    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 13:01:13.610096 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.610084    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xt7p7\""
Sep 11 13:01:13.610421 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.610409    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 13:01:13.612004 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.611988    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 13:01:13.646396 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.646363    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56f55dc566-skp7s"]
Sep 11 13:01:13.653304 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.653275    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b5f91c1e-a86a-47ca-be91-e252b22b8a9d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56f55dc566-skp7s\" (UID: \"b5f91c1e-a86a-47ca-be91-e252b22b8a9d\") " pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-skp7s"
Sep 11 13:01:13.653444 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.653319    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b5f91c1e-a86a-47ca-be91-e252b22b8a9d-manifests\") pod \"opendatahub-operator-controller-manager-56f55dc566-skp7s\" (UID: \"b5f91c1e-a86a-47ca-be91-e252b22b8a9d\") " pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-skp7s"
Sep 11 13:01:13.653444 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.653342    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b5f91c1e-a86a-47ca-be91-e252b22b8a9d-webhook-cert\") pod \"opendatahub-operator-controller-manager-56f55dc566-skp7s\" (UID: \"b5f91c1e-a86a-47ca-be91-e252b22b8a9d\") " pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-skp7s"
Sep 11 13:01:13.653444 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.653418    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82rp8\" (UniqueName: \"kubernetes.io/projected/b5f91c1e-a86a-47ca-be91-e252b22b8a9d-kube-api-access-82rp8\") pod \"opendatahub-operator-controller-manager-56f55dc566-skp7s\" (UID: \"b5f91c1e-a86a-47ca-be91-e252b22b8a9d\") " pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-skp7s"
Sep 11 13:01:13.653598 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.653465    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5f91c1e-a86a-47ca-be91-e252b22b8a9d-tmp\") pod \"opendatahub-operator-controller-manager-56f55dc566-skp7s\" (UID: \"b5f91c1e-a86a-47ca-be91-e252b22b8a9d\") " pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-skp7s"
Sep 11 13:01:13.754010 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.753974    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b5f91c1e-a86a-47ca-be91-e252b22b8a9d-manifests\") pod \"opendatahub-operator-controller-manager-56f55dc566-skp7s\" (UID: \"b5f91c1e-a86a-47ca-be91-e252b22b8a9d\") " pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-skp7s"
Sep 11 13:01:13.754199 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.754018    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b5f91c1e-a86a-47ca-be91-e252b22b8a9d-webhook-cert\") pod \"opendatahub-operator-controller-manager-56f55dc566-skp7s\" (UID: \"b5f91c1e-a86a-47ca-be91-e252b22b8a9d\") " pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-skp7s"
Sep 11 13:01:13.754199 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.754151    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82rp8\" (UniqueName: \"kubernetes.io/projected/b5f91c1e-a86a-47ca-be91-e252b22b8a9d-kube-api-access-82rp8\") pod \"opendatahub-operator-controller-manager-56f55dc566-skp7s\" (UID: \"b5f91c1e-a86a-47ca-be91-e252b22b8a9d\") " pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-skp7s"
Sep 11 13:01:13.754317 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.754206    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5f91c1e-a86a-47ca-be91-e252b22b8a9d-tmp\") pod \"opendatahub-operator-controller-manager-56f55dc566-skp7s\" (UID: \"b5f91c1e-a86a-47ca-be91-e252b22b8a9d\") " pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-skp7s"
Sep 11 13:01:13.754317 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.754285    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b5f91c1e-a86a-47ca-be91-e252b22b8a9d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56f55dc566-skp7s\" (UID: \"b5f91c1e-a86a-47ca-be91-e252b22b8a9d\") " pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-skp7s"
Sep 11 13:01:13.754422 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.754369    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b5f91c1e-a86a-47ca-be91-e252b22b8a9d-manifests\") pod \"opendatahub-operator-controller-manager-56f55dc566-skp7s\" (UID: \"b5f91c1e-a86a-47ca-be91-e252b22b8a9d\") " pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-skp7s"
Sep 11 13:01:13.756561 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.756533    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5f91c1e-a86a-47ca-be91-e252b22b8a9d-tmp\") pod \"opendatahub-operator-controller-manager-56f55dc566-skp7s\" (UID: \"b5f91c1e-a86a-47ca-be91-e252b22b8a9d\") " pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-skp7s"
Sep 11 13:01:13.756796 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.756686    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b5f91c1e-a86a-47ca-be91-e252b22b8a9d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56f55dc566-skp7s\" (UID: \"b5f91c1e-a86a-47ca-be91-e252b22b8a9d\") " pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-skp7s"
Sep 11 13:01:13.756796 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.756690    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b5f91c1e-a86a-47ca-be91-e252b22b8a9d-webhook-cert\") pod \"opendatahub-operator-controller-manager-56f55dc566-skp7s\" (UID: \"b5f91c1e-a86a-47ca-be91-e252b22b8a9d\") " pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-skp7s"
Sep 11 13:01:13.767348 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.767325    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82rp8\" (UniqueName: \"kubernetes.io/projected/b5f91c1e-a86a-47ca-be91-e252b22b8a9d-kube-api-access-82rp8\") pod \"opendatahub-operator-controller-manager-56f55dc566-skp7s\" (UID: \"b5f91c1e-a86a-47ca-be91-e252b22b8a9d\") " pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-skp7s"
Sep 11 13:01:13.786685 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.786652    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:13.889323 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.889288    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:13.916160 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.916134    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-skp7s"
Sep 11 13:01:13.989059 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:13.989029    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:14.091298 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:14.091266    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:14.190522 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:14.190438    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:14.198758 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:14.198737    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56f55dc566-skp7s"]
Sep 11 13:01:14.201167 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:01:14.201140    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5f91c1e_a86a_47ca_be91_e252b22b8a9d.slice/crio-9b6b3eb759ae7a868e174e280c20edc3bd65efee52fbb8798b5438e59b9df240 WatchSource:0}: Error finding container 9b6b3eb759ae7a868e174e280c20edc3bd65efee52fbb8798b5438e59b9df240: Status 404 returned error can't find the container with id 9b6b3eb759ae7a868e174e280c20edc3bd65efee52fbb8798b5438e59b9df240
Sep 11 13:01:14.208689 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:14.208658    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-skp7s" event={"ID":"b5f91c1e-a86a-47ca-be91-e252b22b8a9d","Type":"ContainerStarted","Data":"9b6b3eb759ae7a868e174e280c20edc3bd65efee52fbb8798b5438e59b9df240"}
Sep 11 13:01:15.220615 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:15.219515    2547 generic.go:356] "Generic (PLEG): container finished" podID="6207b30d-1940-4d43-a570-7c839fa70758" containerID="b9356faa93a55fcfce0acdc1336e923227051b6274ae51b96f78740c57b3e9d9" exitCode=0
Sep 11 13:01:15.220615 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:15.219615    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rv7z4" event={"ID":"6207b30d-1940-4d43-a570-7c839fa70758","Type":"ContainerDied","Data":"b9356faa93a55fcfce0acdc1336e923227051b6274ae51b96f78740c57b3e9d9"}
Sep 11 13:01:16.228187 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:16.228149    2547 generic.go:356] "Generic (PLEG): container finished" podID="6207b30d-1940-4d43-a570-7c839fa70758" containerID="e30ac05ce03ba0bf37d91ffc148f014bbbdc0f0168d226c879377f670caaad79" exitCode=0
Sep 11 13:01:16.228615 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:16.228232    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rv7z4" event={"ID":"6207b30d-1940-4d43-a570-7c839fa70758","Type":"ContainerDied","Data":"e30ac05ce03ba0bf37d91ffc148f014bbbdc0f0168d226c879377f670caaad79"}
Sep 11 13:01:17.364090 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:17.364069    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rv7z4"
Sep 11 13:01:17.382797 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:17.382744    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6207b30d-1940-4d43-a570-7c839fa70758-util\") pod \"6207b30d-1940-4d43-a570-7c839fa70758\" (UID: \"6207b30d-1940-4d43-a570-7c839fa70758\") "
Sep 11 13:01:17.382923 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:17.382857    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6207b30d-1940-4d43-a570-7c839fa70758-bundle\") pod \"6207b30d-1940-4d43-a570-7c839fa70758\" (UID: \"6207b30d-1940-4d43-a570-7c839fa70758\") "
Sep 11 13:01:17.382923 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:17.382919    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfgj5\" (UniqueName: \"kubernetes.io/projected/6207b30d-1940-4d43-a570-7c839fa70758-kube-api-access-xfgj5\") pod \"6207b30d-1940-4d43-a570-7c839fa70758\" (UID: \"6207b30d-1940-4d43-a570-7c839fa70758\") "
Sep 11 13:01:17.383908 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:17.383777    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6207b30d-1940-4d43-a570-7c839fa70758-bundle" (OuterVolumeSpecName: "bundle") pod "6207b30d-1940-4d43-a570-7c839fa70758" (UID: "6207b30d-1940-4d43-a570-7c839fa70758"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:01:17.386366 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:17.386334    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6207b30d-1940-4d43-a570-7c839fa70758-kube-api-access-xfgj5" (OuterVolumeSpecName: "kube-api-access-xfgj5") pod "6207b30d-1940-4d43-a570-7c839fa70758" (UID: "6207b30d-1940-4d43-a570-7c839fa70758"). InnerVolumeSpecName "kube-api-access-xfgj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:01:17.389224 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:17.389201    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6207b30d-1940-4d43-a570-7c839fa70758-util" (OuterVolumeSpecName: "util") pod "6207b30d-1940-4d43-a570-7c839fa70758" (UID: "6207b30d-1940-4d43-a570-7c839fa70758"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:01:17.484393 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:17.484319    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6207b30d-1940-4d43-a570-7c839fa70758-util\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:01:17.484393 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:17.484347    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6207b30d-1940-4d43-a570-7c839fa70758-bundle\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:01:17.484393 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:17.484356    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfgj5\" (UniqueName: \"kubernetes.io/projected/6207b30d-1940-4d43-a570-7c839fa70758-kube-api-access-xfgj5\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:01:18.239151 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:18.239113    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-skp7s" event={"ID":"b5f91c1e-a86a-47ca-be91-e252b22b8a9d","Type":"ContainerStarted","Data":"5ecbc0d07a4c467667876a06dde082707b7e830d49c4a49b990db2ba8292904a"}
Sep 11 13:01:18.241128 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:18.241102    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rv7z4" event={"ID":"6207b30d-1940-4d43-a570-7c839fa70758","Type":"ContainerDied","Data":"648807fa4a2a6bb90d47631a786689ffdab4b63879b7af6801216fc9a6f2a6df"}
Sep 11 13:01:18.241265 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:18.241136    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rv7z4"
Sep 11 13:01:18.241265 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:18.241140    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="648807fa4a2a6bb90d47631a786689ffdab4b63879b7af6801216fc9a6f2a6df"
Sep 11 13:01:19.247099 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:19.247067    2547 generic.go:356] "Generic (PLEG): container finished" podID="b5f91c1e-a86a-47ca-be91-e252b22b8a9d" containerID="5ecbc0d07a4c467667876a06dde082707b7e830d49c4a49b990db2ba8292904a" exitCode=0
Sep 11 13:01:19.247463 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:19.247140    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-skp7s" event={"ID":"b5f91c1e-a86a-47ca-be91-e252b22b8a9d","Type":"ContainerDied","Data":"5ecbc0d07a4c467667876a06dde082707b7e830d49c4a49b990db2ba8292904a"}
Sep 11 13:01:21.258101 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:21.258065    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-skp7s" event={"ID":"b5f91c1e-a86a-47ca-be91-e252b22b8a9d","Type":"ContainerStarted","Data":"1a3d603c0f7020185855c995613af75bce897101312913e9bcdbb8087960c7e4"}
Sep 11 13:01:21.258500 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:21.258159    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-skp7s"
Sep 11 13:01:21.282606 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:21.282557    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-skp7s" podStartSLOduration=2.977468596 podStartE2EDuration="8.282542469s" totalImagesPullingTime="4.243815652s" totalInitContainerRuntime="1.061258221s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:01:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:01:21.280407703 +0000 UTC m=+348.141881891" watchObservedRunningTime="2026-09-11 13:01:21.282542469 +0000 UTC m=+348.144016657"
Sep 11 13:01:23.900240 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:23.900206    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:24.010243 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:24.010204    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:27.959571 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:27.959463    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:28.085688 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:28.085636    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:32.265026 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:32.264999    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-skp7s"
Sep 11 13:01:34.160282 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:34.160246    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:34.320184 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:34.320134    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:34.486547 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:34.486430    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:34.619072 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:34.619034    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-85d97b946f-kslsb"]
Sep 11 13:01:34.619369 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:34.619356    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6207b30d-1940-4d43-a570-7c839fa70758" containerName="util"
Sep 11 13:01:34.619419 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:34.619371    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="6207b30d-1940-4d43-a570-7c839fa70758" containerName="util"
Sep 11 13:01:34.619419 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:34.619381    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6207b30d-1940-4d43-a570-7c839fa70758" containerName="pull"
Sep 11 13:01:34.619419 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:34.619390    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="6207b30d-1940-4d43-a570-7c839fa70758" containerName="pull"
Sep 11 13:01:34.619419 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:34.619403    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6207b30d-1940-4d43-a570-7c839fa70758" containerName="extract"
Sep 11 13:01:34.619419 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:34.619410    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="6207b30d-1940-4d43-a570-7c839fa70758" containerName="extract"
Sep 11 13:01:34.619601 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:34.619472    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="6207b30d-1940-4d43-a570-7c839fa70758" containerName="extract"
Sep 11 13:01:34.624577 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:34.624557    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85d97b946f-kslsb"
Sep 11 13:01:34.629443 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:34.629420    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 11 13:01:34.629566 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:34.629467    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-z8vwk\""
Sep 11 13:01:34.632614 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:34.632591    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 11 13:01:34.643960 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:34.643937    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85d97b946f-kslsb"]
Sep 11 13:01:34.714108 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:34.714069    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5stpv\" (UniqueName: \"kubernetes.io/projected/85575799-be02-4bcc-81ba-a1ac1ee0fa71-kube-api-access-5stpv\") pod \"kube-auth-proxy-85d97b946f-kslsb\" (UID: \"85575799-be02-4bcc-81ba-a1ac1ee0fa71\") " pod="openshift-ingress/kube-auth-proxy-85d97b946f-kslsb"
Sep 11 13:01:34.714108 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:34.714116    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/85575799-be02-4bcc-81ba-a1ac1ee0fa71-tmp\") pod \"kube-auth-proxy-85d97b946f-kslsb\" (UID: \"85575799-be02-4bcc-81ba-a1ac1ee0fa71\") " pod="openshift-ingress/kube-auth-proxy-85d97b946f-kslsb"
Sep 11 13:01:34.714338 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:34.714183    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85575799-be02-4bcc-81ba-a1ac1ee0fa71-tls-certs\") pod \"kube-auth-proxy-85d97b946f-kslsb\" (UID: \"85575799-be02-4bcc-81ba-a1ac1ee0fa71\") " pod="openshift-ingress/kube-auth-proxy-85d97b946f-kslsb"
Sep 11 13:01:34.722055 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:34.722017    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:34.815458 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:34.815428    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5stpv\" (UniqueName: \"kubernetes.io/projected/85575799-be02-4bcc-81ba-a1ac1ee0fa71-kube-api-access-5stpv\") pod \"kube-auth-proxy-85d97b946f-kslsb\" (UID: \"85575799-be02-4bcc-81ba-a1ac1ee0fa71\") " pod="openshift-ingress/kube-auth-proxy-85d97b946f-kslsb"
Sep 11 13:01:34.815621 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:34.815478    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/85575799-be02-4bcc-81ba-a1ac1ee0fa71-tmp\") pod \"kube-auth-proxy-85d97b946f-kslsb\" (UID: \"85575799-be02-4bcc-81ba-a1ac1ee0fa71\") " pod="openshift-ingress/kube-auth-proxy-85d97b946f-kslsb"
Sep 11 13:01:34.815621 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:34.815512    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85575799-be02-4bcc-81ba-a1ac1ee0fa71-tls-certs\") pod \"kube-auth-proxy-85d97b946f-kslsb\" (UID: \"85575799-be02-4bcc-81ba-a1ac1ee0fa71\") " pod="openshift-ingress/kube-auth-proxy-85d97b946f-kslsb"
Sep 11 13:01:34.817994 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:34.817970    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/85575799-be02-4bcc-81ba-a1ac1ee0fa71-tmp\") pod \"kube-auth-proxy-85d97b946f-kslsb\" (UID: \"85575799-be02-4bcc-81ba-a1ac1ee0fa71\") " pod="openshift-ingress/kube-auth-proxy-85d97b946f-kslsb"
Sep 11 13:01:34.818093 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:34.818015    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85575799-be02-4bcc-81ba-a1ac1ee0fa71-tls-certs\") pod \"kube-auth-proxy-85d97b946f-kslsb\" (UID: \"85575799-be02-4bcc-81ba-a1ac1ee0fa71\") " pod="openshift-ingress/kube-auth-proxy-85d97b946f-kslsb"
Sep 11 13:01:34.834704 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:34.834682    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5stpv\" (UniqueName: \"kubernetes.io/projected/85575799-be02-4bcc-81ba-a1ac1ee0fa71-kube-api-access-5stpv\") pod \"kube-auth-proxy-85d97b946f-kslsb\" (UID: \"85575799-be02-4bcc-81ba-a1ac1ee0fa71\") " pod="openshift-ingress/kube-auth-proxy-85d97b946f-kslsb"
Sep 11 13:01:34.933888 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:34.933857    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85d97b946f-kslsb"
Sep 11 13:01:35.219578 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:35.219553    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85d97b946f-kslsb"]
Sep 11 13:01:35.222786 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:01:35.222764    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85575799_be02_4bcc_81ba_a1ac1ee0fa71.slice/crio-7095036281d019d97ccbb7e4495aa7509ef26cc0264ca5094a5ac8f05531ebc9 WatchSource:0}: Error finding container 7095036281d019d97ccbb7e4495aa7509ef26cc0264ca5094a5ac8f05531ebc9: Status 404 returned error can't find the container with id 7095036281d019d97ccbb7e4495aa7509ef26cc0264ca5094a5ac8f05531ebc9
Sep 11 13:01:35.325440 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:35.325401    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85d97b946f-kslsb" event={"ID":"85575799-be02-4bcc-81ba-a1ac1ee0fa71","Type":"ContainerStarted","Data":"7095036281d019d97ccbb7e4495aa7509ef26cc0264ca5094a5ac8f05531ebc9"}
Sep 11 13:01:36.622800 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:36.622753    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:36.708527 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:36.708478    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:37.719667 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:37.719624    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:38.353644 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:38.353608    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85d97b946f-kslsb" event={"ID":"85575799-be02-4bcc-81ba-a1ac1ee0fa71","Type":"ContainerStarted","Data":"f530b656a35ebceade39ff275801c9565cdb116199e30b09322cc4ab5fc5e624"}
Sep 11 13:01:38.390310 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:38.390251    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-85d97b946f-kslsb" podStartSLOduration=1.665640694 podStartE2EDuration="4.39023374s" totalImagesPullingTime="2.724593046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:01:38.388688694 +0000 UTC m=+365.250162881" watchObservedRunningTime="2026-09-11 13:01:38.39023374 +0000 UTC m=+365.251707928"
Sep 11 13:01:41.505535 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:41.505496    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:41.605498 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:41.605454    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:41.888666 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:41.888633    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cd99cffb8-wnfj9"]
Sep 11 13:01:41.892004 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:41.891983    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cd99cffb8-wnfj9"
Sep 11 13:01:41.895013 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:41.894990    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 11 13:01:41.895149 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:41.894990    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 11 13:01:41.895149 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:41.894990    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 11 13:01:41.895149 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:41.895052    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-dqx96\""
Sep 11 13:01:41.895484 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:41.895466    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 11 13:01:41.895484 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:41.895476    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 11 13:01:41.903589 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:41.903564    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cd99cffb8-wnfj9"]
Sep 11 13:01:41.986354 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:41.986314    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/03d9cd23-d60c-4c17-99ff-d1cf3a11bc3a-manager-config\") pod \"lws-controller-manager-5cd99cffb8-wnfj9\" (UID: \"03d9cd23-d60c-4c17-99ff-d1cf3a11bc3a\") " pod="openshift-lws-operator/lws-controller-manager-5cd99cffb8-wnfj9"
Sep 11 13:01:41.986557 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:41.986427    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkgfw\" (UniqueName: \"kubernetes.io/projected/03d9cd23-d60c-4c17-99ff-d1cf3a11bc3a-kube-api-access-dkgfw\") pod \"lws-controller-manager-5cd99cffb8-wnfj9\" (UID: \"03d9cd23-d60c-4c17-99ff-d1cf3a11bc3a\") " pod="openshift-lws-operator/lws-controller-manager-5cd99cffb8-wnfj9"
Sep 11 13:01:41.986557 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:41.986461    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/03d9cd23-d60c-4c17-99ff-d1cf3a11bc3a-metrics-cert\") pod \"lws-controller-manager-5cd99cffb8-wnfj9\" (UID: \"03d9cd23-d60c-4c17-99ff-d1cf3a11bc3a\") " pod="openshift-lws-operator/lws-controller-manager-5cd99cffb8-wnfj9"
Sep 11 13:01:41.986557 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:41.986509    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/03d9cd23-d60c-4c17-99ff-d1cf3a11bc3a-cert\") pod \"lws-controller-manager-5cd99cffb8-wnfj9\" (UID: \"03d9cd23-d60c-4c17-99ff-d1cf3a11bc3a\") " pod="openshift-lws-operator/lws-controller-manager-5cd99cffb8-wnfj9"
Sep 11 13:01:42.087224 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:42.087188    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/03d9cd23-d60c-4c17-99ff-d1cf3a11bc3a-metrics-cert\") pod \"lws-controller-manager-5cd99cffb8-wnfj9\" (UID: \"03d9cd23-d60c-4c17-99ff-d1cf3a11bc3a\") " pod="openshift-lws-operator/lws-controller-manager-5cd99cffb8-wnfj9"
Sep 11 13:01:42.087224 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:42.087229    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/03d9cd23-d60c-4c17-99ff-d1cf3a11bc3a-cert\") pod \"lws-controller-manager-5cd99cffb8-wnfj9\" (UID: \"03d9cd23-d60c-4c17-99ff-d1cf3a11bc3a\") " pod="openshift-lws-operator/lws-controller-manager-5cd99cffb8-wnfj9"
Sep 11 13:01:42.087499 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:42.087268    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/03d9cd23-d60c-4c17-99ff-d1cf3a11bc3a-manager-config\") pod \"lws-controller-manager-5cd99cffb8-wnfj9\" (UID: \"03d9cd23-d60c-4c17-99ff-d1cf3a11bc3a\") " pod="openshift-lws-operator/lws-controller-manager-5cd99cffb8-wnfj9"
Sep 11 13:01:42.087499 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:42.087345    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkgfw\" (UniqueName: \"kubernetes.io/projected/03d9cd23-d60c-4c17-99ff-d1cf3a11bc3a-kube-api-access-dkgfw\") pod \"lws-controller-manager-5cd99cffb8-wnfj9\" (UID: \"03d9cd23-d60c-4c17-99ff-d1cf3a11bc3a\") " pod="openshift-lws-operator/lws-controller-manager-5cd99cffb8-wnfj9"
Sep 11 13:01:42.088022 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:42.088004    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/03d9cd23-d60c-4c17-99ff-d1cf3a11bc3a-manager-config\") pod \"lws-controller-manager-5cd99cffb8-wnfj9\" (UID: \"03d9cd23-d60c-4c17-99ff-d1cf3a11bc3a\") " pod="openshift-lws-operator/lws-controller-manager-5cd99cffb8-wnfj9"
Sep 11 13:01:42.089883 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:42.089861    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/03d9cd23-d60c-4c17-99ff-d1cf3a11bc3a-cert\") pod \"lws-controller-manager-5cd99cffb8-wnfj9\" (UID: \"03d9cd23-d60c-4c17-99ff-d1cf3a11bc3a\") " pod="openshift-lws-operator/lws-controller-manager-5cd99cffb8-wnfj9"
Sep 11 13:01:42.089998 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:42.089979    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/03d9cd23-d60c-4c17-99ff-d1cf3a11bc3a-metrics-cert\") pod \"lws-controller-manager-5cd99cffb8-wnfj9\" (UID: \"03d9cd23-d60c-4c17-99ff-d1cf3a11bc3a\") " pod="openshift-lws-operator/lws-controller-manager-5cd99cffb8-wnfj9"
Sep 11 13:01:42.102846 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:42.102823    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkgfw\" (UniqueName: \"kubernetes.io/projected/03d9cd23-d60c-4c17-99ff-d1cf3a11bc3a-kube-api-access-dkgfw\") pod \"lws-controller-manager-5cd99cffb8-wnfj9\" (UID: \"03d9cd23-d60c-4c17-99ff-d1cf3a11bc3a\") " pod="openshift-lws-operator/lws-controller-manager-5cd99cffb8-wnfj9"
Sep 11 13:01:42.201890 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:42.201793    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cd99cffb8-wnfj9"
Sep 11 13:01:42.332227 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:42.332191    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:42.458827 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:42.458748    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:42.484086 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:42.484056    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cd99cffb8-wnfj9"]
Sep 11 13:01:42.486827 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:01:42.486804    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03d9cd23_d60c_4c17_99ff_d1cf3a11bc3a.slice/crio-a14dbd5473fd21078ec0c1cce9ddf6e83c18067ac8f64d585c38990d0d7bffb8 WatchSource:0}: Error finding container a14dbd5473fd21078ec0c1cce9ddf6e83c18067ac8f64d585c38990d0d7bffb8: Status 404 returned error can't find the container with id a14dbd5473fd21078ec0c1cce9ddf6e83c18067ac8f64d585c38990d0d7bffb8
Sep 11 13:01:42.609898 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:42.609857    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:43.379778 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:43.379742    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cd99cffb8-wnfj9" event={"ID":"03d9cd23-d60c-4c17-99ff-d1cf3a11bc3a","Type":"ContainerStarted","Data":"a14dbd5473fd21078ec0c1cce9ddf6e83c18067ac8f64d585c38990d0d7bffb8"}
Sep 11 13:01:44.386341 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:44.386258    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cd99cffb8-wnfj9" event={"ID":"03d9cd23-d60c-4c17-99ff-d1cf3a11bc3a","Type":"ContainerStarted","Data":"e46c0cb08dad8febe46dbf7478417e2cbf50017f6bd0f830ba790398195b3e57"}
Sep 11 13:01:44.386679 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:44.386407    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5cd99cffb8-wnfj9"
Sep 11 13:01:44.404833 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:44.404781    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5cd99cffb8-wnfj9" podStartSLOduration=1.790328037 podStartE2EDuration="3.404764634s" totalImagesPullingTime="1.614436597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:01:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:01:44.402831818 +0000 UTC m=+371.264306008" watchObservedRunningTime="2026-09-11 13:01:44.404764634 +0000 UTC m=+371.266238821"
Sep 11 13:01:45.574202 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:45.574168    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:45.671366 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:45.671303    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:45.764244 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:45.764206    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:45.867883 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:45.867791    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:46.097532 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:46.097503    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:46.309126 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:46.309093    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:49.550963 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:49.550921    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:49.634410 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:49.634355    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:55.394555 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:55.394523    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5cd99cffb8-wnfj9"
Sep 11 13:01:55.665595 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:55.665488    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:55.794283 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:55.794248    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:56.021554 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:56.021466    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:56.406672 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:56.406630    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:56.983756 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:56.983672    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:57.087413 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:57.087376    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:57.298022 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:01:57.297916    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:09.954005 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:09.953970    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-666bf8f6c5-944qj"]
Sep 11 13:02:09.958773 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:09.958749    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-666bf8f6c5-944qj"
Sep 11 13:02:09.975230 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:09.975203    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-666bf8f6c5-944qj"]
Sep 11 13:02:10.026322 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:10.026290    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:10.099223 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:10.099189    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:10.134284 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:10.134245    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4957857-10f5-40a3-b86c-35f4bec85b19-console-serving-cert\") pod \"console-666bf8f6c5-944qj\" (UID: \"a4957857-10f5-40a3-b86c-35f4bec85b19\") " pod="openshift-console/console-666bf8f6c5-944qj"
Sep 11 13:02:10.134441 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:10.134292    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9kxt\" (UniqueName: \"kubernetes.io/projected/a4957857-10f5-40a3-b86c-35f4bec85b19-kube-api-access-f9kxt\") pod \"console-666bf8f6c5-944qj\" (UID: \"a4957857-10f5-40a3-b86c-35f4bec85b19\") " pod="openshift-console/console-666bf8f6c5-944qj"
Sep 11 13:02:10.134441 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:10.134377    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4957857-10f5-40a3-b86c-35f4bec85b19-console-config\") pod \"console-666bf8f6c5-944qj\" (UID: \"a4957857-10f5-40a3-b86c-35f4bec85b19\") " pod="openshift-console/console-666bf8f6c5-944qj"
Sep 11 13:02:10.134548 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:10.134435    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4957857-10f5-40a3-b86c-35f4bec85b19-service-ca\") pod \"console-666bf8f6c5-944qj\" (UID: \"a4957857-10f5-40a3-b86c-35f4bec85b19\") " pod="openshift-console/console-666bf8f6c5-944qj"
Sep 11 13:02:10.134548 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:10.134473    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4957857-10f5-40a3-b86c-35f4bec85b19-trusted-ca-bundle\") pod \"console-666bf8f6c5-944qj\" (UID: \"a4957857-10f5-40a3-b86c-35f4bec85b19\") " pod="openshift-console/console-666bf8f6c5-944qj"
Sep 11 13:02:10.134548 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:10.134494    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4957857-10f5-40a3-b86c-35f4bec85b19-console-oauth-config\") pod \"console-666bf8f6c5-944qj\" (UID: \"a4957857-10f5-40a3-b86c-35f4bec85b19\") " pod="openshift-console/console-666bf8f6c5-944qj"
Sep 11 13:02:10.134548 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:10.134521    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4957857-10f5-40a3-b86c-35f4bec85b19-oauth-serving-cert\") pod \"console-666bf8f6c5-944qj\" (UID: \"a4957857-10f5-40a3-b86c-35f4bec85b19\") " pod="openshift-console/console-666bf8f6c5-944qj"
Sep 11 13:02:10.177817 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:10.177784    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:10.235007 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:10.234940    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4957857-10f5-40a3-b86c-35f4bec85b19-console-config\") pod \"console-666bf8f6c5-944qj\" (UID: \"a4957857-10f5-40a3-b86c-35f4bec85b19\") " pod="openshift-console/console-666bf8f6c5-944qj"
Sep 11 13:02:10.235007 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:10.234980    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4957857-10f5-40a3-b86c-35f4bec85b19-service-ca\") pod \"console-666bf8f6c5-944qj\" (UID: \"a4957857-10f5-40a3-b86c-35f4bec85b19\") " pod="openshift-console/console-666bf8f6c5-944qj"
Sep 11 13:02:10.235161 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:10.235041    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4957857-10f5-40a3-b86c-35f4bec85b19-trusted-ca-bundle\") pod \"console-666bf8f6c5-944qj\" (UID: \"a4957857-10f5-40a3-b86c-35f4bec85b19\") " pod="openshift-console/console-666bf8f6c5-944qj"
Sep 11 13:02:10.235161 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:10.235067    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4957857-10f5-40a3-b86c-35f4bec85b19-console-oauth-config\") pod \"console-666bf8f6c5-944qj\" (UID: \"a4957857-10f5-40a3-b86c-35f4bec85b19\") " pod="openshift-console/console-666bf8f6c5-944qj"
Sep 11 13:02:10.235161 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:10.235097    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4957857-10f5-40a3-b86c-35f4bec85b19-oauth-serving-cert\") pod \"console-666bf8f6c5-944qj\" (UID: \"a4957857-10f5-40a3-b86c-35f4bec85b19\") " pod="openshift-console/console-666bf8f6c5-944qj"
Sep 11 13:02:10.235161 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:10.235123    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4957857-10f5-40a3-b86c-35f4bec85b19-console-serving-cert\") pod \"console-666bf8f6c5-944qj\" (UID: \"a4957857-10f5-40a3-b86c-35f4bec85b19\") " pod="openshift-console/console-666bf8f6c5-944qj"
Sep 11 13:02:10.235161 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:10.235152    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9kxt\" (UniqueName: \"kubernetes.io/projected/a4957857-10f5-40a3-b86c-35f4bec85b19-kube-api-access-f9kxt\") pod \"console-666bf8f6c5-944qj\" (UID: \"a4957857-10f5-40a3-b86c-35f4bec85b19\") " pod="openshift-console/console-666bf8f6c5-944qj"
Sep 11 13:02:10.235812 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:10.235752    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4957857-10f5-40a3-b86c-35f4bec85b19-console-config\") pod \"console-666bf8f6c5-944qj\" (UID: \"a4957857-10f5-40a3-b86c-35f4bec85b19\") " pod="openshift-console/console-666bf8f6c5-944qj"
Sep 11 13:02:10.236095 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:10.235913    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4957857-10f5-40a3-b86c-35f4bec85b19-service-ca\") pod \"console-666bf8f6c5-944qj\" (UID: \"a4957857-10f5-40a3-b86c-35f4bec85b19\") " pod="openshift-console/console-666bf8f6c5-944qj"
Sep 11 13:02:10.236095 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:10.235917    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4957857-10f5-40a3-b86c-35f4bec85b19-trusted-ca-bundle\") pod \"console-666bf8f6c5-944qj\" (UID: \"a4957857-10f5-40a3-b86c-35f4bec85b19\") " pod="openshift-console/console-666bf8f6c5-944qj"
Sep 11 13:02:10.236095 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:10.235959    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4957857-10f5-40a3-b86c-35f4bec85b19-oauth-serving-cert\") pod \"console-666bf8f6c5-944qj\" (UID: \"a4957857-10f5-40a3-b86c-35f4bec85b19\") " pod="openshift-console/console-666bf8f6c5-944qj"
Sep 11 13:02:10.237673 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:10.237653    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4957857-10f5-40a3-b86c-35f4bec85b19-console-oauth-config\") pod \"console-666bf8f6c5-944qj\" (UID: \"a4957857-10f5-40a3-b86c-35f4bec85b19\") " pod="openshift-console/console-666bf8f6c5-944qj"
Sep 11 13:02:10.237949 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:10.237928    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4957857-10f5-40a3-b86c-35f4bec85b19-console-serving-cert\") pod \"console-666bf8f6c5-944qj\" (UID: \"a4957857-10f5-40a3-b86c-35f4bec85b19\") " pod="openshift-console/console-666bf8f6c5-944qj"
Sep 11 13:02:10.243857 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:10.243832    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9kxt\" (UniqueName: \"kubernetes.io/projected/a4957857-10f5-40a3-b86c-35f4bec85b19-kube-api-access-f9kxt\") pod \"console-666bf8f6c5-944qj\" (UID: \"a4957857-10f5-40a3-b86c-35f4bec85b19\") " pod="openshift-console/console-666bf8f6c5-944qj"
Sep 11 13:02:10.269759 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:10.269733    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-666bf8f6c5-944qj"
Sep 11 13:02:10.548421 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:10.548397    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-666bf8f6c5-944qj"]
Sep 11 13:02:10.550380 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:02:10.550354    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4957857_10f5_40a3_b86c_35f4bec85b19.slice/crio-a5b2d3c6f90ae48c68e2c73f359ce8dcfba51b4bf285aaa71f5259ecdf0be85b WatchSource:0}: Error finding container a5b2d3c6f90ae48c68e2c73f359ce8dcfba51b4bf285aaa71f5259ecdf0be85b: Status 404 returned error can't find the container with id a5b2d3c6f90ae48c68e2c73f359ce8dcfba51b4bf285aaa71f5259ecdf0be85b
Sep 11 13:02:10.756898 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:10.756863    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:10.838693 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:10.838663    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:11.533695 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:11.533660    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-666bf8f6c5-944qj" event={"ID":"a4957857-10f5-40a3-b86c-35f4bec85b19","Type":"ContainerStarted","Data":"ab9fb960cca60d599443c69827605c391a08e2a741c992113bd38b3cc3dfeaf9"}
Sep 11 13:02:11.534104 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:11.533707    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-666bf8f6c5-944qj" event={"ID":"a4957857-10f5-40a3-b86c-35f4bec85b19","Type":"ContainerStarted","Data":"a5b2d3c6f90ae48c68e2c73f359ce8dcfba51b4bf285aaa71f5259ecdf0be85b"}
Sep 11 13:02:11.551174 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:11.551126    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-666bf8f6c5-944qj" podStartSLOduration=2.551109757 podStartE2EDuration="2.551109757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:02:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:02:11.550705849 +0000 UTC m=+398.412180040" watchObservedRunningTime="2026-09-11 13:02:11.551109757 +0000 UTC m=+398.412583945"
Sep 11 13:02:20.270903 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:20.270860    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-666bf8f6c5-944qj"
Sep 11 13:02:20.271379 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:20.270921    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-666bf8f6c5-944qj"
Sep 11 13:02:20.275677 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:20.275653    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-666bf8f6c5-944qj"
Sep 11 13:02:20.583509 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:20.583481    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-666bf8f6c5-944qj"
Sep 11 13:02:20.644552 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:20.644519    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b87575865-72br6"]
Sep 11 13:02:20.756577 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:20.756540    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:20.857178 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:20.857088    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:20.957270 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:20.957231    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:27.652117 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:27.652079    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:29.391384 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:29.391351    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:32.476293 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:32.476260    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:45.666748 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:45.666693    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b87575865-72br6" podUID="12daf3d9-4f01-4ff9-b31d-cfc5294797ac" containerName="console" containerID="cri-o://2f52d218ec74eddd8d99455a1c177407acbe775c692c51c5a7a72aeab6a7155f" gracePeriod=15
Sep 11 13:02:45.919202 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:45.919148    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b87575865-72br6"
Sep 11 13:02:46.032710 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.032662    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8q4jr\" (UniqueName: \"kubernetes.io/projected/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-kube-api-access-8q4jr\") pod \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\" (UID: \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\") "
Sep 11 13:02:46.032710 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.032726    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-console-serving-cert\") pod \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\" (UID: \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\") "
Sep 11 13:02:46.032962 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.032769    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-console-config\") pod \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\" (UID: \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\") "
Sep 11 13:02:46.032962 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.032819    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-service-ca\") pod \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\" (UID: \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\") "
Sep 11 13:02:46.032962 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.032844    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-trusted-ca-bundle\") pod \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\" (UID: \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\") "
Sep 11 13:02:46.032962 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.032870    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-oauth-serving-cert\") pod \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\" (UID: \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\") "
Sep 11 13:02:46.032962 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.032886    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-console-oauth-config\") pod \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\" (UID: \"12daf3d9-4f01-4ff9-b31d-cfc5294797ac\") "
Sep 11 13:02:46.033330 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.033298    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-console-config" (OuterVolumeSpecName: "console-config") pod "12daf3d9-4f01-4ff9-b31d-cfc5294797ac" (UID: "12daf3d9-4f01-4ff9-b31d-cfc5294797ac"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:02:46.033330 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.033310    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-service-ca" (OuterVolumeSpecName: "service-ca") pod "12daf3d9-4f01-4ff9-b31d-cfc5294797ac" (UID: "12daf3d9-4f01-4ff9-b31d-cfc5294797ac"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:02:46.033447 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.033318    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "12daf3d9-4f01-4ff9-b31d-cfc5294797ac" (UID: "12daf3d9-4f01-4ff9-b31d-cfc5294797ac"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:02:46.033447 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.033328    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "12daf3d9-4f01-4ff9-b31d-cfc5294797ac" (UID: "12daf3d9-4f01-4ff9-b31d-cfc5294797ac"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:02:46.034974 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.034955    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-kube-api-access-8q4jr" (OuterVolumeSpecName: "kube-api-access-8q4jr") pod "12daf3d9-4f01-4ff9-b31d-cfc5294797ac" (UID: "12daf3d9-4f01-4ff9-b31d-cfc5294797ac"). InnerVolumeSpecName "kube-api-access-8q4jr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:02:46.035098 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.035077    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "12daf3d9-4f01-4ff9-b31d-cfc5294797ac" (UID: "12daf3d9-4f01-4ff9-b31d-cfc5294797ac"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:02:46.035181 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.035160    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "12daf3d9-4f01-4ff9-b31d-cfc5294797ac" (UID: "12daf3d9-4f01-4ff9-b31d-cfc5294797ac"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:02:46.133689 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.133649    2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-trusted-ca-bundle\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:02:46.133689 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.133686    2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-oauth-serving-cert\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:02:46.133881 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.133699    2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-console-oauth-config\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:02:46.133881 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.133738    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8q4jr\" (UniqueName: \"kubernetes.io/projected/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-kube-api-access-8q4jr\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:02:46.133881 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.133751    2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-console-serving-cert\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:02:46.133881 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.133762    2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-console-config\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:02:46.133881 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.133776    2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12daf3d9-4f01-4ff9-b31d-cfc5294797ac-service-ca\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:02:46.327981 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.327945    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:46.426844 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.426811    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:46.709034 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.708938    2547 generic.go:356] "Generic (PLEG): container finished" podID="12daf3d9-4f01-4ff9-b31d-cfc5294797ac" containerID="2f52d218ec74eddd8d99455a1c177407acbe775c692c51c5a7a72aeab6a7155f" exitCode=0
Sep 11 13:02:46.709034 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.708986    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b87575865-72br6"
Sep 11 13:02:46.709504 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.709030    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b87575865-72br6" event={"ID":"12daf3d9-4f01-4ff9-b31d-cfc5294797ac","Type":"ContainerDied","Data":"2f52d218ec74eddd8d99455a1c177407acbe775c692c51c5a7a72aeab6a7155f"}
Sep 11 13:02:46.709504 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.709084    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b87575865-72br6" event={"ID":"12daf3d9-4f01-4ff9-b31d-cfc5294797ac","Type":"ContainerDied","Data":"03f3bea46819e9ed3263f163bc160f1326fb0b69c701757e1a14c4d93ee83153"}
Sep 11 13:02:46.709504 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.709111    2547 scope.go:117] "RemoveContainer" containerID="2f52d218ec74eddd8d99455a1c177407acbe775c692c51c5a7a72aeab6a7155f"
Sep 11 13:02:46.718729 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.718698    2547 scope.go:117] "RemoveContainer" containerID="2f52d218ec74eddd8d99455a1c177407acbe775c692c51c5a7a72aeab6a7155f"
Sep 11 13:02:46.719040 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:02:46.719019    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f52d218ec74eddd8d99455a1c177407acbe775c692c51c5a7a72aeab6a7155f\": container with ID starting with 2f52d218ec74eddd8d99455a1c177407acbe775c692c51c5a7a72aeab6a7155f not found: ID does not exist" containerID="2f52d218ec74eddd8d99455a1c177407acbe775c692c51c5a7a72aeab6a7155f"
Sep 11 13:02:46.719103 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.719048    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f52d218ec74eddd8d99455a1c177407acbe775c692c51c5a7a72aeab6a7155f"} err="failed to get container status \"2f52d218ec74eddd8d99455a1c177407acbe775c692c51c5a7a72aeab6a7155f\": rpc error: code = NotFound desc = could not find container \"2f52d218ec74eddd8d99455a1c177407acbe775c692c51c5a7a72aeab6a7155f\": container with ID starting with 2f52d218ec74eddd8d99455a1c177407acbe775c692c51c5a7a72aeab6a7155f not found: ID does not exist"
Sep 11 13:02:46.740052 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.740029    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b87575865-72br6"]
Sep 11 13:02:46.767374 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:46.767348    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b87575865-72br6"]
Sep 11 13:02:47.663231 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:47.663200    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12daf3d9-4f01-4ff9-b31d-cfc5294797ac" path="/var/lib/kubelet/pods/12daf3d9-4f01-4ff9-b31d-cfc5294797ac/volumes"
Sep 11 13:02:51.228569 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.228527    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r85np"]
Sep 11 13:02:51.229179 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.229024    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12daf3d9-4f01-4ff9-b31d-cfc5294797ac" containerName="console"
Sep 11 13:02:51.229179 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.229043    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="12daf3d9-4f01-4ff9-b31d-cfc5294797ac" containerName="console"
Sep 11 13:02:51.229179 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.229157    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="12daf3d9-4f01-4ff9-b31d-cfc5294797ac" containerName="console"
Sep 11 13:02:51.233552 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.233530    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r85np"
Sep 11 13:02:51.235979 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.235948    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 13:02:51.236731 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.236702    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pmvq6\""
Sep 11 13:02:51.236794 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.236766    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 13:02:51.241729 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.241693    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r85np"]
Sep 11 13:02:51.323731 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.323696    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c656p6k"]
Sep 11 13:02:51.327220 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.327203    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c656p6k"
Sep 11 13:02:51.336596 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.336571    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c656p6k"]
Sep 11 13:02:51.377206 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.377175    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e41b2e51-bd81-4d60-a051-f6daa609c64c-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r85np\" (UID: \"e41b2e51-bd81-4d60-a051-f6daa609c64c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r85np"
Sep 11 13:02:51.377371 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.377211    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xsl7\" (UniqueName: \"kubernetes.io/projected/e41b2e51-bd81-4d60-a051-f6daa609c64c-kube-api-access-4xsl7\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r85np\" (UID: \"e41b2e51-bd81-4d60-a051-f6daa609c64c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r85np"
Sep 11 13:02:51.377371 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.377254    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e41b2e51-bd81-4d60-a051-f6daa609c64c-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r85np\" (UID: \"e41b2e51-bd81-4d60-a051-f6daa609c64c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r85np"
Sep 11 13:02:51.430804 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.430777    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amqqnm"]
Sep 11 13:02:51.434336 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.434320    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amqqnm"
Sep 11 13:02:51.443637 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.443613    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amqqnm"]
Sep 11 13:02:51.477800 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.477769    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e41b2e51-bd81-4d60-a051-f6daa609c64c-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r85np\" (UID: \"e41b2e51-bd81-4d60-a051-f6daa609c64c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r85np"
Sep 11 13:02:51.477919 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.477806    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xsl7\" (UniqueName: \"kubernetes.io/projected/e41b2e51-bd81-4d60-a051-f6daa609c64c-kube-api-access-4xsl7\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r85np\" (UID: \"e41b2e51-bd81-4d60-a051-f6daa609c64c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r85np"
Sep 11 13:02:51.477919 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.477857    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbhdr\" (UniqueName: \"kubernetes.io/projected/60c70fc1-d563-459c-b0c8-2725678fed9c-kube-api-access-rbhdr\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c656p6k\" (UID: \"60c70fc1-d563-459c-b0c8-2725678fed9c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c656p6k"
Sep 11 13:02:51.477919 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.477886    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e41b2e51-bd81-4d60-a051-f6daa609c64c-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r85np\" (UID: \"e41b2e51-bd81-4d60-a051-f6daa609c64c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r85np"
Sep 11 13:02:51.478061 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.477929    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60c70fc1-d563-459c-b0c8-2725678fed9c-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c656p6k\" (UID: \"60c70fc1-d563-459c-b0c8-2725678fed9c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c656p6k"
Sep 11 13:02:51.478061 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.478030    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60c70fc1-d563-459c-b0c8-2725678fed9c-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c656p6k\" (UID: \"60c70fc1-d563-459c-b0c8-2725678fed9c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c656p6k"
Sep 11 13:02:51.478166 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.478150    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e41b2e51-bd81-4d60-a051-f6daa609c64c-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r85np\" (UID: \"e41b2e51-bd81-4d60-a051-f6daa609c64c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r85np"
Sep 11 13:02:51.478202 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.478179    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e41b2e51-bd81-4d60-a051-f6daa609c64c-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r85np\" (UID: \"e41b2e51-bd81-4d60-a051-f6daa609c64c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r85np"
Sep 11 13:02:51.487060 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.487007    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xsl7\" (UniqueName: \"kubernetes.io/projected/e41b2e51-bd81-4d60-a051-f6daa609c64c-kube-api-access-4xsl7\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r85np\" (UID: \"e41b2e51-bd81-4d60-a051-f6daa609c64c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r85np"
Sep 11 13:02:51.544117 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.544089    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r85np"
Sep 11 13:02:51.547009 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.546985    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2zhw"]
Sep 11 13:02:51.550496 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.550480    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2zhw"
Sep 11 13:02:51.559958 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.559938    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2zhw"]
Sep 11 13:02:51.578607 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.578556    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbhdr\" (UniqueName: \"kubernetes.io/projected/60c70fc1-d563-459c-b0c8-2725678fed9c-kube-api-access-rbhdr\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c656p6k\" (UID: \"60c70fc1-d563-459c-b0c8-2725678fed9c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c656p6k"
Sep 11 13:02:51.578781 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.578621    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/506b8e26-79cc-48b1-a27e-e08ab47ed49c-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amqqnm\" (UID: \"506b8e26-79cc-48b1-a27e-e08ab47ed49c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amqqnm"
Sep 11 13:02:51.578781 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.578669    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60c70fc1-d563-459c-b0c8-2725678fed9c-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c656p6k\" (UID: \"60c70fc1-d563-459c-b0c8-2725678fed9c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c656p6k"
Sep 11 13:02:51.578781 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.578703    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60c70fc1-d563-459c-b0c8-2725678fed9c-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c656p6k\" (UID: \"60c70fc1-d563-459c-b0c8-2725678fed9c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c656p6k"
Sep 11 13:02:51.578781 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.578775    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77g8w\" (UniqueName: \"kubernetes.io/projected/506b8e26-79cc-48b1-a27e-e08ab47ed49c-kube-api-access-77g8w\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amqqnm\" (UID: \"506b8e26-79cc-48b1-a27e-e08ab47ed49c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amqqnm"
Sep 11 13:02:51.579039 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.578809    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/506b8e26-79cc-48b1-a27e-e08ab47ed49c-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amqqnm\" (UID: \"506b8e26-79cc-48b1-a27e-e08ab47ed49c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amqqnm"
Sep 11 13:02:51.579103 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.579075    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60c70fc1-d563-459c-b0c8-2725678fed9c-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c656p6k\" (UID: \"60c70fc1-d563-459c-b0c8-2725678fed9c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c656p6k"
Sep 11 13:02:51.579152 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.579115    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60c70fc1-d563-459c-b0c8-2725678fed9c-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c656p6k\" (UID: \"60c70fc1-d563-459c-b0c8-2725678fed9c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c656p6k"
Sep 11 13:02:51.589662 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.589635    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbhdr\" (UniqueName: \"kubernetes.io/projected/60c70fc1-d563-459c-b0c8-2725678fed9c-kube-api-access-rbhdr\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c656p6k\" (UID: \"60c70fc1-d563-459c-b0c8-2725678fed9c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c656p6k"
Sep 11 13:02:51.636591 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.636564    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c656p6k"
Sep 11 13:02:51.679962 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.679926    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/506b8e26-79cc-48b1-a27e-e08ab47ed49c-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amqqnm\" (UID: \"506b8e26-79cc-48b1-a27e-e08ab47ed49c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amqqnm"
Sep 11 13:02:51.680140 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.679971    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8deb63b3-1a03-48ee-bb9f-026615735ee2-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2zhw\" (UID: \"8deb63b3-1a03-48ee-bb9f-026615735ee2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2zhw"
Sep 11 13:02:51.680140 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.680041    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77g8w\" (UniqueName: \"kubernetes.io/projected/506b8e26-79cc-48b1-a27e-e08ab47ed49c-kube-api-access-77g8w\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amqqnm\" (UID: \"506b8e26-79cc-48b1-a27e-e08ab47ed49c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amqqnm"
Sep 11 13:02:51.680140 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.680073    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/506b8e26-79cc-48b1-a27e-e08ab47ed49c-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amqqnm\" (UID: \"506b8e26-79cc-48b1-a27e-e08ab47ed49c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amqqnm"
Sep 11 13:02:51.680297 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.680169    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js7sx\" (UniqueName: \"kubernetes.io/projected/8deb63b3-1a03-48ee-bb9f-026615735ee2-kube-api-access-js7sx\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2zhw\" (UID: \"8deb63b3-1a03-48ee-bb9f-026615735ee2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2zhw"
Sep 11 13:02:51.680297 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.680254    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8deb63b3-1a03-48ee-bb9f-026615735ee2-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2zhw\" (UID: \"8deb63b3-1a03-48ee-bb9f-026615735ee2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2zhw"
Sep 11 13:02:51.680428 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.680403    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/506b8e26-79cc-48b1-a27e-e08ab47ed49c-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amqqnm\" (UID: \"506b8e26-79cc-48b1-a27e-e08ab47ed49c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amqqnm"
Sep 11 13:02:51.680580 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.680560    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/506b8e26-79cc-48b1-a27e-e08ab47ed49c-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amqqnm\" (UID: \"506b8e26-79cc-48b1-a27e-e08ab47ed49c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amqqnm"
Sep 11 13:02:51.691447 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.691423    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77g8w\" (UniqueName: \"kubernetes.io/projected/506b8e26-79cc-48b1-a27e-e08ab47ed49c-kube-api-access-77g8w\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amqqnm\" (UID: \"506b8e26-79cc-48b1-a27e-e08ab47ed49c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amqqnm"
Sep 11 13:02:51.743980 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.743894    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amqqnm"
Sep 11 13:02:51.781266 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.781232    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js7sx\" (UniqueName: \"kubernetes.io/projected/8deb63b3-1a03-48ee-bb9f-026615735ee2-kube-api-access-js7sx\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2zhw\" (UID: \"8deb63b3-1a03-48ee-bb9f-026615735ee2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2zhw"
Sep 11 13:02:51.781418 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.781287    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8deb63b3-1a03-48ee-bb9f-026615735ee2-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2zhw\" (UID: \"8deb63b3-1a03-48ee-bb9f-026615735ee2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2zhw"
Sep 11 13:02:51.781418 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.781312    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8deb63b3-1a03-48ee-bb9f-026615735ee2-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2zhw\" (UID: \"8deb63b3-1a03-48ee-bb9f-026615735ee2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2zhw"
Sep 11 13:02:51.781659 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.781645    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8deb63b3-1a03-48ee-bb9f-026615735ee2-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2zhw\" (UID: \"8deb63b3-1a03-48ee-bb9f-026615735ee2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2zhw"
Sep 11 13:02:51.781728 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.781698    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8deb63b3-1a03-48ee-bb9f-026615735ee2-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2zhw\" (UID: \"8deb63b3-1a03-48ee-bb9f-026615735ee2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2zhw"
Sep 11 13:02:51.790640 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.790615    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-js7sx\" (UniqueName: \"kubernetes.io/projected/8deb63b3-1a03-48ee-bb9f-026615735ee2-kube-api-access-js7sx\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2zhw\" (UID: \"8deb63b3-1a03-48ee-bb9f-026615735ee2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2zhw"
Sep 11 13:02:51.827266 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.827242    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r85np"]
Sep 11 13:02:51.830435 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:02:51.830409    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode41b2e51_bd81_4d60_a051_f6daa609c64c.slice/crio-a6e6b8baa07e79b37b78be64ae5820ff1291da29f00cd5067d9a160114c5549e WatchSource:0}: Error finding container a6e6b8baa07e79b37b78be64ae5820ff1291da29f00cd5067d9a160114c5549e: Status 404 returned error can't find the container with id a6e6b8baa07e79b37b78be64ae5820ff1291da29f00cd5067d9a160114c5549e
Sep 11 13:02:51.875031 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.875000    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2zhw"
Sep 11 13:02:51.914492 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:51.914456    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c656p6k"]
Sep 11 13:02:51.915154 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:02:51.915125    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60c70fc1_d563_459c_b0c8_2725678fed9c.slice/crio-b9b0af1dd6fbda5bd9877451c6b904b689b7d47d8cde6b5b5f6334d6d72edbfa WatchSource:0}: Error finding container b9b0af1dd6fbda5bd9877451c6b904b689b7d47d8cde6b5b5f6334d6d72edbfa: Status 404 returned error can't find the container with id b9b0af1dd6fbda5bd9877451c6b904b689b7d47d8cde6b5b5f6334d6d72edbfa
Sep 11 13:02:52.018933 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:52.018899    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amqqnm"]
Sep 11 13:02:52.021624 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:02:52.021599    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod506b8e26_79cc_48b1_a27e_e08ab47ed49c.slice/crio-6e9b4155f9c8e8dce391d5daed3c30f6adeb43fa88b40dc4a843654bad542bf1 WatchSource:0}: Error finding container 6e9b4155f9c8e8dce391d5daed3c30f6adeb43fa88b40dc4a843654bad542bf1: Status 404 returned error can't find the container with id 6e9b4155f9c8e8dce391d5daed3c30f6adeb43fa88b40dc4a843654bad542bf1
Sep 11 13:02:52.156196 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:52.156169    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2zhw"]
Sep 11 13:02:52.179688 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:02:52.179661    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8deb63b3_1a03_48ee_bb9f_026615735ee2.slice/crio-50bce754b9b362e5011a9bd6fa29ed39fc8f526a854f40dae7d2fec87a29f2ac WatchSource:0}: Error finding container 50bce754b9b362e5011a9bd6fa29ed39fc8f526a854f40dae7d2fec87a29f2ac: Status 404 returned error can't find the container with id 50bce754b9b362e5011a9bd6fa29ed39fc8f526a854f40dae7d2fec87a29f2ac
Sep 11 13:02:52.742492 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:52.742455    2547 generic.go:356] "Generic (PLEG): container finished" podID="8deb63b3-1a03-48ee-bb9f-026615735ee2" containerID="16ce526c4d48c3de436bcead9160b2a5d8e8910b4ca9ba76cb0d0e3365cba55f" exitCode=0
Sep 11 13:02:52.743001 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:52.742528    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2zhw" event={"ID":"8deb63b3-1a03-48ee-bb9f-026615735ee2","Type":"ContainerDied","Data":"16ce526c4d48c3de436bcead9160b2a5d8e8910b4ca9ba76cb0d0e3365cba55f"}
Sep 11 13:02:52.743001 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:52.742614    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2zhw" event={"ID":"8deb63b3-1a03-48ee-bb9f-026615735ee2","Type":"ContainerStarted","Data":"50bce754b9b362e5011a9bd6fa29ed39fc8f526a854f40dae7d2fec87a29f2ac"}
Sep 11 13:02:52.744284 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:52.744205    2547 generic.go:356] "Generic (PLEG): container finished" podID="60c70fc1-d563-459c-b0c8-2725678fed9c" containerID="2ac6e3ae67150ac1cd41f95158bdf61864632d8c3f7642202e3105bd09adf4b9" exitCode=0
Sep 11 13:02:52.744372 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:52.744278    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c656p6k" event={"ID":"60c70fc1-d563-459c-b0c8-2725678fed9c","Type":"ContainerDied","Data":"2ac6e3ae67150ac1cd41f95158bdf61864632d8c3f7642202e3105bd09adf4b9"}
Sep 11 13:02:52.744372 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:52.744327    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c656p6k" event={"ID":"60c70fc1-d563-459c-b0c8-2725678fed9c","Type":"ContainerStarted","Data":"b9b0af1dd6fbda5bd9877451c6b904b689b7d47d8cde6b5b5f6334d6d72edbfa"}
Sep 11 13:02:52.745889 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:52.745870    2547 generic.go:356] "Generic (PLEG): container finished" podID="e41b2e51-bd81-4d60-a051-f6daa609c64c" containerID="515831d322bc1c8211b9aff3688650e46a3cbe2b7c4978aa2d4a36e5ecc62429" exitCode=0
Sep 11 13:02:52.745969 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:52.745951    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r85np" event={"ID":"e41b2e51-bd81-4d60-a051-f6daa609c64c","Type":"ContainerDied","Data":"515831d322bc1c8211b9aff3688650e46a3cbe2b7c4978aa2d4a36e5ecc62429"}
Sep 11 13:02:52.746020 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:52.745993    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r85np" event={"ID":"e41b2e51-bd81-4d60-a051-f6daa609c64c","Type":"ContainerStarted","Data":"a6e6b8baa07e79b37b78be64ae5820ff1291da29f00cd5067d9a160114c5549e"}
Sep 11 13:02:52.747794 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:52.747775    2547 generic.go:356] "Generic (PLEG): container finished" podID="506b8e26-79cc-48b1-a27e-e08ab47ed49c" containerID="d2cfdce8a8a9c103dc3ea72528fefea660d62c5db23665922ecf0a8095a895bc" exitCode=0
Sep 11 13:02:52.747895 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:52.747823    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amqqnm" event={"ID":"506b8e26-79cc-48b1-a27e-e08ab47ed49c","Type":"ContainerDied","Data":"d2cfdce8a8a9c103dc3ea72528fefea660d62c5db23665922ecf0a8095a895bc"}
Sep 11 13:02:52.747895 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:52.747853    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amqqnm" event={"ID":"506b8e26-79cc-48b1-a27e-e08ab47ed49c","Type":"ContainerStarted","Data":"6e9b4155f9c8e8dce391d5daed3c30f6adeb43fa88b40dc4a843654bad542bf1"}
Sep 11 13:02:53.754145 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:53.754104    2547 generic.go:356] "Generic (PLEG): container finished" podID="8deb63b3-1a03-48ee-bb9f-026615735ee2" containerID="143ba34e9d2a5ad32631a06cfd0825606f489bc2d4023967824564cac2da6ef7" exitCode=0
Sep 11 13:02:53.754594 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:53.754183    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2zhw" event={"ID":"8deb63b3-1a03-48ee-bb9f-026615735ee2","Type":"ContainerDied","Data":"143ba34e9d2a5ad32631a06cfd0825606f489bc2d4023967824564cac2da6ef7"}
Sep 11 13:02:54.761838 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:54.761759    2547 generic.go:356] "Generic (PLEG): container finished" podID="8deb63b3-1a03-48ee-bb9f-026615735ee2" containerID="34c0aa5b6b6f061850d2f37e8770a05db566ab1730f9b2cdfad18079e980d702" exitCode=0
Sep 11 13:02:54.762173 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:54.761835    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2zhw" event={"ID":"8deb63b3-1a03-48ee-bb9f-026615735ee2","Type":"ContainerDied","Data":"34c0aa5b6b6f061850d2f37e8770a05db566ab1730f9b2cdfad18079e980d702"}
Sep 11 13:02:55.767962 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:55.767929    2547 generic.go:356] "Generic (PLEG): container finished" podID="506b8e26-79cc-48b1-a27e-e08ab47ed49c" containerID="645ca5f823ae22b721e583957b850bb6f5229ac492efbfd983b08103c0e3c11e" exitCode=0
Sep 11 13:02:55.768385 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:55.768016    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amqqnm" event={"ID":"506b8e26-79cc-48b1-a27e-e08ab47ed49c","Type":"ContainerDied","Data":"645ca5f823ae22b721e583957b850bb6f5229ac492efbfd983b08103c0e3c11e"}
Sep 11 13:02:55.776357 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:55.776329    2547 generic.go:356] "Generic (PLEG): container finished" podID="60c70fc1-d563-459c-b0c8-2725678fed9c" containerID="72887c201f2e79caf13e54b487af070cda7af4ab3e25dfef4e3e0b261fe7d033" exitCode=0
Sep 11 13:02:55.776439 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:55.776407    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c656p6k" event={"ID":"60c70fc1-d563-459c-b0c8-2725678fed9c","Type":"ContainerDied","Data":"72887c201f2e79caf13e54b487af070cda7af4ab3e25dfef4e3e0b261fe7d033"}
Sep 11 13:02:55.778404 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:55.778378    2547 generic.go:356] "Generic (PLEG): container finished" podID="e41b2e51-bd81-4d60-a051-f6daa609c64c" containerID="cd7f82c90035975e9939c57d54f9f8e6734235b620d05857c7633c3f2f8b8dc8" exitCode=0
Sep 11 13:02:55.778404 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:55.778399    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r85np" event={"ID":"e41b2e51-bd81-4d60-a051-f6daa609c64c","Type":"ContainerDied","Data":"cd7f82c90035975e9939c57d54f9f8e6734235b620d05857c7633c3f2f8b8dc8"}
Sep 11 13:02:55.920703 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:55.920668    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2zhw"
Sep 11 13:02:56.021235 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:56.021116    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-js7sx\" (UniqueName: \"kubernetes.io/projected/8deb63b3-1a03-48ee-bb9f-026615735ee2-kube-api-access-js7sx\") pod \"8deb63b3-1a03-48ee-bb9f-026615735ee2\" (UID: \"8deb63b3-1a03-48ee-bb9f-026615735ee2\") "
Sep 11 13:02:56.021235 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:56.021182    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8deb63b3-1a03-48ee-bb9f-026615735ee2-bundle\") pod \"8deb63b3-1a03-48ee-bb9f-026615735ee2\" (UID: \"8deb63b3-1a03-48ee-bb9f-026615735ee2\") "
Sep 11 13:02:56.021235 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:56.021220    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8deb63b3-1a03-48ee-bb9f-026615735ee2-util\") pod \"8deb63b3-1a03-48ee-bb9f-026615735ee2\" (UID: \"8deb63b3-1a03-48ee-bb9f-026615735ee2\") "
Sep 11 13:02:56.021794 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:56.021765    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8deb63b3-1a03-48ee-bb9f-026615735ee2-bundle" (OuterVolumeSpecName: "bundle") pod "8deb63b3-1a03-48ee-bb9f-026615735ee2" (UID: "8deb63b3-1a03-48ee-bb9f-026615735ee2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:02:56.023473 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:56.023453    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8deb63b3-1a03-48ee-bb9f-026615735ee2-kube-api-access-js7sx" (OuterVolumeSpecName: "kube-api-access-js7sx") pod "8deb63b3-1a03-48ee-bb9f-026615735ee2" (UID: "8deb63b3-1a03-48ee-bb9f-026615735ee2"). InnerVolumeSpecName "kube-api-access-js7sx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:02:56.026559 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:56.026535    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8deb63b3-1a03-48ee-bb9f-026615735ee2-util" (OuterVolumeSpecName: "util") pod "8deb63b3-1a03-48ee-bb9f-026615735ee2" (UID: "8deb63b3-1a03-48ee-bb9f-026615735ee2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:02:56.122815 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:56.122781    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-js7sx\" (UniqueName: \"kubernetes.io/projected/8deb63b3-1a03-48ee-bb9f-026615735ee2-kube-api-access-js7sx\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:02:56.122815 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:56.122808    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8deb63b3-1a03-48ee-bb9f-026615735ee2-bundle\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:02:56.122815 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:56.122821    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8deb63b3-1a03-48ee-bb9f-026615735ee2-util\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:02:56.785620 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:56.785584    2547 generic.go:356] "Generic (PLEG): container finished" podID="506b8e26-79cc-48b1-a27e-e08ab47ed49c" containerID="8c7b955773199e636ce5d29d96a19f7ced9c4775ed68c3005346a8430daded4b" exitCode=0
Sep 11 13:02:56.786082 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:56.785671    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amqqnm" event={"ID":"506b8e26-79cc-48b1-a27e-e08ab47ed49c","Type":"ContainerDied","Data":"8c7b955773199e636ce5d29d96a19f7ced9c4775ed68c3005346a8430daded4b"}
Sep 11 13:02:56.787607 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:56.787588    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2zhw" event={"ID":"8deb63b3-1a03-48ee-bb9f-026615735ee2","Type":"ContainerDied","Data":"50bce754b9b362e5011a9bd6fa29ed39fc8f526a854f40dae7d2fec87a29f2ac"}
Sep 11 13:02:56.787664 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:56.787627    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="50bce754b9b362e5011a9bd6fa29ed39fc8f526a854f40dae7d2fec87a29f2ac"
Sep 11 13:02:56.787664 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:56.787600    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2zhw"
Sep 11 13:02:56.789774 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:56.789752    2547 generic.go:356] "Generic (PLEG): container finished" podID="60c70fc1-d563-459c-b0c8-2725678fed9c" containerID="fbeffcd6963a798b3fc54008fbbca2acc657a85a548bfe00de2f1f09c797b101" exitCode=0
Sep 11 13:02:56.789902 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:56.789780    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c656p6k" event={"ID":"60c70fc1-d563-459c-b0c8-2725678fed9c","Type":"ContainerDied","Data":"fbeffcd6963a798b3fc54008fbbca2acc657a85a548bfe00de2f1f09c797b101"}
Sep 11 13:02:56.792080 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:56.792062    2547 generic.go:356] "Generic (PLEG): container finished" podID="e41b2e51-bd81-4d60-a051-f6daa609c64c" containerID="fba6278c5cc463e100f71c71d6ce72bfd5de66d466a5d97e5341552dd859fe2d" exitCode=0
Sep 11 13:02:56.792187 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:56.792150    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r85np" event={"ID":"e41b2e51-bd81-4d60-a051-f6daa609c64c","Type":"ContainerDied","Data":"fba6278c5cc463e100f71c71d6ce72bfd5de66d466a5d97e5341552dd859fe2d"}
Sep 11 13:02:57.959208 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:57.959177    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r85np"
Sep 11 13:02:57.961884 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:57.961863    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amqqnm"
Sep 11 13:02:57.990377 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:57.990354    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c656p6k"
Sep 11 13:02:58.140101 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.140065    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbhdr\" (UniqueName: \"kubernetes.io/projected/60c70fc1-d563-459c-b0c8-2725678fed9c-kube-api-access-rbhdr\") pod \"60c70fc1-d563-459c-b0c8-2725678fed9c\" (UID: \"60c70fc1-d563-459c-b0c8-2725678fed9c\") "
Sep 11 13:02:58.140280 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.140133    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xsl7\" (UniqueName: \"kubernetes.io/projected/e41b2e51-bd81-4d60-a051-f6daa609c64c-kube-api-access-4xsl7\") pod \"e41b2e51-bd81-4d60-a051-f6daa609c64c\" (UID: \"e41b2e51-bd81-4d60-a051-f6daa609c64c\") "
Sep 11 13:02:58.140280 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.140194    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e41b2e51-bd81-4d60-a051-f6daa609c64c-util\") pod \"e41b2e51-bd81-4d60-a051-f6daa609c64c\" (UID: \"e41b2e51-bd81-4d60-a051-f6daa609c64c\") "
Sep 11 13:02:58.140280 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.140217    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e41b2e51-bd81-4d60-a051-f6daa609c64c-bundle\") pod \"e41b2e51-bd81-4d60-a051-f6daa609c64c\" (UID: \"e41b2e51-bd81-4d60-a051-f6daa609c64c\") "
Sep 11 13:02:58.140280 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.140252    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/506b8e26-79cc-48b1-a27e-e08ab47ed49c-bundle\") pod \"506b8e26-79cc-48b1-a27e-e08ab47ed49c\" (UID: \"506b8e26-79cc-48b1-a27e-e08ab47ed49c\") "
Sep 11 13:02:58.140280 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.140278    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/506b8e26-79cc-48b1-a27e-e08ab47ed49c-util\") pod \"506b8e26-79cc-48b1-a27e-e08ab47ed49c\" (UID: \"506b8e26-79cc-48b1-a27e-e08ab47ed49c\") "
Sep 11 13:02:58.140512 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.140320    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60c70fc1-d563-459c-b0c8-2725678fed9c-util\") pod \"60c70fc1-d563-459c-b0c8-2725678fed9c\" (UID: \"60c70fc1-d563-459c-b0c8-2725678fed9c\") "
Sep 11 13:02:58.140512 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.140356    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77g8w\" (UniqueName: \"kubernetes.io/projected/506b8e26-79cc-48b1-a27e-e08ab47ed49c-kube-api-access-77g8w\") pod \"506b8e26-79cc-48b1-a27e-e08ab47ed49c\" (UID: \"506b8e26-79cc-48b1-a27e-e08ab47ed49c\") "
Sep 11 13:02:58.140512 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.140389    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60c70fc1-d563-459c-b0c8-2725678fed9c-bundle\") pod \"60c70fc1-d563-459c-b0c8-2725678fed9c\" (UID: \"60c70fc1-d563-459c-b0c8-2725678fed9c\") "
Sep 11 13:02:58.141097 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.140990    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e41b2e51-bd81-4d60-a051-f6daa609c64c-bundle" (OuterVolumeSpecName: "bundle") pod "e41b2e51-bd81-4d60-a051-f6daa609c64c" (UID: "e41b2e51-bd81-4d60-a051-f6daa609c64c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:02:58.141097 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.141074    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60c70fc1-d563-459c-b0c8-2725678fed9c-bundle" (OuterVolumeSpecName: "bundle") pod "60c70fc1-d563-459c-b0c8-2725678fed9c" (UID: "60c70fc1-d563-459c-b0c8-2725678fed9c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:02:58.141419 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.141388    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/506b8e26-79cc-48b1-a27e-e08ab47ed49c-bundle" (OuterVolumeSpecName: "bundle") pod "506b8e26-79cc-48b1-a27e-e08ab47ed49c" (UID: "506b8e26-79cc-48b1-a27e-e08ab47ed49c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:02:58.142629 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.142609    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e41b2e51-bd81-4d60-a051-f6daa609c64c-kube-api-access-4xsl7" (OuterVolumeSpecName: "kube-api-access-4xsl7") pod "e41b2e51-bd81-4d60-a051-f6daa609c64c" (UID: "e41b2e51-bd81-4d60-a051-f6daa609c64c"). InnerVolumeSpecName "kube-api-access-4xsl7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:02:58.143336 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.143318    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/506b8e26-79cc-48b1-a27e-e08ab47ed49c-kube-api-access-77g8w" (OuterVolumeSpecName: "kube-api-access-77g8w") pod "506b8e26-79cc-48b1-a27e-e08ab47ed49c" (UID: "506b8e26-79cc-48b1-a27e-e08ab47ed49c"). InnerVolumeSpecName "kube-api-access-77g8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:02:58.143479 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.143457    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60c70fc1-d563-459c-b0c8-2725678fed9c-kube-api-access-rbhdr" (OuterVolumeSpecName: "kube-api-access-rbhdr") pod "60c70fc1-d563-459c-b0c8-2725678fed9c" (UID: "60c70fc1-d563-459c-b0c8-2725678fed9c"). InnerVolumeSpecName "kube-api-access-rbhdr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:02:58.146117 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.146080    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e41b2e51-bd81-4d60-a051-f6daa609c64c-util" (OuterVolumeSpecName: "util") pod "e41b2e51-bd81-4d60-a051-f6daa609c64c" (UID: "e41b2e51-bd81-4d60-a051-f6daa609c64c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:02:58.146197 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.146086    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60c70fc1-d563-459c-b0c8-2725678fed9c-util" (OuterVolumeSpecName: "util") pod "60c70fc1-d563-459c-b0c8-2725678fed9c" (UID: "60c70fc1-d563-459c-b0c8-2725678fed9c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:02:58.146472 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.146437    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/506b8e26-79cc-48b1-a27e-e08ab47ed49c-util" (OuterVolumeSpecName: "util") pod "506b8e26-79cc-48b1-a27e-e08ab47ed49c" (UID: "506b8e26-79cc-48b1-a27e-e08ab47ed49c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:02:58.241171 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.241132    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77g8w\" (UniqueName: \"kubernetes.io/projected/506b8e26-79cc-48b1-a27e-e08ab47ed49c-kube-api-access-77g8w\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:02:58.241171 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.241165    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60c70fc1-d563-459c-b0c8-2725678fed9c-bundle\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:02:58.241171 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.241178    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbhdr\" (UniqueName: \"kubernetes.io/projected/60c70fc1-d563-459c-b0c8-2725678fed9c-kube-api-access-rbhdr\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:02:58.241397 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.241189    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xsl7\" (UniqueName: \"kubernetes.io/projected/e41b2e51-bd81-4d60-a051-f6daa609c64c-kube-api-access-4xsl7\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:02:58.241397 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.241197    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e41b2e51-bd81-4d60-a051-f6daa609c64c-util\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:02:58.241397 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.241205    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e41b2e51-bd81-4d60-a051-f6daa609c64c-bundle\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:02:58.241397 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.241213    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/506b8e26-79cc-48b1-a27e-e08ab47ed49c-bundle\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:02:58.241397 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.241220    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/506b8e26-79cc-48b1-a27e-e08ab47ed49c-util\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:02:58.241397 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.241226    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60c70fc1-d563-459c-b0c8-2725678fed9c-util\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:02:58.803505 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.803473    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amqqnm"
Sep 11 13:02:58.803505 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.803484    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amqqnm" event={"ID":"506b8e26-79cc-48b1-a27e-e08ab47ed49c","Type":"ContainerDied","Data":"6e9b4155f9c8e8dce391d5daed3c30f6adeb43fa88b40dc4a843654bad542bf1"}
Sep 11 13:02:58.803764 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.803534    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e9b4155f9c8e8dce391d5daed3c30f6adeb43fa88b40dc4a843654bad542bf1"
Sep 11 13:02:58.805532 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.805511    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c656p6k"
Sep 11 13:02:58.805650 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.805510    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c656p6k" event={"ID":"60c70fc1-d563-459c-b0c8-2725678fed9c","Type":"ContainerDied","Data":"b9b0af1dd6fbda5bd9877451c6b904b689b7d47d8cde6b5b5f6334d6d72edbfa"}
Sep 11 13:02:58.805650 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.805619    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9b0af1dd6fbda5bd9877451c6b904b689b7d47d8cde6b5b5f6334d6d72edbfa"
Sep 11 13:02:58.807503 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.807481    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r85np" event={"ID":"e41b2e51-bd81-4d60-a051-f6daa609c64c","Type":"ContainerDied","Data":"a6e6b8baa07e79b37b78be64ae5820ff1291da29f00cd5067d9a160114c5549e"}
Sep 11 13:02:58.807588 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.807505    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r85np"
Sep 11 13:02:58.807588 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:02:58.807520    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a6e6b8baa07e79b37b78be64ae5820ff1291da29f00cd5067d9a160114c5549e"
Sep 11 13:03:00.913570 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:00.913535    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:01.701188 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:01.701158    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:04.419963 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:04.419925    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:04.899115 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:04.899070    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:05.308947 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:05.308912    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:05.746397 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:05.746300    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:06.626815 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:06.626773    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:06.722466 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:06.722433    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:09.189090 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:09.189028    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:09.649519 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:09.649480    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:11.409609 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:11.409575    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:11.976151 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:11.976107    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:14.786139 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:14.786097    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:14.895923 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:14.895887    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:14.991120 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:14.991085    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:16.119402 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.119366    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-jx9rx"]
Sep 11 13:03:16.119826 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.119697    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8deb63b3-1a03-48ee-bb9f-026615735ee2" containerName="extract"
Sep 11 13:03:16.119826 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.119708    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="8deb63b3-1a03-48ee-bb9f-026615735ee2" containerName="extract"
Sep 11 13:03:16.119826 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.119730    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="506b8e26-79cc-48b1-a27e-e08ab47ed49c" containerName="pull"
Sep 11 13:03:16.119826 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.119736    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="506b8e26-79cc-48b1-a27e-e08ab47ed49c" containerName="pull"
Sep 11 13:03:16.119826 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.119757    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60c70fc1-d563-459c-b0c8-2725678fed9c" containerName="util"
Sep 11 13:03:16.119826 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.119763    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="60c70fc1-d563-459c-b0c8-2725678fed9c" containerName="util"
Sep 11 13:03:16.119826 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.119771    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8deb63b3-1a03-48ee-bb9f-026615735ee2" containerName="pull"
Sep 11 13:03:16.119826 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.119776    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="8deb63b3-1a03-48ee-bb9f-026615735ee2" containerName="pull"
Sep 11 13:03:16.119826 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.119787    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e41b2e51-bd81-4d60-a051-f6daa609c64c" containerName="util"
Sep 11 13:03:16.119826 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.119792    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="e41b2e51-bd81-4d60-a051-f6daa609c64c" containerName="util"
Sep 11 13:03:16.119826 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.119798    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="506b8e26-79cc-48b1-a27e-e08ab47ed49c" containerName="extract"
Sep 11 13:03:16.119826 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.119803    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="506b8e26-79cc-48b1-a27e-e08ab47ed49c" containerName="extract"
Sep 11 13:03:16.119826 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.119810    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e41b2e51-bd81-4d60-a051-f6daa609c64c" containerName="extract"
Sep 11 13:03:16.119826 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.119820    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="e41b2e51-bd81-4d60-a051-f6daa609c64c" containerName="extract"
Sep 11 13:03:16.120302 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.119835    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60c70fc1-d563-459c-b0c8-2725678fed9c" containerName="extract"
Sep 11 13:03:16.120302 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.119843    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="60c70fc1-d563-459c-b0c8-2725678fed9c" containerName="extract"
Sep 11 13:03:16.120302 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.119850    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="506b8e26-79cc-48b1-a27e-e08ab47ed49c" containerName="util"
Sep 11 13:03:16.120302 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.119855    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="506b8e26-79cc-48b1-a27e-e08ab47ed49c" containerName="util"
Sep 11 13:03:16.120302 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.119861    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60c70fc1-d563-459c-b0c8-2725678fed9c" containerName="pull"
Sep 11 13:03:16.120302 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.119867    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="60c70fc1-d563-459c-b0c8-2725678fed9c" containerName="pull"
Sep 11 13:03:16.120302 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.119876    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8deb63b3-1a03-48ee-bb9f-026615735ee2" containerName="util"
Sep 11 13:03:16.120302 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.119881    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="8deb63b3-1a03-48ee-bb9f-026615735ee2" containerName="util"
Sep 11 13:03:16.120302 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.119888    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e41b2e51-bd81-4d60-a051-f6daa609c64c" containerName="pull"
Sep 11 13:03:16.120302 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.119893    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="e41b2e51-bd81-4d60-a051-f6daa609c64c" containerName="pull"
Sep 11 13:03:16.120302 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.119948    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="506b8e26-79cc-48b1-a27e-e08ab47ed49c" containerName="extract"
Sep 11 13:03:16.120302 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.119956    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="e41b2e51-bd81-4d60-a051-f6daa609c64c" containerName="extract"
Sep 11 13:03:16.120302 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.119962    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="8deb63b3-1a03-48ee-bb9f-026615735ee2" containerName="extract"
Sep 11 13:03:16.120302 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.119968    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="60c70fc1-d563-459c-b0c8-2725678fed9c" containerName="extract"
Sep 11 13:03:16.123222 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.123203    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-jx9rx"
Sep 11 13:03:16.125040 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.125007    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:16.125543 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.125522    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 13:03:16.125673 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.125603    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 11 13:03:16.125793 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.125779    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 11 13:03:16.125864 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.125847    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rxs7x\""
Sep 11 13:03:16.126402 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.126384    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 13:03:16.135548 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.135527    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-jx9rx"]
Sep 11 13:03:16.191907 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.191866    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1ce1c87c-4111-4b04-83d0-1d38f5108e9f-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-jx9rx\" (UID: \"1ce1c87c-4111-4b04-83d0-1d38f5108e9f\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-jx9rx"
Sep 11 13:03:16.192086 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.191919    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ce1c87c-4111-4b04-83d0-1d38f5108e9f-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-jx9rx\" (UID: \"1ce1c87c-4111-4b04-83d0-1d38f5108e9f\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-jx9rx"
Sep 11 13:03:16.192086 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.192043    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd2s6\" (UniqueName: \"kubernetes.io/projected/1ce1c87c-4111-4b04-83d0-1d38f5108e9f-kube-api-access-jd2s6\") pod \"kuadrant-console-plugin-fbdd4f445-jx9rx\" (UID: \"1ce1c87c-4111-4b04-83d0-1d38f5108e9f\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-jx9rx"
Sep 11 13:03:16.293400 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.293365    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd2s6\" (UniqueName: \"kubernetes.io/projected/1ce1c87c-4111-4b04-83d0-1d38f5108e9f-kube-api-access-jd2s6\") pod \"kuadrant-console-plugin-fbdd4f445-jx9rx\" (UID: \"1ce1c87c-4111-4b04-83d0-1d38f5108e9f\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-jx9rx"
Sep 11 13:03:16.293400 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.293407    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1ce1c87c-4111-4b04-83d0-1d38f5108e9f-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-jx9rx\" (UID: \"1ce1c87c-4111-4b04-83d0-1d38f5108e9f\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-jx9rx"
Sep 11 13:03:16.293636 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.293427    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ce1c87c-4111-4b04-83d0-1d38f5108e9f-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-jx9rx\" (UID: \"1ce1c87c-4111-4b04-83d0-1d38f5108e9f\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-jx9rx"
Sep 11 13:03:16.294006 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.293981    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1ce1c87c-4111-4b04-83d0-1d38f5108e9f-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-jx9rx\" (UID: \"1ce1c87c-4111-4b04-83d0-1d38f5108e9f\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-jx9rx"
Sep 11 13:03:16.296175 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.296147    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:16.296423 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.296406    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ce1c87c-4111-4b04-83d0-1d38f5108e9f-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-jx9rx\" (UID: \"1ce1c87c-4111-4b04-83d0-1d38f5108e9f\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-jx9rx"
Sep 11 13:03:16.310039 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.310014    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd2s6\" (UniqueName: \"kubernetes.io/projected/1ce1c87c-4111-4b04-83d0-1d38f5108e9f-kube-api-access-jd2s6\") pod \"kuadrant-console-plugin-fbdd4f445-jx9rx\" (UID: \"1ce1c87c-4111-4b04-83d0-1d38f5108e9f\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-jx9rx"
Sep 11 13:03:16.432330 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.432248    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-jx9rx"
Sep 11 13:03:16.702797 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.702751    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-jx9rx"]
Sep 11 13:03:16.705191 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:03:16.705166    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ce1c87c_4111_4b04_83d0_1d38f5108e9f.slice/crio-19611ddae534b0999eee35a0d659c3a6a89b18d5d8915d999351eadc40cf46d2 WatchSource:0}: Error finding container 19611ddae534b0999eee35a0d659c3a6a89b18d5d8915d999351eadc40cf46d2: Status 404 returned error can't find the container with id 19611ddae534b0999eee35a0d659c3a6a89b18d5d8915d999351eadc40cf46d2
Sep 11 13:03:16.902122 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:16.902084    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-jx9rx" event={"ID":"1ce1c87c-4111-4b04-83d0-1d38f5108e9f","Type":"ContainerStarted","Data":"19611ddae534b0999eee35a0d659c3a6a89b18d5d8915d999351eadc40cf46d2"}
Sep 11 13:03:20.390603 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:20.390566    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:20.488803 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:20.488750    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:20.589396 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:20.589331    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:20.751188 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:20.751110    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:20.852620 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:20.852580    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:21.934434 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:21.934402    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-jx9rx" event={"ID":"1ce1c87c-4111-4b04-83d0-1d38f5108e9f","Type":"ContainerStarted","Data":"eec8e32f1400109f71cf9fc42e870b2020f30115dceca1a8c6ae8dd40d0fbefa"}
Sep 11 13:03:21.955006 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:21.954959    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-jx9rx" podStartSLOduration=1.4161769419999999 podStartE2EDuration="5.954941841s" totalImagesPullingTime="4.538764899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:03:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:03:21.953734428 +0000 UTC m=+468.815208614" watchObservedRunningTime="2026-09-11 13:03:21.954941841 +0000 UTC m=+468.816416030"
Sep 11 13:03:27.313681 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:27.313646    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:27.528472 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:27.528438    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:29.775167 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:29.775128    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:29.876405 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:29.876358    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:35.425989 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:35.425955    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:35.533490 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:35.533450    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:36.038065 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:36.038029    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:36.144122 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:36.144083    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:40.636498 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:40.636456    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:40.758438 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:40.758412    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:41.044986 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:41.044896    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:41.146419 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:41.146383    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:41.249611 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:41.249577    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:41.354415 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:41.354381    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:47.481401 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:47.481371    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:47.591271 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:47.591239    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:50.003314 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:50.003278    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:50.119834 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:50.119759    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:58.389694 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:58.389657    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:58.639222 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:58.639186    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:58.739138 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:58.739023    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:58.840143 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:03:58.840088    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:01.136496 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:01.136463    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:01.243127 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:01.243088    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:01.322530 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:01.322495    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:01.958448 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:01.958406    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-nx9ng"]
Sep 11 13:04:01.961813 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:01.961791    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-nx9ng"
Sep 11 13:04:01.965028 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:01.965010    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-c8tfd\""
Sep 11 13:04:01.969785 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:01.969755    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-nx9ng"]
Sep 11 13:04:01.981910 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:01.981886    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt6wv\" (UniqueName: \"kubernetes.io/projected/c7a7737d-7627-4e6c-8b79-6c7a37cd2f2d-kube-api-access-lt6wv\") pod \"authorino-7bcfd8f9cd-nx9ng\" (UID: \"c7a7737d-7627-4e6c-8b79-6c7a37cd2f2d\") " pod="kuadrant-system/authorino-7bcfd8f9cd-nx9ng"
Sep 11 13:04:01.998674 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:01.998646    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:02.082438 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:02.082390    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt6wv\" (UniqueName: \"kubernetes.io/projected/c7a7737d-7627-4e6c-8b79-6c7a37cd2f2d-kube-api-access-lt6wv\") pod \"authorino-7bcfd8f9cd-nx9ng\" (UID: \"c7a7737d-7627-4e6c-8b79-6c7a37cd2f2d\") " pod="kuadrant-system/authorino-7bcfd8f9cd-nx9ng"
Sep 11 13:04:02.085357 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:02.085328    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:02.092081 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:02.092057    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt6wv\" (UniqueName: \"kubernetes.io/projected/c7a7737d-7627-4e6c-8b79-6c7a37cd2f2d-kube-api-access-lt6wv\") pod \"authorino-7bcfd8f9cd-nx9ng\" (UID: \"c7a7737d-7627-4e6c-8b79-6c7a37cd2f2d\") " pod="kuadrant-system/authorino-7bcfd8f9cd-nx9ng"
Sep 11 13:04:02.272750 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:02.272652    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-nx9ng"
Sep 11 13:04:02.547746 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:02.547707    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-nx9ng"]
Sep 11 13:04:02.549143 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:04:02.549117    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7a7737d_7627_4e6c_8b79_6c7a37cd2f2d.slice/crio-2b532eacf8ab5026406e5a002492c5d54c59c90e4e435de22507c5629631b68d WatchSource:0}: Error finding container 2b532eacf8ab5026406e5a002492c5d54c59c90e4e435de22507c5629631b68d: Status 404 returned error can't find the container with id 2b532eacf8ab5026406e5a002492c5d54c59c90e4e435de22507c5629631b68d
Sep 11 13:04:03.152384 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:03.152343    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-nx9ng" event={"ID":"c7a7737d-7627-4e6c-8b79-6c7a37cd2f2d","Type":"ContainerStarted","Data":"2b532eacf8ab5026406e5a002492c5d54c59c90e4e435de22507c5629631b68d"}
Sep 11 13:04:05.017568 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:05.017530    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-nx9ng"]
Sep 11 13:04:06.172156 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:06.172111    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-nx9ng" event={"ID":"c7a7737d-7627-4e6c-8b79-6c7a37cd2f2d","Type":"ContainerStarted","Data":"4e90f16c192f78e318c9b64b7e62cbe529845f3db7ba298551f7d4d781e675a4"}
Sep 11 13:04:06.172596 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:06.172160    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-nx9ng" podUID="c7a7737d-7627-4e6c-8b79-6c7a37cd2f2d" containerName="authorino" containerID="cri-o://4e90f16c192f78e318c9b64b7e62cbe529845f3db7ba298551f7d4d781e675a4" gracePeriod=30
Sep 11 13:04:06.192475 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:06.192431    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-nx9ng" podStartSLOduration=2.386696328 podStartE2EDuration="5.192413763s" totalImagesPullingTime="2.805717435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:04:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:04:06.192211002 +0000 UTC m=+513.053685190" watchObservedRunningTime="2026-09-11 13:04:06.192413763 +0000 UTC m=+513.053887950"
Sep 11 13:04:06.420688 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:06.420661    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-nx9ng"
Sep 11 13:04:06.519272 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:06.519193    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lt6wv\" (UniqueName: \"kubernetes.io/projected/c7a7737d-7627-4e6c-8b79-6c7a37cd2f2d-kube-api-access-lt6wv\") pod \"c7a7737d-7627-4e6c-8b79-6c7a37cd2f2d\" (UID: \"c7a7737d-7627-4e6c-8b79-6c7a37cd2f2d\") "
Sep 11 13:04:06.521590 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:06.521559    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7a7737d-7627-4e6c-8b79-6c7a37cd2f2d-kube-api-access-lt6wv" (OuterVolumeSpecName: "kube-api-access-lt6wv") pod "c7a7737d-7627-4e6c-8b79-6c7a37cd2f2d" (UID: "c7a7737d-7627-4e6c-8b79-6c7a37cd2f2d"). InnerVolumeSpecName "kube-api-access-lt6wv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:04:06.619921 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:06.619894    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lt6wv\" (UniqueName: \"kubernetes.io/projected/c7a7737d-7627-4e6c-8b79-6c7a37cd2f2d-kube-api-access-lt6wv\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:04:07.177953 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:07.177916    2547 generic.go:356] "Generic (PLEG): container finished" podID="c7a7737d-7627-4e6c-8b79-6c7a37cd2f2d" containerID="4e90f16c192f78e318c9b64b7e62cbe529845f3db7ba298551f7d4d781e675a4" exitCode=0
Sep 11 13:04:07.177953 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:07.177956    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-nx9ng"
Sep 11 13:04:07.178481 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:07.178003    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-nx9ng" event={"ID":"c7a7737d-7627-4e6c-8b79-6c7a37cd2f2d","Type":"ContainerDied","Data":"4e90f16c192f78e318c9b64b7e62cbe529845f3db7ba298551f7d4d781e675a4"}
Sep 11 13:04:07.178481 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:07.178041    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-nx9ng" event={"ID":"c7a7737d-7627-4e6c-8b79-6c7a37cd2f2d","Type":"ContainerDied","Data":"2b532eacf8ab5026406e5a002492c5d54c59c90e4e435de22507c5629631b68d"}
Sep 11 13:04:07.178481 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:07.178056    2547 scope.go:117] "RemoveContainer" containerID="4e90f16c192f78e318c9b64b7e62cbe529845f3db7ba298551f7d4d781e675a4"
Sep 11 13:04:07.187285 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:07.187270    2547 scope.go:117] "RemoveContainer" containerID="4e90f16c192f78e318c9b64b7e62cbe529845f3db7ba298551f7d4d781e675a4"
Sep 11 13:04:07.187548 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:04:07.187528    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e90f16c192f78e318c9b64b7e62cbe529845f3db7ba298551f7d4d781e675a4\": container with ID starting with 4e90f16c192f78e318c9b64b7e62cbe529845f3db7ba298551f7d4d781e675a4 not found: ID does not exist" containerID="4e90f16c192f78e318c9b64b7e62cbe529845f3db7ba298551f7d4d781e675a4"
Sep 11 13:04:07.187608 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:07.187560    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e90f16c192f78e318c9b64b7e62cbe529845f3db7ba298551f7d4d781e675a4"} err="failed to get container status \"4e90f16c192f78e318c9b64b7e62cbe529845f3db7ba298551f7d4d781e675a4\": rpc error: code = NotFound desc = could not find container \"4e90f16c192f78e318c9b64b7e62cbe529845f3db7ba298551f7d4d781e675a4\": container with ID starting with 4e90f16c192f78e318c9b64b7e62cbe529845f3db7ba298551f7d4d781e675a4 not found: ID does not exist"
Sep 11 13:04:07.201622 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:07.201596    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-nx9ng"]
Sep 11 13:04:07.205778 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:07.205755    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-nx9ng"]
Sep 11 13:04:07.669841 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:07.669811    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7a7737d-7627-4e6c-8b79-6c7a37cd2f2d" path="/var/lib/kubelet/pods/c7a7737d-7627-4e6c-8b79-6c7a37cd2f2d/volumes"
Sep 11 13:04:09.177149 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:09.177113    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:09.276090 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:09.276051    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:17.274561 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:17.274521    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:17.500879 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:17.500821    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:17.747227 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:17.747192    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:30.422237 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:30.422144    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:30.540211 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:30.540173    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:31.108381 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:31.108346    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57b9fcc6b4-z25m7"]
Sep 11 13:04:31.108668 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:31.108655    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7a7737d-7627-4e6c-8b79-6c7a37cd2f2d" containerName="authorino"
Sep 11 13:04:31.108744 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:31.108670    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7a7737d-7627-4e6c-8b79-6c7a37cd2f2d" containerName="authorino"
Sep 11 13:04:31.108792 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:31.108783    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7a7737d-7627-4e6c-8b79-6c7a37cd2f2d" containerName="authorino"
Sep 11 13:04:31.111818 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:31.111801    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57b9fcc6b4-z25m7"
Sep 11 13:04:31.121984 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:31.121961    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 11 13:04:31.121984 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:31.121971    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-c8tfd\""
Sep 11 13:04:31.145797 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:31.145770    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57b9fcc6b4-z25m7"]
Sep 11 13:04:31.225056 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:31.225019    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjp9x\" (UniqueName: \"kubernetes.io/projected/dcbe5482-449e-4f14-95c6-3e163acef235-kube-api-access-hjp9x\") pod \"authorino-57b9fcc6b4-z25m7\" (UID: \"dcbe5482-449e-4f14-95c6-3e163acef235\") " pod="kuadrant-system/authorino-57b9fcc6b4-z25m7"
Sep 11 13:04:31.225241 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:31.225072    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dcbe5482-449e-4f14-95c6-3e163acef235-tls-cert\") pod \"authorino-57b9fcc6b4-z25m7\" (UID: \"dcbe5482-449e-4f14-95c6-3e163acef235\") " pod="kuadrant-system/authorino-57b9fcc6b4-z25m7"
Sep 11 13:04:31.325963 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:31.325928    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjp9x\" (UniqueName: \"kubernetes.io/projected/dcbe5482-449e-4f14-95c6-3e163acef235-kube-api-access-hjp9x\") pod \"authorino-57b9fcc6b4-z25m7\" (UID: \"dcbe5482-449e-4f14-95c6-3e163acef235\") " pod="kuadrant-system/authorino-57b9fcc6b4-z25m7"
Sep 11 13:04:31.326156 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:31.325981    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dcbe5482-449e-4f14-95c6-3e163acef235-tls-cert\") pod \"authorino-57b9fcc6b4-z25m7\" (UID: \"dcbe5482-449e-4f14-95c6-3e163acef235\") " pod="kuadrant-system/authorino-57b9fcc6b4-z25m7"
Sep 11 13:04:31.328782 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:31.328748    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dcbe5482-449e-4f14-95c6-3e163acef235-tls-cert\") pod \"authorino-57b9fcc6b4-z25m7\" (UID: \"dcbe5482-449e-4f14-95c6-3e163acef235\") " pod="kuadrant-system/authorino-57b9fcc6b4-z25m7"
Sep 11 13:04:31.348084 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:31.348052    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjp9x\" (UniqueName: \"kubernetes.io/projected/dcbe5482-449e-4f14-95c6-3e163acef235-kube-api-access-hjp9x\") pod \"authorino-57b9fcc6b4-z25m7\" (UID: \"dcbe5482-449e-4f14-95c6-3e163acef235\") " pod="kuadrant-system/authorino-57b9fcc6b4-z25m7"
Sep 11 13:04:31.420972 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:31.420889    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57b9fcc6b4-z25m7"
Sep 11 13:04:31.708155 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:31.708126    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57b9fcc6b4-z25m7"]
Sep 11 13:04:31.709115 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:04:31.709088    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddcbe5482_449e_4f14_95c6_3e163acef235.slice/crio-55fff5c3b548a5bbe5a46bcc944e2c9797d0a38af91314d1c8f7c6bbd1921303 WatchSource:0}: Error finding container 55fff5c3b548a5bbe5a46bcc944e2c9797d0a38af91314d1c8f7c6bbd1921303: Status 404 returned error can't find the container with id 55fff5c3b548a5bbe5a46bcc944e2c9797d0a38af91314d1c8f7c6bbd1921303
Sep 11 13:04:32.313009 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:32.312979    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57b9fcc6b4-z25m7" event={"ID":"dcbe5482-449e-4f14-95c6-3e163acef235","Type":"ContainerStarted","Data":"55fff5c3b548a5bbe5a46bcc944e2c9797d0a38af91314d1c8f7c6bbd1921303"}
Sep 11 13:04:33.320603 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:33.320566    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57b9fcc6b4-z25m7" event={"ID":"dcbe5482-449e-4f14-95c6-3e163acef235","Type":"ContainerStarted","Data":"1b08fba35619dff14f375f046072b0791a1afff0dab1e6a765e94d7f43a1591b"}
Sep 11 13:04:33.351041 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:33.350999    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-57b9fcc6b4-z25m7" podStartSLOduration=1.539385373 podStartE2EDuration="2.350983152s" totalImagesPullingTime="811.597779ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:04:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:04:33.349739947 +0000 UTC m=+540.211214132" watchObservedRunningTime="2026-09-11 13:04:33.350983152 +0000 UTC m=+540.212457339"
Sep 11 13:04:35.391545 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:35.391506    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:35.505846 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:35.505807    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:39.098618 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:39.098576    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:39.281112 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:39.281076    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:39.492213 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:39.492108    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:42.654730 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:42.654686    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:42.856635 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:42.856601    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:52.942457 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:04:52.942378    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:15.438401 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:15.438360    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:15.545707 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:15.545667    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:16.803620 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:16.803585    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:17.146117 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:17.146070    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:17.271851 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:17.271811    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:17.399889 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:17.399801    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:17.739692 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:17.739603    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:17.937371 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:17.937334    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:29.418973 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:29.418933    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:29.503497 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:29.503454    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:33.609678 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:33.609651    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-b7gsm_b22738d7-e796-4173-8fb4-80f9208b99dd/console-operator/2.log"
Sep 11 13:05:33.610157 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:33.609943    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-b7gsm_b22738d7-e796-4173-8fb4-80f9208b99dd/console-operator/2.log"
Sep 11 13:05:36.375225 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:36.375188    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:52.927510 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:52.925000    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6xb2d"]
Sep 11 13:05:52.928845 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:52.928825    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6xb2d"
Sep 11 13:05:52.931415 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:52.931385    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 13:05:52.933370 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:52.933349    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 11 13:05:52.933558 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:52.933533    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 13:05:52.933682 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:52.933668    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pjglm\""
Sep 11 13:05:52.942703 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:52.942682    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6xb2d"]
Sep 11 13:05:52.959044 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:52.959013    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:53.101932 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:53.101893    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/105751e2-655e-4df5-9836-d784c926b7f9-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6xb2d\" (UID: \"105751e2-655e-4df5-9836-d784c926b7f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6xb2d"
Sep 11 13:05:53.101932 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:53.101935    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/105751e2-655e-4df5-9836-d784c926b7f9-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6xb2d\" (UID: \"105751e2-655e-4df5-9836-d784c926b7f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6xb2d"
Sep 11 13:05:53.102156 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:53.101967    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v72p\" (UniqueName: \"kubernetes.io/projected/105751e2-655e-4df5-9836-d784c926b7f9-kube-api-access-2v72p\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6xb2d\" (UID: \"105751e2-655e-4df5-9836-d784c926b7f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6xb2d"
Sep 11 13:05:53.102156 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:53.101992    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/105751e2-655e-4df5-9836-d784c926b7f9-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6xb2d\" (UID: \"105751e2-655e-4df5-9836-d784c926b7f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6xb2d"
Sep 11 13:05:53.102156 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:53.102104    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/105751e2-655e-4df5-9836-d784c926b7f9-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6xb2d\" (UID: \"105751e2-655e-4df5-9836-d784c926b7f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6xb2d"
Sep 11 13:05:53.102156 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:53.102135    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/105751e2-655e-4df5-9836-d784c926b7f9-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6xb2d\" (UID: \"105751e2-655e-4df5-9836-d784c926b7f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6xb2d"
Sep 11 13:05:53.203373 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:53.203280    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/105751e2-655e-4df5-9836-d784c926b7f9-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6xb2d\" (UID: \"105751e2-655e-4df5-9836-d784c926b7f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6xb2d"
Sep 11 13:05:53.203373 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:53.203317    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v72p\" (UniqueName: \"kubernetes.io/projected/105751e2-655e-4df5-9836-d784c926b7f9-kube-api-access-2v72p\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6xb2d\" (UID: \"105751e2-655e-4df5-9836-d784c926b7f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6xb2d"
Sep 11 13:05:53.203373 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:53.203340    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/105751e2-655e-4df5-9836-d784c926b7f9-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6xb2d\" (UID: \"105751e2-655e-4df5-9836-d784c926b7f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6xb2d"
Sep 11 13:05:53.203664 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:53.203397    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/105751e2-655e-4df5-9836-d784c926b7f9-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6xb2d\" (UID: \"105751e2-655e-4df5-9836-d784c926b7f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6xb2d"
Sep 11 13:05:53.203664 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:53.203418    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/105751e2-655e-4df5-9836-d784c926b7f9-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6xb2d\" (UID: \"105751e2-655e-4df5-9836-d784c926b7f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6xb2d"
Sep 11 13:05:53.203664 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:53.203443    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/105751e2-655e-4df5-9836-d784c926b7f9-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6xb2d\" (UID: \"105751e2-655e-4df5-9836-d784c926b7f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6xb2d"
Sep 11 13:05:53.203851 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:53.203799    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/105751e2-655e-4df5-9836-d784c926b7f9-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6xb2d\" (UID: \"105751e2-655e-4df5-9836-d784c926b7f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6xb2d"
Sep 11 13:05:53.203851 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:53.203834    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/105751e2-655e-4df5-9836-d784c926b7f9-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6xb2d\" (UID: \"105751e2-655e-4df5-9836-d784c926b7f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6xb2d"
Sep 11 13:05:53.203923 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:53.203847    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/105751e2-655e-4df5-9836-d784c926b7f9-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6xb2d\" (UID: \"105751e2-655e-4df5-9836-d784c926b7f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6xb2d"
Sep 11 13:05:53.205781 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:53.205762    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/105751e2-655e-4df5-9836-d784c926b7f9-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6xb2d\" (UID: \"105751e2-655e-4df5-9836-d784c926b7f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6xb2d"
Sep 11 13:05:53.206035 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:53.206020    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/105751e2-655e-4df5-9836-d784c926b7f9-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6xb2d\" (UID: \"105751e2-655e-4df5-9836-d784c926b7f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6xb2d"
Sep 11 13:05:53.212323 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:53.212294    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v72p\" (UniqueName: \"kubernetes.io/projected/105751e2-655e-4df5-9836-d784c926b7f9-kube-api-access-2v72p\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6xb2d\" (UID: \"105751e2-655e-4df5-9836-d784c926b7f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6xb2d"
Sep 11 13:05:53.239355 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:53.239318    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6xb2d"
Sep 11 13:05:53.516266 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:53.516238    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6xb2d"]
Sep 11 13:05:53.518145 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:05:53.518110    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod105751e2_655e_4df5_9836_d784c926b7f9.slice/crio-bc5097e4020a11116911d0fb0e507912e688539672ab1a51490829dbf3134b9c WatchSource:0}: Error finding container bc5097e4020a11116911d0fb0e507912e688539672ab1a51490829dbf3134b9c: Status 404 returned error can't find the container with id bc5097e4020a11116911d0fb0e507912e688539672ab1a51490829dbf3134b9c
Sep 11 13:05:53.519523 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:53.519506    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 13:05:53.738774 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:53.738650    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6xb2d" event={"ID":"105751e2-655e-4df5-9836-d784c926b7f9","Type":"ContainerStarted","Data":"bc5097e4020a11116911d0fb0e507912e688539672ab1a51490829dbf3134b9c"}
Sep 11 13:05:54.745951 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:54.745918    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6xb2d" event={"ID":"105751e2-655e-4df5-9836-d784c926b7f9","Type":"ContainerStarted","Data":"d13fe8d155f940d98137b4555d90cf6e034b5cedbc908cd2806f31867c55d841"}
Sep 11 13:05:54.767993 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:05:54.767926    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6xb2d" podStartSLOduration=1.6813004729999999 podStartE2EDuration="2.767907037s" totalImagesPullingTime="1.086606564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:05:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:05:54.767074435 +0000 UTC m=+621.628548624" watchObservedRunningTime="2026-09-11 13:05:54.767907037 +0000 UTC m=+621.629381225"
Sep 11 13:06:03.240180 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:03.240143    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6xb2d"
Sep 11 13:06:03.240642 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:03.240202    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6xb2d"
Sep 11 13:06:03.252707 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:03.252683    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6xb2d"
Sep 11 13:06:03.299465 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:03.299437    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd"]
Sep 11 13:06:03.301821 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:03.301802    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd"
Sep 11 13:06:03.304835 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:03.304815    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 11 13:06:03.320462 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:03.320433    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd"]
Sep 11 13:06:03.349770 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:03.349740    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:03.392618 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:03.392595    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/869b3226-5f7e-4c7c-a7cb-5ce418527e27-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd\" (UID: \"869b3226-5f7e-4c7c-a7cb-5ce418527e27\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd"
Sep 11 13:06:03.392760 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:03.392636    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/869b3226-5f7e-4c7c-a7cb-5ce418527e27-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd\" (UID: \"869b3226-5f7e-4c7c-a7cb-5ce418527e27\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd"
Sep 11 13:06:03.392760 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:03.392668    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/869b3226-5f7e-4c7c-a7cb-5ce418527e27-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd\" (UID: \"869b3226-5f7e-4c7c-a7cb-5ce418527e27\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd"
Sep 11 13:06:03.392760 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:03.392741    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/869b3226-5f7e-4c7c-a7cb-5ce418527e27-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd\" (UID: \"869b3226-5f7e-4c7c-a7cb-5ce418527e27\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd"
Sep 11 13:06:03.392913 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:03.392840    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtg2r\" (UniqueName: \"kubernetes.io/projected/869b3226-5f7e-4c7c-a7cb-5ce418527e27-kube-api-access-rtg2r\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd\" (UID: \"869b3226-5f7e-4c7c-a7cb-5ce418527e27\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd"
Sep 11 13:06:03.392913 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:03.392875    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/869b3226-5f7e-4c7c-a7cb-5ce418527e27-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd\" (UID: \"869b3226-5f7e-4c7c-a7cb-5ce418527e27\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd"
Sep 11 13:06:03.494126 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:03.494059    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/869b3226-5f7e-4c7c-a7cb-5ce418527e27-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd\" (UID: \"869b3226-5f7e-4c7c-a7cb-5ce418527e27\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd"
Sep 11 13:06:03.494126 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:03.494088    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/869b3226-5f7e-4c7c-a7cb-5ce418527e27-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd\" (UID: \"869b3226-5f7e-4c7c-a7cb-5ce418527e27\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd"
Sep 11 13:06:03.494126 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:03.494126    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtg2r\" (UniqueName: \"kubernetes.io/projected/869b3226-5f7e-4c7c-a7cb-5ce418527e27-kube-api-access-rtg2r\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd\" (UID: \"869b3226-5f7e-4c7c-a7cb-5ce418527e27\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd"
Sep 11 13:06:03.494405 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:03.494242    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/869b3226-5f7e-4c7c-a7cb-5ce418527e27-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd\" (UID: \"869b3226-5f7e-4c7c-a7cb-5ce418527e27\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd"
Sep 11 13:06:03.494405 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:03.494280    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/869b3226-5f7e-4c7c-a7cb-5ce418527e27-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd\" (UID: \"869b3226-5f7e-4c7c-a7cb-5ce418527e27\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd"
Sep 11 13:06:03.494405 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:03.494328    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/869b3226-5f7e-4c7c-a7cb-5ce418527e27-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd\" (UID: \"869b3226-5f7e-4c7c-a7cb-5ce418527e27\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd"
Sep 11 13:06:03.494574 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:03.494520    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/869b3226-5f7e-4c7c-a7cb-5ce418527e27-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd\" (UID: \"869b3226-5f7e-4c7c-a7cb-5ce418527e27\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd"
Sep 11 13:06:03.494617 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:03.494577    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/869b3226-5f7e-4c7c-a7cb-5ce418527e27-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd\" (UID: \"869b3226-5f7e-4c7c-a7cb-5ce418527e27\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd"
Sep 11 13:06:03.494654 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:03.494624    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/869b3226-5f7e-4c7c-a7cb-5ce418527e27-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd\" (UID: \"869b3226-5f7e-4c7c-a7cb-5ce418527e27\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd"
Sep 11 13:06:03.496618 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:03.496598    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/869b3226-5f7e-4c7c-a7cb-5ce418527e27-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd\" (UID: \"869b3226-5f7e-4c7c-a7cb-5ce418527e27\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd"
Sep 11 13:06:03.496862 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:03.496846    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/869b3226-5f7e-4c7c-a7cb-5ce418527e27-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd\" (UID: \"869b3226-5f7e-4c7c-a7cb-5ce418527e27\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd"
Sep 11 13:06:03.503659 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:03.503637    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtg2r\" (UniqueName: \"kubernetes.io/projected/869b3226-5f7e-4c7c-a7cb-5ce418527e27-kube-api-access-rtg2r\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd\" (UID: \"869b3226-5f7e-4c7c-a7cb-5ce418527e27\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd"
Sep 11 13:06:03.613589 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:03.613556    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd"
Sep 11 13:06:03.804614 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:03.804532    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6xb2d"
Sep 11 13:06:03.889416 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:03.889382    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd"]
Sep 11 13:06:03.890415 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:06:03.890384    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod869b3226_5f7e_4c7c_a7cb_5ce418527e27.slice/crio-c968813a0e7e43cb23f9ba41467460e3a8e4f63ac9b4c48e0cb282779184c96d WatchSource:0}: Error finding container c968813a0e7e43cb23f9ba41467460e3a8e4f63ac9b4c48e0cb282779184c96d: Status 404 returned error can't find the container with id c968813a0e7e43cb23f9ba41467460e3a8e4f63ac9b4c48e0cb282779184c96d
Sep 11 13:06:04.802521 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:04.802480    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd" event={"ID":"869b3226-5f7e-4c7c-a7cb-5ce418527e27","Type":"ContainerStarted","Data":"635977a70f8ca00c1735fbe0732c3c73a2decad3701e35a0b5a34d95c36aa54b"}
Sep 11 13:06:04.803052 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:04.802541    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd" event={"ID":"869b3226-5f7e-4c7c-a7cb-5ce418527e27","Type":"ContainerStarted","Data":"c968813a0e7e43cb23f9ba41467460e3a8e4f63ac9b4c48e0cb282779184c96d"}
Sep 11 13:06:04.820771 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:04.820703    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd" podStartSLOduration=1.646305728 podStartE2EDuration="1.820685478s" totalImagesPullingTime="174.37975ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:06:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:06:04.818628595 +0000 UTC m=+631.680102783" watchObservedRunningTime="2026-09-11 13:06:04.820685478 +0000 UTC m=+631.682159665"
Sep 11 13:06:06.856587 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:06.856550    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:12.665129 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:12.665091    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:13.614634 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:13.614598    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd"
Sep 11 13:06:13.614878 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:13.614659    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd"
Sep 11 13:06:13.627215 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:13.627187    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd"
Sep 11 13:06:13.861164 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:13.861135    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd"
Sep 11 13:06:18.120936 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:18.120901    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:20.116761 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:20.116707    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:33.710969 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:33.710934    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-tsxtp"]
Sep 11 13:06:33.714244 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:33.714223    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tsxtp"
Sep 11 13:06:33.716920 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:33.716893    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 11 13:06:33.730356 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:33.730327    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-tsxtp"]
Sep 11 13:06:33.748681 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:33.748626    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:33.871539 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:33.871495    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/623cc444-e1c4-4b67-8d12-5667dc0e8bba-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tsxtp\" (UID: \"623cc444-e1c4-4b67-8d12-5667dc0e8bba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tsxtp"
Sep 11 13:06:33.871705 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:33.871560    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/623cc444-e1c4-4b67-8d12-5667dc0e8bba-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tsxtp\" (UID: \"623cc444-e1c4-4b67-8d12-5667dc0e8bba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tsxtp"
Sep 11 13:06:33.871705 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:33.871653    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/623cc444-e1c4-4b67-8d12-5667dc0e8bba-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tsxtp\" (UID: \"623cc444-e1c4-4b67-8d12-5667dc0e8bba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tsxtp"
Sep 11 13:06:33.871705 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:33.871697    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzws2\" (UniqueName: \"kubernetes.io/projected/623cc444-e1c4-4b67-8d12-5667dc0e8bba-kube-api-access-vzws2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tsxtp\" (UID: \"623cc444-e1c4-4b67-8d12-5667dc0e8bba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tsxtp"
Sep 11 13:06:33.871830 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:33.871786    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/623cc444-e1c4-4b67-8d12-5667dc0e8bba-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tsxtp\" (UID: \"623cc444-e1c4-4b67-8d12-5667dc0e8bba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tsxtp"
Sep 11 13:06:33.871867 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:33.871847    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/623cc444-e1c4-4b67-8d12-5667dc0e8bba-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tsxtp\" (UID: \"623cc444-e1c4-4b67-8d12-5667dc0e8bba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tsxtp"
Sep 11 13:06:33.973212 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:33.973125    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/623cc444-e1c4-4b67-8d12-5667dc0e8bba-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tsxtp\" (UID: \"623cc444-e1c4-4b67-8d12-5667dc0e8bba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tsxtp"
Sep 11 13:06:33.973212 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:33.973167    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/623cc444-e1c4-4b67-8d12-5667dc0e8bba-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tsxtp\" (UID: \"623cc444-e1c4-4b67-8d12-5667dc0e8bba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tsxtp"
Sep 11 13:06:33.973212 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:33.973214    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/623cc444-e1c4-4b67-8d12-5667dc0e8bba-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tsxtp\" (UID: \"623cc444-e1c4-4b67-8d12-5667dc0e8bba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tsxtp"
Sep 11 13:06:33.973448 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:33.973241    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzws2\" (UniqueName: \"kubernetes.io/projected/623cc444-e1c4-4b67-8d12-5667dc0e8bba-kube-api-access-vzws2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tsxtp\" (UID: \"623cc444-e1c4-4b67-8d12-5667dc0e8bba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tsxtp"
Sep 11 13:06:33.973448 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:33.973284    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/623cc444-e1c4-4b67-8d12-5667dc0e8bba-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tsxtp\" (UID: \"623cc444-e1c4-4b67-8d12-5667dc0e8bba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tsxtp"
Sep 11 13:06:33.973448 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:33.973308    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/623cc444-e1c4-4b67-8d12-5667dc0e8bba-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tsxtp\" (UID: \"623cc444-e1c4-4b67-8d12-5667dc0e8bba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tsxtp"
Sep 11 13:06:33.973587 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:33.973562    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/623cc444-e1c4-4b67-8d12-5667dc0e8bba-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tsxtp\" (UID: \"623cc444-e1c4-4b67-8d12-5667dc0e8bba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tsxtp"
Sep 11 13:06:33.973630 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:33.973605    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/623cc444-e1c4-4b67-8d12-5667dc0e8bba-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tsxtp\" (UID: \"623cc444-e1c4-4b67-8d12-5667dc0e8bba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tsxtp"
Sep 11 13:06:33.973676 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:33.973657    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/623cc444-e1c4-4b67-8d12-5667dc0e8bba-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tsxtp\" (UID: \"623cc444-e1c4-4b67-8d12-5667dc0e8bba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tsxtp"
Sep 11 13:06:33.975752 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:33.975703    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/623cc444-e1c4-4b67-8d12-5667dc0e8bba-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tsxtp\" (UID: \"623cc444-e1c4-4b67-8d12-5667dc0e8bba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tsxtp"
Sep 11 13:06:33.976010 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:33.975989    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/623cc444-e1c4-4b67-8d12-5667dc0e8bba-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tsxtp\" (UID: \"623cc444-e1c4-4b67-8d12-5667dc0e8bba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tsxtp"
Sep 11 13:06:33.981760 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:33.981741    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzws2\" (UniqueName: \"kubernetes.io/projected/623cc444-e1c4-4b67-8d12-5667dc0e8bba-kube-api-access-vzws2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tsxtp\" (UID: \"623cc444-e1c4-4b67-8d12-5667dc0e8bba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tsxtp"
Sep 11 13:06:34.024883 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:34.024849    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tsxtp"
Sep 11 13:06:34.299958 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:34.299929    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-tsxtp"]
Sep 11 13:06:34.302635 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:06:34.302606    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod623cc444_e1c4_4b67_8d12_5667dc0e8bba.slice/crio-7ea5e946e39797bc572a098ef445ee2c2214a7e5884440982f391bbf68f4df6a WatchSource:0}: Error finding container 7ea5e946e39797bc572a098ef445ee2c2214a7e5884440982f391bbf68f4df6a: Status 404 returned error can't find the container with id 7ea5e946e39797bc572a098ef445ee2c2214a7e5884440982f391bbf68f4df6a
Sep 11 13:06:34.964948 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:34.964913    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tsxtp" event={"ID":"623cc444-e1c4-4b67-8d12-5667dc0e8bba","Type":"ContainerStarted","Data":"73b8b6bc7fb80dea87853e7f3ae76e286681131844693cf67c84b78ea3435a64"}
Sep 11 13:06:34.965364 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:34.964980    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tsxtp" event={"ID":"623cc444-e1c4-4b67-8d12-5667dc0e8bba","Type":"ContainerStarted","Data":"7ea5e946e39797bc572a098ef445ee2c2214a7e5884440982f391bbf68f4df6a"}
Sep 11 13:06:34.984821 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:34.984771    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tsxtp" podStartSLOduration=1.792358297 podStartE2EDuration="1.984754796s" totalImagesPullingTime="192.396499ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:06:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:06:34.983418863 +0000 UTC m=+661.844893053" watchObservedRunningTime="2026-09-11 13:06:34.984754796 +0000 UTC m=+661.846228981"
Sep 11 13:06:44.025202 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:44.025170    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tsxtp"
Sep 11 13:06:44.025646 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:44.025251    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tsxtp"
Sep 11 13:06:44.038116 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:44.038091    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tsxtp"
Sep 11 13:06:45.027933 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:45.027902    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tsxtp"
Sep 11 13:06:49.176158 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:49.176097    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk"]
Sep 11 13:06:49.179538 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:49.179520    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk"
Sep 11 13:06:49.188374 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:49.188353    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 11 13:06:49.204763 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:49.204708    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bfad827-4c24-47b1-a2b7-2d8d65e96783-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk\" (UID: \"0bfad827-4c24-47b1-a2b7-2d8d65e96783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk"
Sep 11 13:06:49.204969 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:49.204783    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bfad827-4c24-47b1-a2b7-2d8d65e96783-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk\" (UID: \"0bfad827-4c24-47b1-a2b7-2d8d65e96783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk"
Sep 11 13:06:49.204969 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:49.204805    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bfad827-4c24-47b1-a2b7-2d8d65e96783-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk\" (UID: \"0bfad827-4c24-47b1-a2b7-2d8d65e96783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk"
Sep 11 13:06:49.204969 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:49.204846    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bfad827-4c24-47b1-a2b7-2d8d65e96783-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk\" (UID: \"0bfad827-4c24-47b1-a2b7-2d8d65e96783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk"
Sep 11 13:06:49.204969 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:49.204911    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bfad827-4c24-47b1-a2b7-2d8d65e96783-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk\" (UID: \"0bfad827-4c24-47b1-a2b7-2d8d65e96783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk"
Sep 11 13:06:49.204969 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:49.204940    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z65b\" (UniqueName: \"kubernetes.io/projected/0bfad827-4c24-47b1-a2b7-2d8d65e96783-kube-api-access-7z65b\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk\" (UID: \"0bfad827-4c24-47b1-a2b7-2d8d65e96783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk"
Sep 11 13:06:49.211576 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:49.211549    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk"]
Sep 11 13:06:49.305082 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:49.305029    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:49.305347 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:49.305328    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bfad827-4c24-47b1-a2b7-2d8d65e96783-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk\" (UID: \"0bfad827-4c24-47b1-a2b7-2d8d65e96783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk"
Sep 11 13:06:49.305423 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:49.305381    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bfad827-4c24-47b1-a2b7-2d8d65e96783-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk\" (UID: \"0bfad827-4c24-47b1-a2b7-2d8d65e96783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk"
Sep 11 13:06:49.305423 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:49.305399    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z65b\" (UniqueName: \"kubernetes.io/projected/0bfad827-4c24-47b1-a2b7-2d8d65e96783-kube-api-access-7z65b\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk\" (UID: \"0bfad827-4c24-47b1-a2b7-2d8d65e96783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk"
Sep 11 13:06:49.305534 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:49.305509    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bfad827-4c24-47b1-a2b7-2d8d65e96783-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk\" (UID: \"0bfad827-4c24-47b1-a2b7-2d8d65e96783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk"
Sep 11 13:06:49.305584 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:49.305554    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bfad827-4c24-47b1-a2b7-2d8d65e96783-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk\" (UID: \"0bfad827-4c24-47b1-a2b7-2d8d65e96783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk"
Sep 11 13:06:49.305697 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:49.305671    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bfad827-4c24-47b1-a2b7-2d8d65e96783-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk\" (UID: \"0bfad827-4c24-47b1-a2b7-2d8d65e96783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk"
Sep 11 13:06:49.305814 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:49.305795    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bfad827-4c24-47b1-a2b7-2d8d65e96783-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk\" (UID: \"0bfad827-4c24-47b1-a2b7-2d8d65e96783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk"
Sep 11 13:06:49.305880 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:49.305866    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bfad827-4c24-47b1-a2b7-2d8d65e96783-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk\" (UID: \"0bfad827-4c24-47b1-a2b7-2d8d65e96783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk"
Sep 11 13:06:49.305959 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:49.305939    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bfad827-4c24-47b1-a2b7-2d8d65e96783-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk\" (UID: \"0bfad827-4c24-47b1-a2b7-2d8d65e96783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk"
Sep 11 13:06:49.307827 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:49.307808    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bfad827-4c24-47b1-a2b7-2d8d65e96783-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk\" (UID: \"0bfad827-4c24-47b1-a2b7-2d8d65e96783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk"
Sep 11 13:06:49.308248 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:49.308229    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bfad827-4c24-47b1-a2b7-2d8d65e96783-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk\" (UID: \"0bfad827-4c24-47b1-a2b7-2d8d65e96783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk"
Sep 11 13:06:49.327866 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:49.327833    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z65b\" (UniqueName: \"kubernetes.io/projected/0bfad827-4c24-47b1-a2b7-2d8d65e96783-kube-api-access-7z65b\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk\" (UID: \"0bfad827-4c24-47b1-a2b7-2d8d65e96783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk"
Sep 11 13:06:49.488946 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:49.488848    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk"
Sep 11 13:06:49.785939 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:49.785914    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk"]
Sep 11 13:06:49.787631 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:06:49.787604    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0bfad827_4c24_47b1_a2b7_2d8d65e96783.slice/crio-937cb9539f9341794f3bdfa7ab9d3962cf88bb3b9a4cbbb87267177d402badab WatchSource:0}: Error finding container 937cb9539f9341794f3bdfa7ab9d3962cf88bb3b9a4cbbb87267177d402badab: Status 404 returned error can't find the container with id 937cb9539f9341794f3bdfa7ab9d3962cf88bb3b9a4cbbb87267177d402badab
Sep 11 13:06:50.051487 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:50.051386    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk" event={"ID":"0bfad827-4c24-47b1-a2b7-2d8d65e96783","Type":"ContainerStarted","Data":"3e7ac5dfeed908224cde00f38d7af34c83c742bd9767f599c8019b164db9de98"}
Sep 11 13:06:50.051487 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:50.051437    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk" event={"ID":"0bfad827-4c24-47b1-a2b7-2d8d65e96783","Type":"ContainerStarted","Data":"937cb9539f9341794f3bdfa7ab9d3962cf88bb3b9a4cbbb87267177d402badab"}
Sep 11 13:06:50.093538 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:50.093481    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk" podStartSLOduration=0.908773982 podStartE2EDuration="1.093461282s" totalImagesPullingTime="184.6873ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:06:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:06:50.091329129 +0000 UTC m=+676.952803341" watchObservedRunningTime="2026-09-11 13:06:50.093461282 +0000 UTC m=+676.954935470"
Sep 11 13:06:59.489499 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:59.489443    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk"
Sep 11 13:06:59.489499 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:59.489508    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk"
Sep 11 13:06:59.502510 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:06:59.502485    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk"
Sep 11 13:07:00.117405 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:07:00.117370    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk"
Sep 11 13:07:47.484333 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:07:47.484238    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:03.213371 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:03.213330    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57b9fcc6b4-z25m7"]
Sep 11 13:08:03.213885 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:03.213520    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-57b9fcc6b4-z25m7" podUID="dcbe5482-449e-4f14-95c6-3e163acef235" containerName="authorino" containerID="cri-o://1b08fba35619dff14f375f046072b0791a1afff0dab1e6a765e94d7f43a1591b" gracePeriod=30
Sep 11 13:08:03.442120 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:03.442093    2547 generic.go:356] "Generic (PLEG): container finished" podID="dcbe5482-449e-4f14-95c6-3e163acef235" containerID="1b08fba35619dff14f375f046072b0791a1afff0dab1e6a765e94d7f43a1591b" exitCode=0
Sep 11 13:08:03.442266 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:03.442166    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57b9fcc6b4-z25m7" event={"ID":"dcbe5482-449e-4f14-95c6-3e163acef235","Type":"ContainerDied","Data":"1b08fba35619dff14f375f046072b0791a1afff0dab1e6a765e94d7f43a1591b"}
Sep 11 13:08:03.459871 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:03.459851    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57b9fcc6b4-z25m7"
Sep 11 13:08:03.547834 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:03.547731    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dcbe5482-449e-4f14-95c6-3e163acef235-tls-cert\") pod \"dcbe5482-449e-4f14-95c6-3e163acef235\" (UID: \"dcbe5482-449e-4f14-95c6-3e163acef235\") "
Sep 11 13:08:03.547834 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:03.547802    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjp9x\" (UniqueName: \"kubernetes.io/projected/dcbe5482-449e-4f14-95c6-3e163acef235-kube-api-access-hjp9x\") pod \"dcbe5482-449e-4f14-95c6-3e163acef235\" (UID: \"dcbe5482-449e-4f14-95c6-3e163acef235\") "
Sep 11 13:08:03.549920 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:03.549886    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcbe5482-449e-4f14-95c6-3e163acef235-kube-api-access-hjp9x" (OuterVolumeSpecName: "kube-api-access-hjp9x") pod "dcbe5482-449e-4f14-95c6-3e163acef235" (UID: "dcbe5482-449e-4f14-95c6-3e163acef235"). InnerVolumeSpecName "kube-api-access-hjp9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:08:03.557952 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:03.557927    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcbe5482-449e-4f14-95c6-3e163acef235-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "dcbe5482-449e-4f14-95c6-3e163acef235" (UID: "dcbe5482-449e-4f14-95c6-3e163acef235"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:08:03.649075 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:03.649028    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjp9x\" (UniqueName: \"kubernetes.io/projected/dcbe5482-449e-4f14-95c6-3e163acef235-kube-api-access-hjp9x\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:08:03.649075 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:03.649069    2547 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dcbe5482-449e-4f14-95c6-3e163acef235-tls-cert\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:08:03.815221 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:03.815182    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:03.917555 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:03.917518    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:04.449140 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:04.449108    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57b9fcc6b4-z25m7"
Sep 11 13:08:04.449140 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:04.449133    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57b9fcc6b4-z25m7" event={"ID":"dcbe5482-449e-4f14-95c6-3e163acef235","Type":"ContainerDied","Data":"55fff5c3b548a5bbe5a46bcc944e2c9797d0a38af91314d1c8f7c6bbd1921303"}
Sep 11 13:08:04.449630 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:04.449186    2547 scope.go:117] "RemoveContainer" containerID="1b08fba35619dff14f375f046072b0791a1afff0dab1e6a765e94d7f43a1591b"
Sep 11 13:08:04.491118 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:04.491090    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57b9fcc6b4-z25m7"]
Sep 11 13:08:04.518860 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:04.518831    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57b9fcc6b4-z25m7"]
Sep 11 13:08:04.949505 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:04.949479    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:05.106675 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:05.106642    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:05.662956 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:05.662923    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcbe5482-449e-4f14-95c6-3e163acef235" path="/var/lib/kubelet/pods/dcbe5482-449e-4f14-95c6-3e163acef235/volumes"
Sep 11 13:08:20.772290 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:20.772259    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:20.885465 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:20.885431    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:21.605750 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:21.605707    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:21.742017 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:21.741985    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:22.519785 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:22.519747    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:22.694464 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:22.694421    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:22.848064 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:22.848028    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:23.036358 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:23.036325    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7790-e4085d"]
Sep 11 13:08:23.036683 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:23.036672    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcbe5482-449e-4f14-95c6-3e163acef235" containerName="authorino"
Sep 11 13:08:23.036761 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:23.036685    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcbe5482-449e-4f14-95c6-3e163acef235" containerName="authorino"
Sep 11 13:08:23.036761 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:23.036756    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcbe5482-449e-4f14-95c6-3e163acef235" containerName="authorino"
Sep 11 13:08:23.041082 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:23.041057    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:23.041311 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:23.041295    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7790-e4085d"
Sep 11 13:08:23.044087 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:23.044069    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-46lmf\""
Sep 11 13:08:23.053266 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:23.053245    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7790-e4085d"]
Sep 11 13:08:23.118898 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:23.118808    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-588hw\" (UniqueName: \"kubernetes.io/projected/8ae93cd7-fe13-41a9-b837-4c6d52d659da-kube-api-access-588hw\") pod \"test-curl-7790-e4085d\" (UID: \"8ae93cd7-fe13-41a9-b837-4c6d52d659da\") " pod="opendatahub/test-curl-7790-e4085d"
Sep 11 13:08:23.219861 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:23.219826    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-588hw\" (UniqueName: \"kubernetes.io/projected/8ae93cd7-fe13-41a9-b837-4c6d52d659da-kube-api-access-588hw\") pod \"test-curl-7790-e4085d\" (UID: \"8ae93cd7-fe13-41a9-b837-4c6d52d659da\") " pod="opendatahub/test-curl-7790-e4085d"
Sep 11 13:08:23.228619 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:23.228592    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-588hw\" (UniqueName: \"kubernetes.io/projected/8ae93cd7-fe13-41a9-b837-4c6d52d659da-kube-api-access-588hw\") pod \"test-curl-7790-e4085d\" (UID: \"8ae93cd7-fe13-41a9-b837-4c6d52d659da\") " pod="opendatahub/test-curl-7790-e4085d"
Sep 11 13:08:23.350668 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:23.350638    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7790-e4085d"
Sep 11 13:08:23.624528 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:23.624499    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7790-e4085d"]
Sep 11 13:08:23.625522 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:08:23.625493    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ae93cd7_fe13_41a9_b837_4c6d52d659da.slice/crio-e018cf5c1fd3f217faab3ea179e8269e6b5b7d89d374093d63b3fd99cc2ee218 WatchSource:0}: Error finding container e018cf5c1fd3f217faab3ea179e8269e6b5b7d89d374093d63b3fd99cc2ee218: Status 404 returned error can't find the container with id e018cf5c1fd3f217faab3ea179e8269e6b5b7d89d374093d63b3fd99cc2ee218
Sep 11 13:08:24.557879 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:24.557837    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7790-e4085d" event={"ID":"8ae93cd7-fe13-41a9-b837-4c6d52d659da","Type":"ContainerStarted","Data":"e018cf5c1fd3f217faab3ea179e8269e6b5b7d89d374093d63b3fd99cc2ee218"}
Sep 11 13:08:25.012471 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:25.012364    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:25.115463 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:25.115431    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:26.298823 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:26.298779    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:26.395619 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:26.395584    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:26.570339 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:26.570307    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7790-e4085d" event={"ID":"8ae93cd7-fe13-41a9-b837-4c6d52d659da","Type":"ContainerStarted","Data":"ab7176fb1765f9a4fbefe73123d657c2bfded71714f36690749f1a3d75f9fb73"}
Sep 11 13:08:26.844442 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:26.844355    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:27.011673 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:27.011634    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:27.137248 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:27.137143    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:27.278361 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:27.278306    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7790-e4085d" podStartSLOduration=2.317172059 podStartE2EDuration="4.278287666s" totalImagesPullingTime="1.961115607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:08:26.591665287 +0000 UTC m=+773.453139479" watchObservedRunningTime="2026-09-11 13:08:27.278287666 +0000 UTC m=+774.139761854"
Sep 11 13:08:27.279704 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:27.279682    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-528ff6-847dc875bc-9ldxf"]
Sep 11 13:08:27.283207 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:27.283192    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-528ff6-847dc875bc-9ldxf"
Sep 11 13:08:27.285962 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:27.285941    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-528ff6-dockercfg-5wvdm\""
Sep 11 13:08:27.286162 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:27.286149    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-528ff6\""
Sep 11 13:08:27.302583 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:27.302559    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-528ff6-847dc875bc-9ldxf"]
Sep 11 13:08:27.314222 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:27.314195    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7790-e4085d"]
Sep 11 13:08:27.334230 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:27.334202    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7790-e4085d"]
Sep 11 13:08:27.460672 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:27.460580    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1ab0c2f-8a7b-467f-a7ab-891c2166ef00-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-528ff6-847dc875bc-9ldxf\" (UID: \"f1ab0c2f-8a7b-467f-a7ab-891c2166ef00\") " pod="openshift-ingress/payload-processing-e2e-inf-a-528ff6-847dc875bc-9ldxf"
Sep 11 13:08:27.460672 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:27.460641    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72n8r\" (UniqueName: \"kubernetes.io/projected/f1ab0c2f-8a7b-467f-a7ab-891c2166ef00-kube-api-access-72n8r\") pod \"payload-processing-e2e-inf-a-528ff6-847dc875bc-9ldxf\" (UID: \"f1ab0c2f-8a7b-467f-a7ab-891c2166ef00\") " pod="openshift-ingress/payload-processing-e2e-inf-a-528ff6-847dc875bc-9ldxf"
Sep 11 13:08:27.562092 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:27.562041    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72n8r\" (UniqueName: \"kubernetes.io/projected/f1ab0c2f-8a7b-467f-a7ab-891c2166ef00-kube-api-access-72n8r\") pod \"payload-processing-e2e-inf-a-528ff6-847dc875bc-9ldxf\" (UID: \"f1ab0c2f-8a7b-467f-a7ab-891c2166ef00\") " pod="openshift-ingress/payload-processing-e2e-inf-a-528ff6-847dc875bc-9ldxf"
Sep 11 13:08:27.562280 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:27.562154    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1ab0c2f-8a7b-467f-a7ab-891c2166ef00-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-528ff6-847dc875bc-9ldxf\" (UID: \"f1ab0c2f-8a7b-467f-a7ab-891c2166ef00\") " pod="openshift-ingress/payload-processing-e2e-inf-a-528ff6-847dc875bc-9ldxf"
Sep 11 13:08:27.562855 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:27.562838    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1ab0c2f-8a7b-467f-a7ab-891c2166ef00-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-528ff6-847dc875bc-9ldxf\" (UID: \"f1ab0c2f-8a7b-467f-a7ab-891c2166ef00\") " pod="openshift-ingress/payload-processing-e2e-inf-a-528ff6-847dc875bc-9ldxf"
Sep 11 13:08:27.574290 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:27.574264    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72n8r\" (UniqueName: \"kubernetes.io/projected/f1ab0c2f-8a7b-467f-a7ab-891c2166ef00-kube-api-access-72n8r\") pod \"payload-processing-e2e-inf-a-528ff6-847dc875bc-9ldxf\" (UID: \"f1ab0c2f-8a7b-467f-a7ab-891c2166ef00\") " pod="openshift-ingress/payload-processing-e2e-inf-a-528ff6-847dc875bc-9ldxf"
Sep 11 13:08:27.577319 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:08:27.577294    2547 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7790-e4085d" container="test-curl-7790-e4085d"
Sep 11 13:08:27.594428 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:27.594404    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-528ff6-847dc875bc-9ldxf"
Sep 11 13:08:27.883330 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:27.883302    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-528ff6-847dc875bc-9ldxf"]
Sep 11 13:08:27.884559 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:08:27.884533    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1ab0c2f_8a7b_467f_a7ab_891c2166ef00.slice/crio-e98fc222053241c63b001a96aedd3c276601b06e6a6dbabb181dcd15d7737874 WatchSource:0}: Error finding container e98fc222053241c63b001a96aedd3c276601b06e6a6dbabb181dcd15d7737874: Status 404 returned error can't find the container with id e98fc222053241c63b001a96aedd3c276601b06e6a6dbabb181dcd15d7737874
Sep 11 13:08:28.589075 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:28.588705    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7790-e4085d" podUID="8ae93cd7-fe13-41a9-b837-4c6d52d659da" containerName="test-curl-7790-e4085d" containerID="cri-o://ab7176fb1765f9a4fbefe73123d657c2bfded71714f36690749f1a3d75f9fb73" gracePeriod=2
Sep 11 13:08:28.589075 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:28.588778    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-528ff6-847dc875bc-9ldxf" event={"ID":"f1ab0c2f-8a7b-467f-a7ab-891c2166ef00","Type":"ContainerStarted","Data":"e98fc222053241c63b001a96aedd3c276601b06e6a6dbabb181dcd15d7737874"}
Sep 11 13:08:30.511693 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:30.511650    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:30.605675 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:30.605650    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-528ff6-847dc875bc-9ldxf" event={"ID":"f1ab0c2f-8a7b-467f-a7ab-891c2166ef00","Type":"ContainerStarted","Data":"54ad91d0a367cb4ff94c27fbf53261ab0ceeb8b40cbc02565c398ac56b1df97c"}
Sep 11 13:08:30.605827 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:30.605729    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-528ff6-847dc875bc-9ldxf"
Sep 11 13:08:30.774582 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:30.774522    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7790-e4085d"
Sep 11 13:08:30.777964 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:30.777935    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:30.892232 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:30.892191    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-588hw\" (UniqueName: \"kubernetes.io/projected/8ae93cd7-fe13-41a9-b837-4c6d52d659da-kube-api-access-588hw\") pod \"8ae93cd7-fe13-41a9-b837-4c6d52d659da\" (UID: \"8ae93cd7-fe13-41a9-b837-4c6d52d659da\") "
Sep 11 13:08:30.894553 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:30.894525    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ae93cd7-fe13-41a9-b837-4c6d52d659da-kube-api-access-588hw" (OuterVolumeSpecName: "kube-api-access-588hw") pod "8ae93cd7-fe13-41a9-b837-4c6d52d659da" (UID: "8ae93cd7-fe13-41a9-b837-4c6d52d659da"). InnerVolumeSpecName "kube-api-access-588hw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:08:30.984466 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:30.984432    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:30.993528 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:30.993506    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-588hw\" (UniqueName: \"kubernetes.io/projected/8ae93cd7-fe13-41a9-b837-4c6d52d659da-kube-api-access-588hw\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:08:31.185533 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:31.185498    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:31.561090 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:31.561054    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:31.611970 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:31.611936    2547 generic.go:356] "Generic (PLEG): container finished" podID="8ae93cd7-fe13-41a9-b837-4c6d52d659da" containerID="ab7176fb1765f9a4fbefe73123d657c2bfded71714f36690749f1a3d75f9fb73" exitCode=137
Sep 11 13:08:31.612173 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:31.611981    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7790-e4085d"
Sep 11 13:08:31.612173 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:31.611993    2547 scope.go:117] "RemoveContainer" containerID="ab7176fb1765f9a4fbefe73123d657c2bfded71714f36690749f1a3d75f9fb73"
Sep 11 13:08:31.621428 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:31.621412    2547 scope.go:117] "RemoveContainer" containerID="ab7176fb1765f9a4fbefe73123d657c2bfded71714f36690749f1a3d75f9fb73"
Sep 11 13:08:31.621707 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:08:31.621690    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab7176fb1765f9a4fbefe73123d657c2bfded71714f36690749f1a3d75f9fb73\": container with ID starting with ab7176fb1765f9a4fbefe73123d657c2bfded71714f36690749f1a3d75f9fb73 not found: ID does not exist" containerID="ab7176fb1765f9a4fbefe73123d657c2bfded71714f36690749f1a3d75f9fb73"
Sep 11 13:08:31.621707 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:31.621736    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab7176fb1765f9a4fbefe73123d657c2bfded71714f36690749f1a3d75f9fb73"} err="failed to get container status \"ab7176fb1765f9a4fbefe73123d657c2bfded71714f36690749f1a3d75f9fb73\": rpc error: code = NotFound desc = could not find container \"ab7176fb1765f9a4fbefe73123d657c2bfded71714f36690749f1a3d75f9fb73\": container with ID starting with ab7176fb1765f9a4fbefe73123d657c2bfded71714f36690749f1a3d75f9fb73 not found: ID does not exist"
Sep 11 13:08:31.628640 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:08:31.628617    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7790-e4085d\" is forbidden: User \"system:node:ip-10-0-133-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-79.ec2.internal' and this object" podUID="8ae93cd7-fe13-41a9-b837-4c6d52d659da" pod="opendatahub/test-curl-7790-e4085d"
Sep 11 13:08:31.663806 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:31.663768    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ae93cd7-fe13-41a9-b837-4c6d52d659da" path="/var/lib/kubelet/pods/8ae93cd7-fe13-41a9-b837-4c6d52d659da/volumes"
Sep 11 13:08:33.010860 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:33.010825    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:33.515362 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:33.515320    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:33.730862 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:33.730827    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:34.201454 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:34.201414    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:34.307766 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:34.307735    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:34.771852 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:34.771822    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:36.003096 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:36.003058    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:36.109535 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:36.109483    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:36.372202 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:36.372161    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:36.901135 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:36.901101    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:37.003478 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.003440    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:37.045699 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.045642    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-528ff6-847dc875bc-9ldxf" podStartSLOduration=8.368408648 podStartE2EDuration="10.045624106s" totalImagesPullingTime="1.677215458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:08:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:08:30.717048468 +0000 UTC m=+777.578522666" watchObservedRunningTime="2026-09-11 13:08:37.045624106 +0000 UTC m=+783.907098346"
Sep 11 13:08:37.046914 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.046885    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-976b6f6f-c9667758b-x4mmm"]
Sep 11 13:08:37.047259 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.047245    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ae93cd7-fe13-41a9-b837-4c6d52d659da" containerName="test-curl-7790-e4085d"
Sep 11 13:08:37.047259 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.047260    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ae93cd7-fe13-41a9-b837-4c6d52d659da" containerName="test-curl-7790-e4085d"
Sep 11 13:08:37.047343 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.047321    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ae93cd7-fe13-41a9-b837-4c6d52d659da" containerName="test-curl-7790-e4085d"
Sep 11 13:08:37.051616 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.051600    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-976b6f6f-c9667758b-x4mmm"
Sep 11 13:08:37.054780 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.054761    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-976b6f6f\""
Sep 11 13:08:37.068086 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.068058    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-976b6f6f-c9667758b-x4mmm"]
Sep 11 13:08:37.191248 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.191171    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-976b6f6f-6b5bcbcddc-j5s98"]
Sep 11 13:08:37.194577 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.194561    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-976b6f6f-6b5bcbcddc-j5s98"
Sep 11 13:08:37.226589 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.226548    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-976b6f6f-dockercfg-n8fkf\""
Sep 11 13:08:37.235008 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.234980    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-976b6f6f-6b5bcbcddc-j5s98"]
Sep 11 13:08:37.249595 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.249559    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtfmb\" (UniqueName: \"kubernetes.io/projected/9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92-kube-api-access-dtfmb\") pod \"payload-pre-processing-e2e-ait-976b6f6f-c9667758b-x4mmm\" (UID: \"9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-976b6f6f-c9667758b-x4mmm"
Sep 11 13:08:37.249767 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.249726    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-976b6f6f-c9667758b-x4mmm\" (UID: \"9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-976b6f6f-c9667758b-x4mmm"
Sep 11 13:08:37.290458 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.290417    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:37.350628 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.350584    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f-plugins-config-volume\") pod \"payload-processing-e2e-ait-976b6f6f-6b5bcbcddc-j5s98\" (UID: \"7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f\") " pod="openshift-ingress/payload-processing-e2e-ait-976b6f6f-6b5bcbcddc-j5s98"
Sep 11 13:08:37.350863 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.350658    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-976b6f6f-c9667758b-x4mmm\" (UID: \"9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-976b6f6f-c9667758b-x4mmm"
Sep 11 13:08:37.350863 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.350748    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtfmb\" (UniqueName: \"kubernetes.io/projected/9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92-kube-api-access-dtfmb\") pod \"payload-pre-processing-e2e-ait-976b6f6f-c9667758b-x4mmm\" (UID: \"9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-976b6f6f-c9667758b-x4mmm"
Sep 11 13:08:37.350863 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.350789    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5hzw\" (UniqueName: \"kubernetes.io/projected/7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f-kube-api-access-n5hzw\") pod \"payload-processing-e2e-ait-976b6f6f-6b5bcbcddc-j5s98\" (UID: \"7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f\") " pod="openshift-ingress/payload-processing-e2e-ait-976b6f6f-6b5bcbcddc-j5s98"
Sep 11 13:08:37.351411 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.351391    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-976b6f6f-c9667758b-x4mmm\" (UID: \"9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-976b6f6f-c9667758b-x4mmm"
Sep 11 13:08:37.367641 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.367607    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtfmb\" (UniqueName: \"kubernetes.io/projected/9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92-kube-api-access-dtfmb\") pod \"payload-pre-processing-e2e-ait-976b6f6f-c9667758b-x4mmm\" (UID: \"9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-976b6f6f-c9667758b-x4mmm"
Sep 11 13:08:37.437210 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.437170    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:37.452356 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.452270    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5hzw\" (UniqueName: \"kubernetes.io/projected/7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f-kube-api-access-n5hzw\") pod \"payload-processing-e2e-ait-976b6f6f-6b5bcbcddc-j5s98\" (UID: \"7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f\") " pod="openshift-ingress/payload-processing-e2e-ait-976b6f6f-6b5bcbcddc-j5s98"
Sep 11 13:08:37.452511 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.452368    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f-plugins-config-volume\") pod \"payload-processing-e2e-ait-976b6f6f-6b5bcbcddc-j5s98\" (UID: \"7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f\") " pod="openshift-ingress/payload-processing-e2e-ait-976b6f6f-6b5bcbcddc-j5s98"
Sep 11 13:08:37.453105 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.453083    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f-plugins-config-volume\") pod \"payload-processing-e2e-ait-976b6f6f-6b5bcbcddc-j5s98\" (UID: \"7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f\") " pod="openshift-ingress/payload-processing-e2e-ait-976b6f6f-6b5bcbcddc-j5s98"
Sep 11 13:08:37.465973 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.465946    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5hzw\" (UniqueName: \"kubernetes.io/projected/7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f-kube-api-access-n5hzw\") pod \"payload-processing-e2e-ait-976b6f6f-6b5bcbcddc-j5s98\" (UID: \"7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f\") " pod="openshift-ingress/payload-processing-e2e-ait-976b6f6f-6b5bcbcddc-j5s98"
Sep 11 13:08:37.504954 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.504916    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-976b6f6f-6b5bcbcddc-j5s98"
Sep 11 13:08:37.662508 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.662473    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-976b6f6f-c9667758b-x4mmm"
Sep 11 13:08:37.727816 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.727780    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:37.801663 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.801640    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-976b6f6f-6b5bcbcddc-j5s98"]
Sep 11 13:08:37.802438 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:08:37.802412    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a4eb6f4_f1c7_41ee_a15e_f9b54d59f69f.slice/crio-0190857af108be5c8ccc19fcb281f7a09c2b6ad11af6611e8de44bcf7e9e67a7 WatchSource:0}: Error finding container 0190857af108be5c8ccc19fcb281f7a09c2b6ad11af6611e8de44bcf7e9e67a7: Status 404 returned error can't find the container with id 0190857af108be5c8ccc19fcb281f7a09c2b6ad11af6611e8de44bcf7e9e67a7
Sep 11 13:08:37.959945 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:37.959842    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-976b6f6f-c9667758b-x4mmm"]
Sep 11 13:08:37.962052 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:08:37.962024    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fe72cf8_c137_4cfc_89ee_f0ea53ffcb92.slice/crio-034eeb5cab90f0da0d68101e477403347d7c1c0149f8618cdc191ccdb2478764 WatchSource:0}: Error finding container 034eeb5cab90f0da0d68101e477403347d7c1c0149f8618cdc191ccdb2478764: Status 404 returned error can't find the container with id 034eeb5cab90f0da0d68101e477403347d7c1c0149f8618cdc191ccdb2478764
Sep 11 13:08:38.660506 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:38.660473    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-976b6f6f-c9667758b-x4mmm" event={"ID":"9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92","Type":"ContainerStarted","Data":"a4298b11b759c7f320918eb0b32a9b095491bd8393d921a7b22d85e6d1203c2d"}
Sep 11 13:08:38.661019 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:38.660530    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-976b6f6f-c9667758b-x4mmm"
Sep 11 13:08:38.661019 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:38.660555    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-976b6f6f-c9667758b-x4mmm" event={"ID":"9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92","Type":"ContainerStarted","Data":"034eeb5cab90f0da0d68101e477403347d7c1c0149f8618cdc191ccdb2478764"}
Sep 11 13:08:38.662165 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:38.662137    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-976b6f6f-6b5bcbcddc-j5s98" event={"ID":"7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f","Type":"ContainerStarted","Data":"e37e671e9e6226581e2be9fdf2b0fb0f634e112f56900f4fb82d3c3aec7c4720"}
Sep 11 13:08:38.662297 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:38.662183    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-976b6f6f-6b5bcbcddc-j5s98" event={"ID":"7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f","Type":"ContainerStarted","Data":"0190857af108be5c8ccc19fcb281f7a09c2b6ad11af6611e8de44bcf7e9e67a7"}
Sep 11 13:08:38.662297 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:38.662213    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-976b6f6f-6b5bcbcddc-j5s98"
Sep 11 13:08:38.791949 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:38.791869    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-976b6f6f-6b5bcbcddc-j5s98" podStartSLOduration=1.791847163 podStartE2EDuration="1.791847163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:08:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:08:38.785670575 +0000 UTC m=+785.647144763" watchObservedRunningTime="2026-09-11 13:08:38.791847163 +0000 UTC m=+785.653321352"
Sep 11 13:08:38.793184 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:38.793149    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-976b6f6f-c9667758b-x4mmm" podStartSLOduration=1.793138946 podStartE2EDuration="1.793138946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:08:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:08:38.756168424 +0000 UTC m=+785.617642613" watchObservedRunningTime="2026-09-11 13:08:38.793138946 +0000 UTC m=+785.654613133"
Sep 11 13:08:39.489486 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:39.489448    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:39.610422 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:39.610373    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:39.711021 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:39.710982    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:39.822181 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:39.822135    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:40.000241 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:40.000190    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:40.115568 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:40.115474    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:40.225211 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:40.225166    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:40.351280 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:40.351248    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:40.388752 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:40.388655    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-efc023-6fc5d8d55-czdpz"]
Sep 11 13:08:40.392308 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:40.392283    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-efc023-6fc5d8d55-czdpz"
Sep 11 13:08:40.394621 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:40.394595    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-efc023\""
Sep 11 13:08:40.399013 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:40.398983    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-efc023-dockercfg-28gmr\""
Sep 11 13:08:40.422496 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:40.422459    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-efc023-6fc5d8d55-czdpz"]
Sep 11 13:08:40.482076 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:40.482041    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln8ff\" (UniqueName: \"kubernetes.io/projected/4a68873e-e353-4e12-a1ed-de00392af57a-kube-api-access-ln8ff\") pod \"payload-processing-e2e-autores-efc023-6fc5d8d55-czdpz\" (UID: \"4a68873e-e353-4e12-a1ed-de00392af57a\") " pod="openshift-ingress/payload-processing-e2e-autores-efc023-6fc5d8d55-czdpz"
Sep 11 13:08:40.482264 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:40.482120    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a68873e-e353-4e12-a1ed-de00392af57a-plugins-config-volume\") pod \"payload-processing-e2e-autores-efc023-6fc5d8d55-czdpz\" (UID: \"4a68873e-e353-4e12-a1ed-de00392af57a\") " pod="openshift-ingress/payload-processing-e2e-autores-efc023-6fc5d8d55-czdpz"
Sep 11 13:08:40.501146 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:40.501114    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:40.512617 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:40.512583    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-efc023-6f7c7cbf74-sj2tq"]
Sep 11 13:08:40.516013 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:40.515997    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-efc023-6f7c7cbf74-sj2tq"
Sep 11 13:08:40.531273 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:40.531243    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-efc023-6f7c7cbf74-sj2tq"]
Sep 11 13:08:40.583240 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:40.583206    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a68873e-e353-4e12-a1ed-de00392af57a-plugins-config-volume\") pod \"payload-processing-e2e-autores-efc023-6fc5d8d55-czdpz\" (UID: \"4a68873e-e353-4e12-a1ed-de00392af57a\") " pod="openshift-ingress/payload-processing-e2e-autores-efc023-6fc5d8d55-czdpz"
Sep 11 13:08:40.583413 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:40.583249    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qctfj\" (UniqueName: \"kubernetes.io/projected/734dcbc0-f33c-4642-bc11-10ff7ee2263e-kube-api-access-qctfj\") pod \"payload-pre-processing-e2e-autores-efc023-6f7c7cbf74-sj2tq\" (UID: \"734dcbc0-f33c-4642-bc11-10ff7ee2263e\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-efc023-6f7c7cbf74-sj2tq"
Sep 11 13:08:40.583413 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:40.583309    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/734dcbc0-f33c-4642-bc11-10ff7ee2263e-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-efc023-6f7c7cbf74-sj2tq\" (UID: \"734dcbc0-f33c-4642-bc11-10ff7ee2263e\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-efc023-6f7c7cbf74-sj2tq"
Sep 11 13:08:40.583413 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:40.583347    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln8ff\" (UniqueName: \"kubernetes.io/projected/4a68873e-e353-4e12-a1ed-de00392af57a-kube-api-access-ln8ff\") pod \"payload-processing-e2e-autores-efc023-6fc5d8d55-czdpz\" (UID: \"4a68873e-e353-4e12-a1ed-de00392af57a\") " pod="openshift-ingress/payload-processing-e2e-autores-efc023-6fc5d8d55-czdpz"
Sep 11 13:08:40.583977 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:40.583953    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a68873e-e353-4e12-a1ed-de00392af57a-plugins-config-volume\") pod \"payload-processing-e2e-autores-efc023-6fc5d8d55-czdpz\" (UID: \"4a68873e-e353-4e12-a1ed-de00392af57a\") " pod="openshift-ingress/payload-processing-e2e-autores-efc023-6fc5d8d55-czdpz"
Sep 11 13:08:40.598078 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:40.598045    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln8ff\" (UniqueName: \"kubernetes.io/projected/4a68873e-e353-4e12-a1ed-de00392af57a-kube-api-access-ln8ff\") pod \"payload-processing-e2e-autores-efc023-6fc5d8d55-czdpz\" (UID: \"4a68873e-e353-4e12-a1ed-de00392af57a\") " pod="openshift-ingress/payload-processing-e2e-autores-efc023-6fc5d8d55-czdpz"
Sep 11 13:08:40.685025 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:40.684919    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qctfj\" (UniqueName: \"kubernetes.io/projected/734dcbc0-f33c-4642-bc11-10ff7ee2263e-kube-api-access-qctfj\") pod \"payload-pre-processing-e2e-autores-efc023-6f7c7cbf74-sj2tq\" (UID: \"734dcbc0-f33c-4642-bc11-10ff7ee2263e\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-efc023-6f7c7cbf74-sj2tq"
Sep 11 13:08:40.685025 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:40.684990    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/734dcbc0-f33c-4642-bc11-10ff7ee2263e-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-efc023-6f7c7cbf74-sj2tq\" (UID: \"734dcbc0-f33c-4642-bc11-10ff7ee2263e\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-efc023-6f7c7cbf74-sj2tq"
Sep 11 13:08:40.685709 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:40.685689    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/734dcbc0-f33c-4642-bc11-10ff7ee2263e-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-efc023-6f7c7cbf74-sj2tq\" (UID: \"734dcbc0-f33c-4642-bc11-10ff7ee2263e\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-efc023-6f7c7cbf74-sj2tq"
Sep 11 13:08:40.694887 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:40.694853    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qctfj\" (UniqueName: \"kubernetes.io/projected/734dcbc0-f33c-4642-bc11-10ff7ee2263e-kube-api-access-qctfj\") pod \"payload-pre-processing-e2e-autores-efc023-6f7c7cbf74-sj2tq\" (UID: \"734dcbc0-f33c-4642-bc11-10ff7ee2263e\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-efc023-6f7c7cbf74-sj2tq"
Sep 11 13:08:40.705584 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:40.705555    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-efc023-6fc5d8d55-czdpz"
Sep 11 13:08:40.788006 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:40.787971    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:40.829829 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:40.829794    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-efc023-6f7c7cbf74-sj2tq"
Sep 11 13:08:40.888880 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:40.888817    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:40.992535 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:40.992512    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-efc023-6fc5d8d55-czdpz"]
Sep 11 13:08:40.995135 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:08:40.995099    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a68873e_e353_4e12_a1ed_de00392af57a.slice/crio-997381298df156f8aea5fed59664fe82fc2bdcb53316c0e81b076ef5a4d5347f WatchSource:0}: Error finding container 997381298df156f8aea5fed59664fe82fc2bdcb53316c0e81b076ef5a4d5347f: Status 404 returned error can't find the container with id 997381298df156f8aea5fed59664fe82fc2bdcb53316c0e81b076ef5a4d5347f
Sep 11 13:08:41.124730 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:41.124685    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-efc023-6f7c7cbf74-sj2tq"]
Sep 11 13:08:41.127386 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:08:41.127356    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod734dcbc0_f33c_4642_bc11_10ff7ee2263e.slice/crio-003af0571600076fa5768b09b6e10f0e5940fd7dd62fdfc84a01f02fe91badb5 WatchSource:0}: Error finding container 003af0571600076fa5768b09b6e10f0e5940fd7dd62fdfc84a01f02fe91badb5: Status 404 returned error can't find the container with id 003af0571600076fa5768b09b6e10f0e5940fd7dd62fdfc84a01f02fe91badb5
Sep 11 13:08:41.614604 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:41.614576    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-528ff6-847dc875bc-9ldxf"
Sep 11 13:08:41.682531 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:41.682497    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-efc023-6f7c7cbf74-sj2tq" event={"ID":"734dcbc0-f33c-4642-bc11-10ff7ee2263e","Type":"ContainerStarted","Data":"29d083af0ce98588a61364ce619881c22c61323652c6e1231d06bbf68bbcd375"}
Sep 11 13:08:41.682843 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:41.682821    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-efc023-6f7c7cbf74-sj2tq" event={"ID":"734dcbc0-f33c-4642-bc11-10ff7ee2263e","Type":"ContainerStarted","Data":"003af0571600076fa5768b09b6e10f0e5940fd7dd62fdfc84a01f02fe91badb5"}
Sep 11 13:08:41.682958 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:41.682947    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-efc023-6f7c7cbf74-sj2tq"
Sep 11 13:08:41.684596 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:41.684572    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-efc023-6fc5d8d55-czdpz" event={"ID":"4a68873e-e353-4e12-a1ed-de00392af57a","Type":"ContainerStarted","Data":"75570675b2dd06dcff5a61ab9265e94a504905723a79e5a114d52389ae8146fd"}
Sep 11 13:08:41.684782 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:41.684764    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-efc023-6fc5d8d55-czdpz"
Sep 11 13:08:41.684870 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:41.684788    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-efc023-6fc5d8d55-czdpz" event={"ID":"4a68873e-e353-4e12-a1ed-de00392af57a","Type":"ContainerStarted","Data":"997381298df156f8aea5fed59664fe82fc2bdcb53316c0e81b076ef5a4d5347f"}
Sep 11 13:08:41.719890 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:41.719836    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-efc023-6f7c7cbf74-sj2tq" podStartSLOduration=1.719818697 podStartE2EDuration="1.719818697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:08:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:08:41.719329681 +0000 UTC m=+788.580803872" watchObservedRunningTime="2026-09-11 13:08:41.719818697 +0000 UTC m=+788.581292884"
Sep 11 13:08:42.284850 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:42.284814    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:43.327404 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:43.327375    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:43.881167 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:43.881134    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:44.363212 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:44.363177    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:44.783788 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:44.783692    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:45.249768 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:45.249690    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:45.674459 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:45.674430    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:45.809730 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:45.809682    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:46.388575 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:46.388543    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:46.501683 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:46.501651    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:46.651774 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:46.651646    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-efc023-6fc5d8d55-czdpz" podStartSLOduration=6.651623022 podStartE2EDuration="6.651623022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:08:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:08:41.784615684 +0000 UTC m=+788.646089874" watchObservedRunningTime="2026-09-11 13:08:46.651623022 +0000 UTC m=+793.513097212"
Sep 11 13:08:46.653063 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:46.653041    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-a6ba91-5699f887dc-bv6cq"]
Sep 11 13:08:46.656852 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:46.656834    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-a6ba91-5699f887dc-bv6cq"
Sep 11 13:08:46.659819 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:46.659793    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-a6ba91\""
Sep 11 13:08:46.659968 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:46.659951    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-a6ba91-dockercfg-vmvgh\""
Sep 11 13:08:46.691792 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:46.691765    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-a6ba91-5699f887dc-bv6cq"]
Sep 11 13:08:46.744187 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:46.744151    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zm27\" (UniqueName: \"kubernetes.io/projected/c6b5b119-96c1-4c0c-be2d-888cfc2695c7-kube-api-access-2zm27\") pod \"payload-processing-e2e-inf-b-a6ba91-5699f887dc-bv6cq\" (UID: \"c6b5b119-96c1-4c0c-be2d-888cfc2695c7\") " pod="openshift-ingress/payload-processing-e2e-inf-b-a6ba91-5699f887dc-bv6cq"
Sep 11 13:08:46.744456 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:46.744435    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6b5b119-96c1-4c0c-be2d-888cfc2695c7-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-a6ba91-5699f887dc-bv6cq\" (UID: \"c6b5b119-96c1-4c0c-be2d-888cfc2695c7\") " pod="openshift-ingress/payload-processing-e2e-inf-b-a6ba91-5699f887dc-bv6cq"
Sep 11 13:08:46.845208 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:46.845173    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6b5b119-96c1-4c0c-be2d-888cfc2695c7-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-a6ba91-5699f887dc-bv6cq\" (UID: \"c6b5b119-96c1-4c0c-be2d-888cfc2695c7\") " pod="openshift-ingress/payload-processing-e2e-inf-b-a6ba91-5699f887dc-bv6cq"
Sep 11 13:08:46.845366 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:46.845216    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zm27\" (UniqueName: \"kubernetes.io/projected/c6b5b119-96c1-4c0c-be2d-888cfc2695c7-kube-api-access-2zm27\") pod \"payload-processing-e2e-inf-b-a6ba91-5699f887dc-bv6cq\" (UID: \"c6b5b119-96c1-4c0c-be2d-888cfc2695c7\") " pod="openshift-ingress/payload-processing-e2e-inf-b-a6ba91-5699f887dc-bv6cq"
Sep 11 13:08:46.845892 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:46.845872    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6b5b119-96c1-4c0c-be2d-888cfc2695c7-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-a6ba91-5699f887dc-bv6cq\" (UID: \"c6b5b119-96c1-4c0c-be2d-888cfc2695c7\") " pod="openshift-ingress/payload-processing-e2e-inf-b-a6ba91-5699f887dc-bv6cq"
Sep 11 13:08:46.854489 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:46.854458    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zm27\" (UniqueName: \"kubernetes.io/projected/c6b5b119-96c1-4c0c-be2d-888cfc2695c7-kube-api-access-2zm27\") pod \"payload-processing-e2e-inf-b-a6ba91-5699f887dc-bv6cq\" (UID: \"c6b5b119-96c1-4c0c-be2d-888cfc2695c7\") " pod="openshift-ingress/payload-processing-e2e-inf-b-a6ba91-5699f887dc-bv6cq"
Sep 11 13:08:46.968293 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:46.968193    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-a6ba91-5699f887dc-bv6cq"
Sep 11 13:08:46.989324 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:46.989290    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:47.486587 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:47.486557    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-a6ba91-5699f887dc-bv6cq"]
Sep 11 13:08:47.489588 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:08:47.489554    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6b5b119_96c1_4c0c_be2d_888cfc2695c7.slice/crio-4ec5c10369add97ecbde11246b7cfa7d81e6f8eb30f2d120ede96abd577554ee WatchSource:0}: Error finding container 4ec5c10369add97ecbde11246b7cfa7d81e6f8eb30f2d120ede96abd577554ee: Status 404 returned error can't find the container with id 4ec5c10369add97ecbde11246b7cfa7d81e6f8eb30f2d120ede96abd577554ee
Sep 11 13:08:47.721565 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:47.721526    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-a6ba91-5699f887dc-bv6cq" event={"ID":"c6b5b119-96c1-4c0c-be2d-888cfc2695c7","Type":"ContainerStarted","Data":"155d610a0aea9fb687c4d4fa73bcd5d71579d0ca6936e91d52147dc48aecaf40"}
Sep 11 13:08:47.721990 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:47.721579    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-a6ba91-5699f887dc-bv6cq" event={"ID":"c6b5b119-96c1-4c0c-be2d-888cfc2695c7","Type":"ContainerStarted","Data":"4ec5c10369add97ecbde11246b7cfa7d81e6f8eb30f2d120ede96abd577554ee"}
Sep 11 13:08:47.721990 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:47.721623    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-a6ba91-5699f887dc-bv6cq"
Sep 11 13:08:48.446677 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:48.446641    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:49.344106 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:49.344069    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:49.670150 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:49.670064    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-976b6f6f-6b5bcbcddc-j5s98"
Sep 11 13:08:49.670150 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:49.670145    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-976b6f6f-c9667758b-x4mmm"
Sep 11 13:08:49.704106 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:49.704055    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-a6ba91-5699f887dc-bv6cq" podStartSLOduration=3.704040198 podStartE2EDuration="3.704040198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:08:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:08:47.7579698 +0000 UTC m=+794.619443987" watchObservedRunningTime="2026-09-11 13:08:49.704040198 +0000 UTC m=+796.565514385"
Sep 11 13:08:50.799669 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:50.799622    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:52.128118 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:52.128076    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:52.693028 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:52.692991    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-efc023-6fc5d8d55-czdpz"
Sep 11 13:08:52.693242 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:52.693163    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-efc023-6f7c7cbf74-sj2tq"
Sep 11 13:08:53.143231 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:53.143192    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:53.900200 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:53.900129    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:55.186599 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:55.186502    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:56.653392 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:56.653352    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:57.101735 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:57.101676    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:58.125950 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:58.125919    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:58.728280 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:58.728251    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-a6ba91-5699f887dc-bv6cq"
Sep 11 13:08:59.505412 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:08:59.505379    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:00.622889 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:00.622846    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:01.564435 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:01.564373    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:02.491868 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:02.491827    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:03.302079 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:03.302046    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:04.095815 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:04.095772    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:04.266543 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:04.266501    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:05.271221 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.271181    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:05.310259 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.310219    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-976b6f6f-6b5bcbcddc-j5s98"]
Sep 11 13:09:05.310509 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.310484    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-976b6f6f-6b5bcbcddc-j5s98" podUID="7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f" containerName="payload-processing" containerID="cri-o://e37e671e9e6226581e2be9fdf2b0fb0f634e112f56900f4fb82d3c3aec7c4720" gracePeriod=30
Sep 11 13:09:05.319138 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.319111    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-976b6f6f-c9667758b-x4mmm"]
Sep 11 13:09:05.319374 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.319349    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-976b6f6f-c9667758b-x4mmm" podUID="9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92" containerName="payload-pre-processing" containerID="cri-o://a4298b11b759c7f320918eb0b32a9b095491bd8393d921a7b22d85e6d1203c2d" gracePeriod=30
Sep 11 13:09:05.375976 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.375941    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:05.470017 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.469976    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:05.571319 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.571270    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:05.580554 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.580526    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-976b6f6f-6b5bcbcddc-j5s98"
Sep 11 13:09:05.609616 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.609589    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-976b6f6f-c9667758b-x4mmm"
Sep 11 13:09:05.725726 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.725682    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5hzw\" (UniqueName: \"kubernetes.io/projected/7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f-kube-api-access-n5hzw\") pod \"7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f\" (UID: \"7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f\") "
Sep 11 13:09:05.725893 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.725743    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f-plugins-config-volume\") pod \"7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f\" (UID: \"7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f\") "
Sep 11 13:09:05.725893 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.725836    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtfmb\" (UniqueName: \"kubernetes.io/projected/9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92-kube-api-access-dtfmb\") pod \"9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92\" (UID: \"9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92\") "
Sep 11 13:09:05.725987 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.725900    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92-plugins-config-volume\") pod \"9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92\" (UID: \"9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92\") "
Sep 11 13:09:05.726222 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.726148    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f" (UID: "7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:09:05.726366 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.726331    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92" (UID: "9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:09:05.728677 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.728654    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f-kube-api-access-n5hzw" (OuterVolumeSpecName: "kube-api-access-n5hzw") pod "7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f" (UID: "7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f"). InnerVolumeSpecName "kube-api-access-n5hzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:09:05.728807 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.728684    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92-kube-api-access-dtfmb" (OuterVolumeSpecName: "kube-api-access-dtfmb") pod "9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92" (UID: "9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92"). InnerVolumeSpecName "kube-api-access-dtfmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:09:05.763121 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.763082    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:05.824240 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.824206    2547 generic.go:356] "Generic (PLEG): container finished" podID="9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92" containerID="a4298b11b759c7f320918eb0b32a9b095491bd8393d921a7b22d85e6d1203c2d" exitCode=0
Sep 11 13:09:05.824442 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.824262    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-976b6f6f-c9667758b-x4mmm"
Sep 11 13:09:05.824442 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.824264    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-976b6f6f-c9667758b-x4mmm" event={"ID":"9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92","Type":"ContainerDied","Data":"a4298b11b759c7f320918eb0b32a9b095491bd8393d921a7b22d85e6d1203c2d"}
Sep 11 13:09:05.824442 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.824389    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-976b6f6f-c9667758b-x4mmm" event={"ID":"9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92","Type":"ContainerDied","Data":"034eeb5cab90f0da0d68101e477403347d7c1c0149f8618cdc191ccdb2478764"}
Sep 11 13:09:05.824442 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.824437    2547 scope.go:117] "RemoveContainer" containerID="a4298b11b759c7f320918eb0b32a9b095491bd8393d921a7b22d85e6d1203c2d"
Sep 11 13:09:05.825796 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.825768    2547 generic.go:356] "Generic (PLEG): container finished" podID="7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f" containerID="e37e671e9e6226581e2be9fdf2b0fb0f634e112f56900f4fb82d3c3aec7c4720" exitCode=0
Sep 11 13:09:05.825898 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.825795    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-976b6f6f-6b5bcbcddc-j5s98" event={"ID":"7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f","Type":"ContainerDied","Data":"e37e671e9e6226581e2be9fdf2b0fb0f634e112f56900f4fb82d3c3aec7c4720"}
Sep 11 13:09:05.825898 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.825862    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-976b6f6f-6b5bcbcddc-j5s98" event={"ID":"7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f","Type":"ContainerDied","Data":"0190857af108be5c8ccc19fcb281f7a09c2b6ad11af6611e8de44bcf7e9e67a7"}
Sep 11 13:09:05.825898 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.825817    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-976b6f6f-6b5bcbcddc-j5s98"
Sep 11 13:09:05.826602 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.826582    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92-plugins-config-volume\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:09:05.826699 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.826606    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5hzw\" (UniqueName: \"kubernetes.io/projected/7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f-kube-api-access-n5hzw\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:09:05.826699 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.826619    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f-plugins-config-volume\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:09:05.826699 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.826632    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtfmb\" (UniqueName: \"kubernetes.io/projected/9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92-kube-api-access-dtfmb\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:09:05.834260 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.834239    2547 scope.go:117] "RemoveContainer" containerID="a4298b11b759c7f320918eb0b32a9b095491bd8393d921a7b22d85e6d1203c2d"
Sep 11 13:09:05.834614 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:09:05.834585    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4298b11b759c7f320918eb0b32a9b095491bd8393d921a7b22d85e6d1203c2d\": container with ID starting with a4298b11b759c7f320918eb0b32a9b095491bd8393d921a7b22d85e6d1203c2d not found: ID does not exist" containerID="a4298b11b759c7f320918eb0b32a9b095491bd8393d921a7b22d85e6d1203c2d"
Sep 11 13:09:05.834736 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.834627    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4298b11b759c7f320918eb0b32a9b095491bd8393d921a7b22d85e6d1203c2d"} err="failed to get container status \"a4298b11b759c7f320918eb0b32a9b095491bd8393d921a7b22d85e6d1203c2d\": rpc error: code = NotFound desc = could not find container \"a4298b11b759c7f320918eb0b32a9b095491bd8393d921a7b22d85e6d1203c2d\": container with ID starting with a4298b11b759c7f320918eb0b32a9b095491bd8393d921a7b22d85e6d1203c2d not found: ID does not exist"
Sep 11 13:09:05.834736 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.834651    2547 scope.go:117] "RemoveContainer" containerID="e37e671e9e6226581e2be9fdf2b0fb0f634e112f56900f4fb82d3c3aec7c4720"
Sep 11 13:09:05.843729 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.843694    2547 scope.go:117] "RemoveContainer" containerID="e37e671e9e6226581e2be9fdf2b0fb0f634e112f56900f4fb82d3c3aec7c4720"
Sep 11 13:09:05.844147 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:09:05.844120    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e37e671e9e6226581e2be9fdf2b0fb0f634e112f56900f4fb82d3c3aec7c4720\": container with ID starting with e37e671e9e6226581e2be9fdf2b0fb0f634e112f56900f4fb82d3c3aec7c4720 not found: ID does not exist" containerID="e37e671e9e6226581e2be9fdf2b0fb0f634e112f56900f4fb82d3c3aec7c4720"
Sep 11 13:09:05.844258 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.844151    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e37e671e9e6226581e2be9fdf2b0fb0f634e112f56900f4fb82d3c3aec7c4720"} err="failed to get container status \"e37e671e9e6226581e2be9fdf2b0fb0f634e112f56900f4fb82d3c3aec7c4720\": rpc error: code = NotFound desc = could not find container \"e37e671e9e6226581e2be9fdf2b0fb0f634e112f56900f4fb82d3c3aec7c4720\": container with ID starting with e37e671e9e6226581e2be9fdf2b0fb0f634e112f56900f4fb82d3c3aec7c4720 not found: ID does not exist"
Sep 11 13:09:05.857965 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.857939    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-976b6f6f-6b5bcbcddc-j5s98"]
Sep 11 13:09:05.863458 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.863431    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-976b6f6f-6b5bcbcddc-j5s98"]
Sep 11 13:09:05.877316 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.877286    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-976b6f6f-c9667758b-x4mmm"]
Sep 11 13:09:05.882486 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:05.882456    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-976b6f6f-c9667758b-x4mmm"]
Sep 11 13:09:06.103409 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:06.103323    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:06.258673 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:06.258631    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:06.591818 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:06.591790    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:07.000511 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:07.000419    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:07.447392 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:07.447357    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:07.664995 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:07.664961    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f" path="/var/lib/kubelet/pods/7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f/volumes"
Sep 11 13:09:07.665496 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:07.665476    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92" path="/var/lib/kubelet/pods/9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92/volumes"
Sep 11 13:09:08.012210 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:08.012176    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:08.694843 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:08.694804    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:10.160270 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:10.160236    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:10.266409 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:10.266371    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:10.600941 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:10.600906    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:11.960910 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:11.960870    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:15.032791 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:15.032745    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:16.154459 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:16.154428    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:16.302052 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:16.302012    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:16.413562 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:16.413468    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:16.946866 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:16.946832    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:17.155186 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:17.155156    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:17.355190 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:17.355157    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-87e2eb97-686946577d-vl5z7"]
Sep 11 13:09:17.355547 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:17.355535    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f" containerName="payload-processing"
Sep 11 13:09:17.355587 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:17.355550    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f" containerName="payload-processing"
Sep 11 13:09:17.355587 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:17.355565    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92" containerName="payload-pre-processing"
Sep 11 13:09:17.355587 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:17.355571    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92" containerName="payload-pre-processing"
Sep 11 13:09:17.355684 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:17.355643    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fe72cf8-c137-4cfc-89ee-f0ea53ffcb92" containerName="payload-pre-processing"
Sep 11 13:09:17.355684 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:17.355655    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a4eb6f4-f1c7-41ee-a15e-f9b54d59f69f" containerName="payload-processing"
Sep 11 13:09:17.360003 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:17.359982    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-87e2eb97-686946577d-vl5z7"
Sep 11 13:09:17.364494 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:17.364471    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-87e2eb97-dockercfg-bxm9v\""
Sep 11 13:09:17.364837 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:17.364819    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-87e2eb97\""
Sep 11 13:09:17.393891 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:17.393858    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-87e2eb97-686946577d-vl5z7"]
Sep 11 13:09:17.435234 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:17.435200    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-87e2eb97-686946577d-vl5z7\" (UID: \"ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-87e2eb97-686946577d-vl5z7"
Sep 11 13:09:17.435234 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:17.435241    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzlck\" (UniqueName: \"kubernetes.io/projected/ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2-kube-api-access-jzlck\") pod \"payload-pre-processing-e2e-migrate-87e2eb97-686946577d-vl5z7\" (UID: \"ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-87e2eb97-686946577d-vl5z7"
Sep 11 13:09:17.542168 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:17.542119    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzlck\" (UniqueName: \"kubernetes.io/projected/ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2-kube-api-access-jzlck\") pod \"payload-pre-processing-e2e-migrate-87e2eb97-686946577d-vl5z7\" (UID: \"ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-87e2eb97-686946577d-vl5z7"
Sep 11 13:09:17.542378 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:17.542278    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-87e2eb97-686946577d-vl5z7\" (UID: \"ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-87e2eb97-686946577d-vl5z7"
Sep 11 13:09:17.542963 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:17.542942    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-87e2eb97-686946577d-vl5z7\" (UID: \"ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-87e2eb97-686946577d-vl5z7"
Sep 11 13:09:17.561268 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:17.561227    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzlck\" (UniqueName: \"kubernetes.io/projected/ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2-kube-api-access-jzlck\") pod \"payload-pre-processing-e2e-migrate-87e2eb97-686946577d-vl5z7\" (UID: \"ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-87e2eb97-686946577d-vl5z7"
Sep 11 13:09:17.670544 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:17.670462    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-87e2eb97-686946577d-vl5z7"
Sep 11 13:09:17.984636 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:17.984551    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-87e2eb97-686946577d-vl5z7"]
Sep 11 13:09:17.996921 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:09:17.996893    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea8ac0f6_e2e3_4e81_9ad9_a87e724057c2.slice/crio-267e24db814c89a53835b66e0a7785ee72530712bc41412c8536b661e3f675da WatchSource:0}: Error finding container 267e24db814c89a53835b66e0a7785ee72530712bc41412c8536b661e3f675da: Status 404 returned error can't find the container with id 267e24db814c89a53835b66e0a7785ee72530712bc41412c8536b661e3f675da
Sep 11 13:09:18.124037 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:18.123996    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:18.903418 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:18.903389    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-87e2eb97-686946577d-vl5z7" event={"ID":"ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2","Type":"ContainerStarted","Data":"ee3d5c008dcc9d261f2c7156ed8950ace820a22a64b615cb2804ac8acea52c52"}
Sep 11 13:09:18.903850 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:18.903446    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-87e2eb97-686946577d-vl5z7" event={"ID":"ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2","Type":"ContainerStarted","Data":"267e24db814c89a53835b66e0a7785ee72530712bc41412c8536b661e3f675da"}
Sep 11 13:09:18.903850 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:18.903476    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-87e2eb97-686946577d-vl5z7"
Sep 11 13:09:18.924603 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:18.924554    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-87e2eb97-686946577d-vl5z7" podStartSLOduration=1.924538181 podStartE2EDuration="1.924538181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:09:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:09:18.922385774 +0000 UTC m=+825.783859963" watchObservedRunningTime="2026-09-11 13:09:18.924538181 +0000 UTC m=+825.786012368"
Sep 11 13:09:19.198629 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:19.198543    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:21.309273 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:21.309242    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"]
Sep 11 13:09:21.313049 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:21.313025    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"
Sep 11 13:09:21.315669 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:21.315652    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-a-ae83ed5e-kserve-self-signed-certs\""
Sep 11 13:09:21.328193 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:21.328170    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"]
Sep 11 13:09:21.338911 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:21.338867    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:21.375681 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:21.375657    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzmsx\" (UniqueName: \"kubernetes.io/projected/b00a6f1e-3c45-497e-8392-97c702209e25-kube-api-access-vzmsx\") pod \"e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99\" (UID: \"b00a6f1e-3c45-497e-8392-97c702209e25\") " pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"
Sep 11 13:09:21.375819 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:21.375696    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b00a6f1e-3c45-497e-8392-97c702209e25-dshm\") pod \"e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99\" (UID: \"b00a6f1e-3c45-497e-8392-97c702209e25\") " pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"
Sep 11 13:09:21.375819 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:21.375736    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b00a6f1e-3c45-497e-8392-97c702209e25-home\") pod \"e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99\" (UID: \"b00a6f1e-3c45-497e-8392-97c702209e25\") " pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"
Sep 11 13:09:21.375819 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:21.375807    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b00a6f1e-3c45-497e-8392-97c702209e25-tls-certs\") pod \"e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99\" (UID: \"b00a6f1e-3c45-497e-8392-97c702209e25\") " pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"
Sep 11 13:09:21.375949 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:21.375878    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b00a6f1e-3c45-497e-8392-97c702209e25-model-cache\") pod \"e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99\" (UID: \"b00a6f1e-3c45-497e-8392-97c702209e25\") " pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"
Sep 11 13:09:21.375949 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:21.375935    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b00a6f1e-3c45-497e-8392-97c702209e25-tmp-dir\") pod \"e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99\" (UID: \"b00a6f1e-3c45-497e-8392-97c702209e25\") " pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"
Sep 11 13:09:21.477063 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:21.477030    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b00a6f1e-3c45-497e-8392-97c702209e25-tmp-dir\") pod \"e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99\" (UID: \"b00a6f1e-3c45-497e-8392-97c702209e25\") " pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"
Sep 11 13:09:21.477253 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:21.477071    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzmsx\" (UniqueName: \"kubernetes.io/projected/b00a6f1e-3c45-497e-8392-97c702209e25-kube-api-access-vzmsx\") pod \"e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99\" (UID: \"b00a6f1e-3c45-497e-8392-97c702209e25\") " pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"
Sep 11 13:09:21.477253 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:21.477098    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b00a6f1e-3c45-497e-8392-97c702209e25-dshm\") pod \"e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99\" (UID: \"b00a6f1e-3c45-497e-8392-97c702209e25\") " pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"
Sep 11 13:09:21.477253 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:21.477127    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b00a6f1e-3c45-497e-8392-97c702209e25-home\") pod \"e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99\" (UID: \"b00a6f1e-3c45-497e-8392-97c702209e25\") " pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"
Sep 11 13:09:21.477253 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:21.477157    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b00a6f1e-3c45-497e-8392-97c702209e25-tls-certs\") pod \"e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99\" (UID: \"b00a6f1e-3c45-497e-8392-97c702209e25\") " pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"
Sep 11 13:09:21.477253 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:21.477185    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b00a6f1e-3c45-497e-8392-97c702209e25-model-cache\") pod \"e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99\" (UID: \"b00a6f1e-3c45-497e-8392-97c702209e25\") " pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"
Sep 11 13:09:21.477572 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:21.477550    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b00a6f1e-3c45-497e-8392-97c702209e25-home\") pod \"e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99\" (UID: \"b00a6f1e-3c45-497e-8392-97c702209e25\") " pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"
Sep 11 13:09:21.477572 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:21.477565    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b00a6f1e-3c45-497e-8392-97c702209e25-model-cache\") pod \"e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99\" (UID: \"b00a6f1e-3c45-497e-8392-97c702209e25\") " pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"
Sep 11 13:09:21.477695 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:21.477559    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b00a6f1e-3c45-497e-8392-97c702209e25-tmp-dir\") pod \"e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99\" (UID: \"b00a6f1e-3c45-497e-8392-97c702209e25\") " pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"
Sep 11 13:09:21.479595 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:21.479573    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b00a6f1e-3c45-497e-8392-97c702209e25-dshm\") pod \"e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99\" (UID: \"b00a6f1e-3c45-497e-8392-97c702209e25\") " pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"
Sep 11 13:09:21.480040 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:21.480023    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b00a6f1e-3c45-497e-8392-97c702209e25-tls-certs\") pod \"e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99\" (UID: \"b00a6f1e-3c45-497e-8392-97c702209e25\") " pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"
Sep 11 13:09:21.488255 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:21.488221    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzmsx\" (UniqueName: \"kubernetes.io/projected/b00a6f1e-3c45-497e-8392-97c702209e25-kube-api-access-vzmsx\") pod \"e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99\" (UID: \"b00a6f1e-3c45-497e-8392-97c702209e25\") " pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"
Sep 11 13:09:21.622332 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:21.622254    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"
Sep 11 13:09:21.903104 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:21.903073    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"]
Sep 11 13:09:21.904458 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:09:21.904432    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb00a6f1e_3c45_497e_8392_97c702209e25.slice/crio-6f2574b688fa30766470be696a3865245058c2c01ba1100a7c53b2c7375ca839 WatchSource:0}: Error finding container 6f2574b688fa30766470be696a3865245058c2c01ba1100a7c53b2c7375ca839: Status 404 returned error can't find the container with id 6f2574b688fa30766470be696a3865245058c2c01ba1100a7c53b2c7375ca839
Sep 11 13:09:21.920063 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:21.920038    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99" event={"ID":"b00a6f1e-3c45-497e-8392-97c702209e25","Type":"ContainerStarted","Data":"6f2574b688fa30766470be696a3865245058c2c01ba1100a7c53b2c7375ca839"}
Sep 11 13:09:22.927804 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:22.927768    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99" event={"ID":"b00a6f1e-3c45-497e-8392-97c702209e25","Type":"ContainerStarted","Data":"d19831d61dcc3caf5b222e08c2a8f1a34c2d957418ca803ddb12e81867473ffc"}
Sep 11 13:09:22.949652 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:22.949590    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99" podStartSLOduration=1.9495736909999999 podStartE2EDuration="1.949573691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:09:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:09:22.948153888 +0000 UTC m=+829.809628076" watchObservedRunningTime="2026-09-11 13:09:22.949573691 +0000 UTC m=+829.811047878"
Sep 11 13:09:29.911685 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:29.911654    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-87e2eb97-686946577d-vl5z7"
Sep 11 13:09:31.622795 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:31.622761    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"
Sep 11 13:09:31.622795 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:31.622803    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"
Sep 11 13:09:31.635557 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:31.635533    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"
Sep 11 13:09:31.995375 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:31.995295    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"
Sep 11 13:09:32.716413 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:32.716378    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"]
Sep 11 13:09:32.719985 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:32.719965    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"
Sep 11 13:09:32.729850 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:32.729828    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-efc023\"/\"kube-root-ca.crt\""
Sep 11 13:09:32.730533 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:32.730514    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-efc023\"/\"openshift-service-ca.crt\""
Sep 11 13:09:32.733501 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:32.733482    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-efc023\"/\"autores-model-efc023-kserve-self-signed-certs\""
Sep 11 13:09:32.733804 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:32.733788    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-efc023\"/\"default-dockercfg-jk85r\""
Sep 11 13:09:32.752785 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:32.752758    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"]
Sep 11 13:09:32.784414 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:32.784387    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e76a306-b456-4c9b-ab29-7bf6f66a4365-home\") pod \"autores-model-efc023-kserve-584d5ddf75-z49b9\" (UID: \"5e76a306-b456-4c9b-ab29-7bf6f66a4365\") " pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"
Sep 11 13:09:32.784565 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:32.784433    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e76a306-b456-4c9b-ab29-7bf6f66a4365-tmp-dir\") pod \"autores-model-efc023-kserve-584d5ddf75-z49b9\" (UID: \"5e76a306-b456-4c9b-ab29-7bf6f66a4365\") " pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"
Sep 11 13:09:32.784565 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:32.784453    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e76a306-b456-4c9b-ab29-7bf6f66a4365-dshm\") pod \"autores-model-efc023-kserve-584d5ddf75-z49b9\" (UID: \"5e76a306-b456-4c9b-ab29-7bf6f66a4365\") " pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"
Sep 11 13:09:32.784565 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:32.784538    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e76a306-b456-4c9b-ab29-7bf6f66a4365-model-cache\") pod \"autores-model-efc023-kserve-584d5ddf75-z49b9\" (UID: \"5e76a306-b456-4c9b-ab29-7bf6f66a4365\") " pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"
Sep 11 13:09:32.784682 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:32.784579    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg7sx\" (UniqueName: \"kubernetes.io/projected/5e76a306-b456-4c9b-ab29-7bf6f66a4365-kube-api-access-jg7sx\") pod \"autores-model-efc023-kserve-584d5ddf75-z49b9\" (UID: \"5e76a306-b456-4c9b-ab29-7bf6f66a4365\") " pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"
Sep 11 13:09:32.784682 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:32.784663    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e76a306-b456-4c9b-ab29-7bf6f66a4365-tls-certs\") pod \"autores-model-efc023-kserve-584d5ddf75-z49b9\" (UID: \"5e76a306-b456-4c9b-ab29-7bf6f66a4365\") " pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"
Sep 11 13:09:32.885836 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:32.885797    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg7sx\" (UniqueName: \"kubernetes.io/projected/5e76a306-b456-4c9b-ab29-7bf6f66a4365-kube-api-access-jg7sx\") pod \"autores-model-efc023-kserve-584d5ddf75-z49b9\" (UID: \"5e76a306-b456-4c9b-ab29-7bf6f66a4365\") " pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"
Sep 11 13:09:32.886018 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:32.885879    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e76a306-b456-4c9b-ab29-7bf6f66a4365-tls-certs\") pod \"autores-model-efc023-kserve-584d5ddf75-z49b9\" (UID: \"5e76a306-b456-4c9b-ab29-7bf6f66a4365\") " pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"
Sep 11 13:09:32.886018 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:32.885931    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e76a306-b456-4c9b-ab29-7bf6f66a4365-home\") pod \"autores-model-efc023-kserve-584d5ddf75-z49b9\" (UID: \"5e76a306-b456-4c9b-ab29-7bf6f66a4365\") " pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"
Sep 11 13:09:32.886018 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:32.885977    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e76a306-b456-4c9b-ab29-7bf6f66a4365-tmp-dir\") pod \"autores-model-efc023-kserve-584d5ddf75-z49b9\" (UID: \"5e76a306-b456-4c9b-ab29-7bf6f66a4365\") " pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"
Sep 11 13:09:32.886018 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:32.886000    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e76a306-b456-4c9b-ab29-7bf6f66a4365-dshm\") pod \"autores-model-efc023-kserve-584d5ddf75-z49b9\" (UID: \"5e76a306-b456-4c9b-ab29-7bf6f66a4365\") " pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"
Sep 11 13:09:32.886295 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:32.886091    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e76a306-b456-4c9b-ab29-7bf6f66a4365-model-cache\") pod \"autores-model-efc023-kserve-584d5ddf75-z49b9\" (UID: \"5e76a306-b456-4c9b-ab29-7bf6f66a4365\") " pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"
Sep 11 13:09:32.886455 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:32.886433    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e76a306-b456-4c9b-ab29-7bf6f66a4365-home\") pod \"autores-model-efc023-kserve-584d5ddf75-z49b9\" (UID: \"5e76a306-b456-4c9b-ab29-7bf6f66a4365\") " pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"
Sep 11 13:09:32.886549 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:32.886460    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e76a306-b456-4c9b-ab29-7bf6f66a4365-model-cache\") pod \"autores-model-efc023-kserve-584d5ddf75-z49b9\" (UID: \"5e76a306-b456-4c9b-ab29-7bf6f66a4365\") " pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"
Sep 11 13:09:32.886549 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:32.886485    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e76a306-b456-4c9b-ab29-7bf6f66a4365-tmp-dir\") pod \"autores-model-efc023-kserve-584d5ddf75-z49b9\" (UID: \"5e76a306-b456-4c9b-ab29-7bf6f66a4365\") " pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"
Sep 11 13:09:32.888556 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:32.888521    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e76a306-b456-4c9b-ab29-7bf6f66a4365-dshm\") pod \"autores-model-efc023-kserve-584d5ddf75-z49b9\" (UID: \"5e76a306-b456-4c9b-ab29-7bf6f66a4365\") " pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"
Sep 11 13:09:32.888556 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:32.888544    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e76a306-b456-4c9b-ab29-7bf6f66a4365-tls-certs\") pod \"autores-model-efc023-kserve-584d5ddf75-z49b9\" (UID: \"5e76a306-b456-4c9b-ab29-7bf6f66a4365\") " pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"
Sep 11 13:09:32.894437 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:32.894416    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg7sx\" (UniqueName: \"kubernetes.io/projected/5e76a306-b456-4c9b-ab29-7bf6f66a4365-kube-api-access-jg7sx\") pod \"autores-model-efc023-kserve-584d5ddf75-z49b9\" (UID: \"5e76a306-b456-4c9b-ab29-7bf6f66a4365\") " pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"
Sep 11 13:09:33.020664 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:33.020565    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:33.029463 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:33.029445    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"
Sep 11 13:09:33.315302 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:33.315154    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"]
Sep 11 13:09:33.317707 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:09:33.317681    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e76a306_b456_4c9b_ab29_7bf6f66a4365.slice/crio-603cf27638feef9e622cbffe4bb65942efb2f2f03391787c2c6a813cc3562eec WatchSource:0}: Error finding container 603cf27638feef9e622cbffe4bb65942efb2f2f03391787c2c6a813cc3562eec: Status 404 returned error can't find the container with id 603cf27638feef9e622cbffe4bb65942efb2f2f03391787c2c6a813cc3562eec
Sep 11 13:09:33.997699 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:33.997605    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9" event={"ID":"5e76a306-b456-4c9b-ab29-7bf6f66a4365","Type":"ContainerStarted","Data":"594d0360101ce78e9664ab03fedf38ad4234041411fe0a534929693a0c21b2e4"}
Sep 11 13:09:33.997699 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:33.997647    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9" event={"ID":"5e76a306-b456-4c9b-ab29-7bf6f66a4365","Type":"ContainerStarted","Data":"603cf27638feef9e622cbffe4bb65942efb2f2f03391787c2c6a813cc3562eec"}
Sep 11 13:09:34.027978 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:34.027922    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9" podStartSLOduration=2.027906373 podStartE2EDuration="2.027906373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:09:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:09:34.026912538 +0000 UTC m=+840.888386725" watchObservedRunningTime="2026-09-11 13:09:34.027906373 +0000 UTC m=+840.889380561"
Sep 11 13:09:39.296477 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:39.296437    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:40.422380 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:40.422342    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:41.261778 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:41.261738    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:42.045271 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:42.045234    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:43.030449 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:43.030408    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"
Sep 11 13:09:43.030449 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:43.030456    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"
Sep 11 13:09:43.042673 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:43.042650    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"
Sep 11 13:09:43.066694 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:43.066669    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"
Sep 11 13:09:43.239163 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:43.239132    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:44.012437 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:44.012398    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:44.112154 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:44.112111    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:44.240408 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:44.240371    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:44.388116 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:44.388085    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:45.474833 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:45.474796    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:50.421183 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:50.421148    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:50.596666 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:50.596626    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:50.818573 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:50.818538    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:50.985379 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:50.985342    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:51.309731 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:51.309674    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:52.195847 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:52.195804    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:52.260115 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:52.260084    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-87e2eb97-686946577d-vl5z7"]
Sep 11 13:09:52.260388 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:52.260363    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-87e2eb97-686946577d-vl5z7" podUID="ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2" containerName="payload-pre-processing" containerID="cri-o://ee3d5c008dcc9d261f2c7156ed8950ace820a22a64b615cb2804ac8acea52c52" gracePeriod=30
Sep 11 13:09:52.307097 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:52.307062    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:52.413432 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:52.413393    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:52.522907 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:52.522874    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-87e2eb97-686946577d-vl5z7"
Sep 11 13:09:52.535390 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:52.535353    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:52.684566 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:52.684528    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2-plugins-config-volume\") pod \"ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2\" (UID: \"ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2\") "
Sep 11 13:09:52.684795 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:52.684586    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzlck\" (UniqueName: \"kubernetes.io/projected/ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2-kube-api-access-jzlck\") pod \"ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2\" (UID: \"ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2\") "
Sep 11 13:09:52.685004 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:52.684979    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2" (UID: "ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:09:52.686957 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:52.686933    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2-kube-api-access-jzlck" (OuterVolumeSpecName: "kube-api-access-jzlck") pod "ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2" (UID: "ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2"). InnerVolumeSpecName "kube-api-access-jzlck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:09:52.749289 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:52.749249    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:52.786030 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:52.785936    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2-plugins-config-volume\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:09:52.786030 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:52.785966    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzlck\" (UniqueName: \"kubernetes.io/projected/ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2-kube-api-access-jzlck\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:09:52.994010 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:52.993967    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:53.116440 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:53.116410    2547 generic.go:356] "Generic (PLEG): container finished" podID="ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2" containerID="ee3d5c008dcc9d261f2c7156ed8950ace820a22a64b615cb2804ac8acea52c52" exitCode=0
Sep 11 13:09:53.116642 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:53.116456    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-87e2eb97-686946577d-vl5z7" event={"ID":"ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2","Type":"ContainerDied","Data":"ee3d5c008dcc9d261f2c7156ed8950ace820a22a64b615cb2804ac8acea52c52"}
Sep 11 13:09:53.116642 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:53.116492    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-87e2eb97-686946577d-vl5z7" event={"ID":"ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2","Type":"ContainerDied","Data":"267e24db814c89a53835b66e0a7785ee72530712bc41412c8536b661e3f675da"}
Sep 11 13:09:53.116642 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:53.116513    2547 scope.go:117] "RemoveContainer" containerID="ee3d5c008dcc9d261f2c7156ed8950ace820a22a64b615cb2804ac8acea52c52"
Sep 11 13:09:53.116642 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:53.116457    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-87e2eb97-686946577d-vl5z7"
Sep 11 13:09:53.126896 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:53.126877    2547 scope.go:117] "RemoveContainer" containerID="ee3d5c008dcc9d261f2c7156ed8950ace820a22a64b615cb2804ac8acea52c52"
Sep 11 13:09:53.127183 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:09:53.127165    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee3d5c008dcc9d261f2c7156ed8950ace820a22a64b615cb2804ac8acea52c52\": container with ID starting with ee3d5c008dcc9d261f2c7156ed8950ace820a22a64b615cb2804ac8acea52c52 not found: ID does not exist" containerID="ee3d5c008dcc9d261f2c7156ed8950ace820a22a64b615cb2804ac8acea52c52"
Sep 11 13:09:53.127246 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:53.127198    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee3d5c008dcc9d261f2c7156ed8950ace820a22a64b615cb2804ac8acea52c52"} err="failed to get container status \"ee3d5c008dcc9d261f2c7156ed8950ace820a22a64b615cb2804ac8acea52c52\": rpc error: code = NotFound desc = could not find container \"ee3d5c008dcc9d261f2c7156ed8950ace820a22a64b615cb2804ac8acea52c52\": container with ID starting with ee3d5c008dcc9d261f2c7156ed8950ace820a22a64b615cb2804ac8acea52c52 not found: ID does not exist"
Sep 11 13:09:53.128814 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:53.128748    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:53.143882 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:53.143849    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-87e2eb97-686946577d-vl5z7"]
Sep 11 13:09:53.146139 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:53.146118    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-87e2eb97-686946577d-vl5z7"]
Sep 11 13:09:53.664923 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:53.664890    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2" path="/var/lib/kubelet/pods/ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2/volumes"
Sep 11 13:09:53.719776 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:53.719739    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:53.834913 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:53.834877    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:54.608077 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:54.608043    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:55.910795 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:55.910755    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:56.052766 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:56.052676    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:56.308241 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:56.308203    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:58.078642 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:58.078596    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:59.696781 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:59.696741    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:59.988582 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:09:59.988457    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:01.155197 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:01.155144    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:01.276315 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:01.276283    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:01.912691 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:01.912651    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:02.148851 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:02.148807    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:03.226419 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:03.226381    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:03.334915 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:03.334872    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:04.279865 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:04.279819    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:05.096829 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:05.096789    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:05.524576 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:05.524468    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-efc023-j468f"]
Sep 11 13:10:05.525927 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:05.525898    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2" containerName="payload-pre-processing"
Sep 11 13:10:05.526078 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:05.526066    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2" containerName="payload-pre-processing"
Sep 11 13:10:05.526431 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:05.526414    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea8ac0f6-e2e3-4e81-9ad9-a87e724057c2" containerName="payload-pre-processing"
Sep 11 13:10:05.530391 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:05.530370    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-efc023-j468f"
Sep 11 13:10:05.534996 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:05.534966    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kt2vz\""
Sep 11 13:10:05.535189 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:05.534966    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:10:05.537633 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:05.537608    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-efc023-j468f"]
Sep 11 13:10:05.611567 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:05.611523    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/668c4114-8b24-469f-b10e-5434526304fb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-efc023-j468f\" (UID: \"668c4114-8b24-469f-b10e-5434526304fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-efc023-j468f"
Sep 11 13:10:05.712294 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:05.712256    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/668c4114-8b24-469f-b10e-5434526304fb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-efc023-j468f\" (UID: \"668c4114-8b24-469f-b10e-5434526304fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-efc023-j468f"
Sep 11 13:10:05.712931 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:05.712913    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/668c4114-8b24-469f-b10e-5434526304fb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-efc023-j468f\" (UID: \"668c4114-8b24-469f-b10e-5434526304fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-efc023-j468f"
Sep 11 13:10:05.761011 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:05.760976    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:05.844451 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:05.844410    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-efc023-j468f"
Sep 11 13:10:06.127179 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:06.127150    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-efc023-j468f"]
Sep 11 13:10:06.128984 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:10:06.128958    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod668c4114_8b24_469f_b10e_5434526304fb.slice/crio-10c29d3d11211f8c8b6b25ddfc0ee2cb499c333254de6039fd9b1be3469a97e7 WatchSource:0}: Error finding container 10c29d3d11211f8c8b6b25ddfc0ee2cb499c333254de6039fd9b1be3469a97e7: Status 404 returned error can't find the container with id 10c29d3d11211f8c8b6b25ddfc0ee2cb499c333254de6039fd9b1be3469a97e7
Sep 11 13:10:06.196027 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:06.195987    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-efc023-j468f" event={"ID":"668c4114-8b24-469f-b10e-5434526304fb","Type":"ContainerStarted","Data":"10c29d3d11211f8c8b6b25ddfc0ee2cb499c333254de6039fd9b1be3469a97e7"}
Sep 11 13:10:06.689544 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:06.689503    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:07.890689 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:07.890647    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:08.852977 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:08.852942    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:09.220286 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:09.220194    2547 generic.go:356] "Generic (PLEG): container finished" podID="668c4114-8b24-469f-b10e-5434526304fb" containerID="80de273d62a3e90149a5d7dad35d2fc73329ce964d83be4a711e5ac1d7d4384a" exitCode=0
Sep 11 13:10:09.220643 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:09.220284    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-efc023-j468f" event={"ID":"668c4114-8b24-469f-b10e-5434526304fb","Type":"ContainerDied","Data":"80de273d62a3e90149a5d7dad35d2fc73329ce964d83be4a711e5ac1d7d4384a"}
Sep 11 13:10:09.899367 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:09.899328    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:10.363183 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:10.363160    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-efc023-j468f"
Sep 11 13:10:10.457336 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:10.457304    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/668c4114-8b24-469f-b10e-5434526304fb-maas-api-service-ca\") pod \"668c4114-8b24-469f-b10e-5434526304fb\" (UID: \"668c4114-8b24-469f-b10e-5434526304fb\") "
Sep 11 13:10:10.457639 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:10.457618    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/668c4114-8b24-469f-b10e-5434526304fb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "668c4114-8b24-469f-b10e-5434526304fb" (UID: "668c4114-8b24-469f-b10e-5434526304fb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:10:10.558529 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:10.558503    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/668c4114-8b24-469f-b10e-5434526304fb-maas-api-service-ca\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:10:10.904687 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:10.904652    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:11.233191 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:11.233103    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-efc023-j468f"
Sep 11 13:10:11.233362 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:11.233140    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-efc023-j468f" event={"ID":"668c4114-8b24-469f-b10e-5434526304fb","Type":"ContainerDied","Data":"10c29d3d11211f8c8b6b25ddfc0ee2cb499c333254de6039fd9b1be3469a97e7"}
Sep 11 13:10:11.233362 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:11.233247    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="10c29d3d11211f8c8b6b25ddfc0ee2cb499c333254de6039fd9b1be3469a97e7"
Sep 11 13:10:11.725336 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:11.725304    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-48769560-kt7xk"]
Sep 11 13:10:11.725707 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:11.725678    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="668c4114-8b24-469f-b10e-5434526304fb" containerName="revoke-keys"
Sep 11 13:10:11.725707 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:11.725692    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="668c4114-8b24-469f-b10e-5434526304fb" containerName="revoke-keys"
Sep 11 13:10:11.725844 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:11.725784    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="668c4114-8b24-469f-b10e-5434526304fb" containerName="revoke-keys"
Sep 11 13:10:11.728841 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:11.728826    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-48769560-kt7xk"
Sep 11 13:10:11.754483 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:11.754460    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:10:11.756675 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:11.756658    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kt2vz\""
Sep 11 13:10:11.770160 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:11.770129    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7483f299-c78b-4b13-b0f4-31e61ec80c40-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-48769560-kt7xk\" (UID: \"7483f299-c78b-4b13-b0f4-31e61ec80c40\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-48769560-kt7xk"
Sep 11 13:10:11.776287 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:11.776263    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-48769560-kt7xk"]
Sep 11 13:10:11.871032 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:11.870993    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7483f299-c78b-4b13-b0f4-31e61ec80c40-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-48769560-kt7xk\" (UID: \"7483f299-c78b-4b13-b0f4-31e61ec80c40\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-48769560-kt7xk"
Sep 11 13:10:11.871582 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:11.871563    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7483f299-c78b-4b13-b0f4-31e61ec80c40-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-48769560-kt7xk\" (UID: \"7483f299-c78b-4b13-b0f4-31e61ec80c40\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-48769560-kt7xk"
Sep 11 13:10:12.039251 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:12.039173    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-48769560-kt7xk"
Sep 11 13:10:12.304067 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:12.303953    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:12.325941 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:12.325919    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-48769560-kt7xk"]
Sep 11 13:10:12.328924 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:10:12.328898    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7483f299_c78b_4b13_b0f4_31e61ec80c40.slice/crio-d451f3a8a408769a88165752ee3e03d244023dd29d96f405680eab96d753d08e WatchSource:0}: Error finding container d451f3a8a408769a88165752ee3e03d244023dd29d96f405680eab96d753d08e: Status 404 returned error can't find the container with id d451f3a8a408769a88165752ee3e03d244023dd29d96f405680eab96d753d08e
Sep 11 13:10:13.246140 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:13.246106    2547 generic.go:356] "Generic (PLEG): container finished" podID="7483f299-c78b-4b13-b0f4-31e61ec80c40" containerID="e17eac204e091b033edeeda67581c6ba0b44f3d8f289a4b4fd1756d7b4bb0721" exitCode=0
Sep 11 13:10:13.246540 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:13.246170    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-48769560-kt7xk" event={"ID":"7483f299-c78b-4b13-b0f4-31e61ec80c40","Type":"ContainerDied","Data":"e17eac204e091b033edeeda67581c6ba0b44f3d8f289a4b4fd1756d7b4bb0721"}
Sep 11 13:10:13.246540 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:13.246217    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-48769560-kt7xk" event={"ID":"7483f299-c78b-4b13-b0f4-31e61ec80c40","Type":"ContainerStarted","Data":"d451f3a8a408769a88165752ee3e03d244023dd29d96f405680eab96d753d08e"}
Sep 11 13:10:13.254818 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:13.254787    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:14.085468 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:14.085432    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:14.389486 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:14.389461    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-48769560-kt7xk"
Sep 11 13:10:14.497040 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:14.497004    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7483f299-c78b-4b13-b0f4-31e61ec80c40-maas-api-service-ca\") pod \"7483f299-c78b-4b13-b0f4-31e61ec80c40\" (UID: \"7483f299-c78b-4b13-b0f4-31e61ec80c40\") "
Sep 11 13:10:14.497349 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:14.497326    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7483f299-c78b-4b13-b0f4-31e61ec80c40-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7483f299-c78b-4b13-b0f4-31e61ec80c40" (UID: "7483f299-c78b-4b13-b0f4-31e61ec80c40"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:10:14.597991 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:14.597953    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7483f299-c78b-4b13-b0f4-31e61ec80c40-maas-api-service-ca\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:10:14.971381 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:14.971343    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:15.258955 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:15.258870    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-48769560-kt7xk"
Sep 11 13:10:15.258955 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:15.258915    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-48769560-kt7xk" event={"ID":"7483f299-c78b-4b13-b0f4-31e61ec80c40","Type":"ContainerDied","Data":"d451f3a8a408769a88165752ee3e03d244023dd29d96f405680eab96d753d08e"}
Sep 11 13:10:15.259143 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:15.258971    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d451f3a8a408769a88165752ee3e03d244023dd29d96f405680eab96d753d08e"
Sep 11 13:10:15.681850 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:15.681815    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:15.730672 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:15.730643    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-efc023-6fc5d8d55-czdpz"]
Sep 11 13:10:15.730949 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:15.730921    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-efc023-6fc5d8d55-czdpz" podUID="4a68873e-e353-4e12-a1ed-de00392af57a" containerName="payload-processing" containerID="cri-o://75570675b2dd06dcff5a61ab9265e94a504905723a79e5a114d52389ae8146fd" gracePeriod=30
Sep 11 13:10:15.755314 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:15.755289    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-efc023-6f7c7cbf74-sj2tq"]
Sep 11 13:10:15.755495 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:15.755477    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-efc023-6f7c7cbf74-sj2tq" podUID="734dcbc0-f33c-4642-bc11-10ff7ee2263e" containerName="payload-pre-processing" containerID="cri-o://29d083af0ce98588a61364ce619881c22c61323652c6e1231d06bbf68bbcd375" gracePeriod=30
Sep 11 13:10:15.808935 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:15.808905    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:15.926486 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:15.926414    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:16.016968 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.016940    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-efc023-j468f"]
Sep 11 13:10:16.021090 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.021070    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-efc023-j468f"]
Sep 11 13:10:16.023444 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.023419    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:16.036827 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.036809    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-efc023-6fc5d8d55-czdpz"
Sep 11 13:10:16.039800 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.039781    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-efc023-6f7c7cbf74-sj2tq"
Sep 11 13:10:16.111407 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.111381    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/734dcbc0-f33c-4642-bc11-10ff7ee2263e-plugins-config-volume\") pod \"734dcbc0-f33c-4642-bc11-10ff7ee2263e\" (UID: \"734dcbc0-f33c-4642-bc11-10ff7ee2263e\") "
Sep 11 13:10:16.111579 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.111421    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qctfj\" (UniqueName: \"kubernetes.io/projected/734dcbc0-f33c-4642-bc11-10ff7ee2263e-kube-api-access-qctfj\") pod \"734dcbc0-f33c-4642-bc11-10ff7ee2263e\" (UID: \"734dcbc0-f33c-4642-bc11-10ff7ee2263e\") "
Sep 11 13:10:16.111579 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.111548    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ln8ff\" (UniqueName: \"kubernetes.io/projected/4a68873e-e353-4e12-a1ed-de00392af57a-kube-api-access-ln8ff\") pod \"4a68873e-e353-4e12-a1ed-de00392af57a\" (UID: \"4a68873e-e353-4e12-a1ed-de00392af57a\") "
Sep 11 13:10:16.111732 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.111586    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a68873e-e353-4e12-a1ed-de00392af57a-plugins-config-volume\") pod \"4a68873e-e353-4e12-a1ed-de00392af57a\" (UID: \"4a68873e-e353-4e12-a1ed-de00392af57a\") "
Sep 11 13:10:16.111819 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.111795    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/734dcbc0-f33c-4642-bc11-10ff7ee2263e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "734dcbc0-f33c-4642-bc11-10ff7ee2263e" (UID: "734dcbc0-f33c-4642-bc11-10ff7ee2263e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:10:16.111970 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.111954    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/734dcbc0-f33c-4642-bc11-10ff7ee2263e-plugins-config-volume\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:10:16.112050 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.112024    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a68873e-e353-4e12-a1ed-de00392af57a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4a68873e-e353-4e12-a1ed-de00392af57a" (UID: "4a68873e-e353-4e12-a1ed-de00392af57a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:10:16.113926 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.113898    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/734dcbc0-f33c-4642-bc11-10ff7ee2263e-kube-api-access-qctfj" (OuterVolumeSpecName: "kube-api-access-qctfj") pod "734dcbc0-f33c-4642-bc11-10ff7ee2263e" (UID: "734dcbc0-f33c-4642-bc11-10ff7ee2263e"). InnerVolumeSpecName "kube-api-access-qctfj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:10:16.114042 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.113932    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a68873e-e353-4e12-a1ed-de00392af57a-kube-api-access-ln8ff" (OuterVolumeSpecName: "kube-api-access-ln8ff") pod "4a68873e-e353-4e12-a1ed-de00392af57a" (UID: "4a68873e-e353-4e12-a1ed-de00392af57a"). InnerVolumeSpecName "kube-api-access-ln8ff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:10:16.212613 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.212539    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ln8ff\" (UniqueName: \"kubernetes.io/projected/4a68873e-e353-4e12-a1ed-de00392af57a-kube-api-access-ln8ff\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:10:16.212613 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.212562    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a68873e-e353-4e12-a1ed-de00392af57a-plugins-config-volume\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:10:16.212613 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.212575    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qctfj\" (UniqueName: \"kubernetes.io/projected/734dcbc0-f33c-4642-bc11-10ff7ee2263e-kube-api-access-qctfj\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:10:16.266209 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.266180    2547 generic.go:356] "Generic (PLEG): container finished" podID="4a68873e-e353-4e12-a1ed-de00392af57a" containerID="75570675b2dd06dcff5a61ab9265e94a504905723a79e5a114d52389ae8146fd" exitCode=0
Sep 11 13:10:16.266385 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.266237    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-efc023-6fc5d8d55-czdpz"
Sep 11 13:10:16.266385 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.266267    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-efc023-6fc5d8d55-czdpz" event={"ID":"4a68873e-e353-4e12-a1ed-de00392af57a","Type":"ContainerDied","Data":"75570675b2dd06dcff5a61ab9265e94a504905723a79e5a114d52389ae8146fd"}
Sep 11 13:10:16.266385 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.266309    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-efc023-6fc5d8d55-czdpz" event={"ID":"4a68873e-e353-4e12-a1ed-de00392af57a","Type":"ContainerDied","Data":"997381298df156f8aea5fed59664fe82fc2bdcb53316c0e81b076ef5a4d5347f"}
Sep 11 13:10:16.266385 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.266335    2547 scope.go:117] "RemoveContainer" containerID="75570675b2dd06dcff5a61ab9265e94a504905723a79e5a114d52389ae8146fd"
Sep 11 13:10:16.267697 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.267674    2547 generic.go:356] "Generic (PLEG): container finished" podID="734dcbc0-f33c-4642-bc11-10ff7ee2263e" containerID="29d083af0ce98588a61364ce619881c22c61323652c6e1231d06bbf68bbcd375" exitCode=0
Sep 11 13:10:16.267830 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.267739    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-efc023-6f7c7cbf74-sj2tq"
Sep 11 13:10:16.267830 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.267755    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-efc023-6f7c7cbf74-sj2tq" event={"ID":"734dcbc0-f33c-4642-bc11-10ff7ee2263e","Type":"ContainerDied","Data":"29d083af0ce98588a61364ce619881c22c61323652c6e1231d06bbf68bbcd375"}
Sep 11 13:10:16.267830 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.267795    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-efc023-6f7c7cbf74-sj2tq" event={"ID":"734dcbc0-f33c-4642-bc11-10ff7ee2263e","Type":"ContainerDied","Data":"003af0571600076fa5768b09b6e10f0e5940fd7dd62fdfc84a01f02fe91badb5"}
Sep 11 13:10:16.277521 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.277505    2547 scope.go:117] "RemoveContainer" containerID="75570675b2dd06dcff5a61ab9265e94a504905723a79e5a114d52389ae8146fd"
Sep 11 13:10:16.277896 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:10:16.277878    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75570675b2dd06dcff5a61ab9265e94a504905723a79e5a114d52389ae8146fd\": container with ID starting with 75570675b2dd06dcff5a61ab9265e94a504905723a79e5a114d52389ae8146fd not found: ID does not exist" containerID="75570675b2dd06dcff5a61ab9265e94a504905723a79e5a114d52389ae8146fd"
Sep 11 13:10:16.277976 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.277907    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75570675b2dd06dcff5a61ab9265e94a504905723a79e5a114d52389ae8146fd"} err="failed to get container status \"75570675b2dd06dcff5a61ab9265e94a504905723a79e5a114d52389ae8146fd\": rpc error: code = NotFound desc = could not find container \"75570675b2dd06dcff5a61ab9265e94a504905723a79e5a114d52389ae8146fd\": container with ID starting with 75570675b2dd06dcff5a61ab9265e94a504905723a79e5a114d52389ae8146fd not found: ID does not exist"
Sep 11 13:10:16.277976 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.277929    2547 scope.go:117] "RemoveContainer" containerID="29d083af0ce98588a61364ce619881c22c61323652c6e1231d06bbf68bbcd375"
Sep 11 13:10:16.286780 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.286764    2547 scope.go:117] "RemoveContainer" containerID="29d083af0ce98588a61364ce619881c22c61323652c6e1231d06bbf68bbcd375"
Sep 11 13:10:16.287020 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:10:16.287004    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29d083af0ce98588a61364ce619881c22c61323652c6e1231d06bbf68bbcd375\": container with ID starting with 29d083af0ce98588a61364ce619881c22c61323652c6e1231d06bbf68bbcd375 not found: ID does not exist" containerID="29d083af0ce98588a61364ce619881c22c61323652c6e1231d06bbf68bbcd375"
Sep 11 13:10:16.287065 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.287026    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29d083af0ce98588a61364ce619881c22c61323652c6e1231d06bbf68bbcd375"} err="failed to get container status \"29d083af0ce98588a61364ce619881c22c61323652c6e1231d06bbf68bbcd375\": rpc error: code = NotFound desc = could not find container \"29d083af0ce98588a61364ce619881c22c61323652c6e1231d06bbf68bbcd375\": container with ID starting with 29d083af0ce98588a61364ce619881c22c61323652c6e1231d06bbf68bbcd375 not found: ID does not exist"
Sep 11 13:10:16.321189 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.321161    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-efc023-6fc5d8d55-czdpz"]
Sep 11 13:10:16.366238 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.366205    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-efc023-6fc5d8d55-czdpz"]
Sep 11 13:10:16.429512 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.429479    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-efc023-6f7c7cbf74-sj2tq"]
Sep 11 13:10:16.440916 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.440882    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-efc023-6f7c7cbf74-sj2tq"]
Sep 11 13:10:16.512156 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:16.512078    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:17.651789 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.651756    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"]
Sep 11 13:10:17.652187 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.652112    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="734dcbc0-f33c-4642-bc11-10ff7ee2263e" containerName="payload-pre-processing"
Sep 11 13:10:17.652187 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.652124    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="734dcbc0-f33c-4642-bc11-10ff7ee2263e" containerName="payload-pre-processing"
Sep 11 13:10:17.652187 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.652155    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7483f299-c78b-4b13-b0f4-31e61ec80c40" containerName="revoke-keys"
Sep 11 13:10:17.652187 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.652161    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="7483f299-c78b-4b13-b0f4-31e61ec80c40" containerName="revoke-keys"
Sep 11 13:10:17.652187 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.652172    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a68873e-e353-4e12-a1ed-de00392af57a" containerName="payload-processing"
Sep 11 13:10:17.652187 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.652178    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a68873e-e353-4e12-a1ed-de00392af57a" containerName="payload-processing"
Sep 11 13:10:17.652375 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.652236    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="7483f299-c78b-4b13-b0f4-31e61ec80c40" containerName="revoke-keys"
Sep 11 13:10:17.652375 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.652243    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a68873e-e353-4e12-a1ed-de00392af57a" containerName="payload-processing"
Sep 11 13:10:17.652375 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.652251    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="734dcbc0-f33c-4642-bc11-10ff7ee2263e" containerName="payload-pre-processing"
Sep 11 13:10:17.656598 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.656576    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"
Sep 11 13:10:17.660519 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:10:17.660443    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz\" is forbidden: User \"system:node:ip-10-0-133-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"llm\": no relationship found between node 'ip-10-0-133-79.ec2.internal' and this object" podUID="e696adaf-bb78-4a22-adf1-7dfa7c11c252" pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"
Sep 11 13:10:17.661580 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.661548    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-b-ae83ed5e-kserve-self-signed-certs\""
Sep 11 13:10:17.664044 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.664022    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a68873e-e353-4e12-a1ed-de00392af57a" path="/var/lib/kubelet/pods/4a68873e-e353-4e12-a1ed-de00392af57a/volumes"
Sep 11 13:10:17.664364 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.664351    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="668c4114-8b24-469f-b10e-5434526304fb" path="/var/lib/kubelet/pods/668c4114-8b24-469f-b10e-5434526304fb/volumes"
Sep 11 13:10:17.664656 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.664645    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="734dcbc0-f33c-4642-bc11-10ff7ee2263e" path="/var/lib/kubelet/pods/734dcbc0-f33c-4642-bc11-10ff7ee2263e/volumes"
Sep 11 13:10:17.686038 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.686006    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"]
Sep 11 13:10:17.726017 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.725975    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e696adaf-bb78-4a22-adf1-7dfa7c11c252-dshm\") pod \"e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz\" (UID: \"e696adaf-bb78-4a22-adf1-7dfa7c11c252\") " pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"
Sep 11 13:10:17.726173 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.726051    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e696adaf-bb78-4a22-adf1-7dfa7c11c252-tmp-dir\") pod \"e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz\" (UID: \"e696adaf-bb78-4a22-adf1-7dfa7c11c252\") " pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"
Sep 11 13:10:17.726173 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.726080    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e696adaf-bb78-4a22-adf1-7dfa7c11c252-tls-certs\") pod \"e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz\" (UID: \"e696adaf-bb78-4a22-adf1-7dfa7c11c252\") " pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"
Sep 11 13:10:17.726302 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.726200    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e696adaf-bb78-4a22-adf1-7dfa7c11c252-model-cache\") pod \"e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz\" (UID: \"e696adaf-bb78-4a22-adf1-7dfa7c11c252\") " pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"
Sep 11 13:10:17.726302 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.726243    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx5pr\" (UniqueName: \"kubernetes.io/projected/e696adaf-bb78-4a22-adf1-7dfa7c11c252-kube-api-access-mx5pr\") pod \"e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz\" (UID: \"e696adaf-bb78-4a22-adf1-7dfa7c11c252\") " pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"
Sep 11 13:10:17.726406 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.726312    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e696adaf-bb78-4a22-adf1-7dfa7c11c252-home\") pod \"e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz\" (UID: \"e696adaf-bb78-4a22-adf1-7dfa7c11c252\") " pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"
Sep 11 13:10:17.827679 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.827642    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e696adaf-bb78-4a22-adf1-7dfa7c11c252-dshm\") pod \"e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz\" (UID: \"e696adaf-bb78-4a22-adf1-7dfa7c11c252\") " pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"
Sep 11 13:10:17.827933 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.827701    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e696adaf-bb78-4a22-adf1-7dfa7c11c252-tmp-dir\") pod \"e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz\" (UID: \"e696adaf-bb78-4a22-adf1-7dfa7c11c252\") " pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"
Sep 11 13:10:17.827933 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.827747    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e696adaf-bb78-4a22-adf1-7dfa7c11c252-tls-certs\") pod \"e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz\" (UID: \"e696adaf-bb78-4a22-adf1-7dfa7c11c252\") " pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"
Sep 11 13:10:17.827933 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.827783    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e696adaf-bb78-4a22-adf1-7dfa7c11c252-model-cache\") pod \"e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz\" (UID: \"e696adaf-bb78-4a22-adf1-7dfa7c11c252\") " pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"
Sep 11 13:10:17.827933 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.827802    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx5pr\" (UniqueName: \"kubernetes.io/projected/e696adaf-bb78-4a22-adf1-7dfa7c11c252-kube-api-access-mx5pr\") pod \"e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz\" (UID: \"e696adaf-bb78-4a22-adf1-7dfa7c11c252\") " pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"
Sep 11 13:10:17.827933 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.827826    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e696adaf-bb78-4a22-adf1-7dfa7c11c252-home\") pod \"e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz\" (UID: \"e696adaf-bb78-4a22-adf1-7dfa7c11c252\") " pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"
Sep 11 13:10:17.828231 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.828208    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e696adaf-bb78-4a22-adf1-7dfa7c11c252-home\") pod \"e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz\" (UID: \"e696adaf-bb78-4a22-adf1-7dfa7c11c252\") " pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"
Sep 11 13:10:17.828295 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.828242    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e696adaf-bb78-4a22-adf1-7dfa7c11c252-tmp-dir\") pod \"e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz\" (UID: \"e696adaf-bb78-4a22-adf1-7dfa7c11c252\") " pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"
Sep 11 13:10:17.828295 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.828273    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e696adaf-bb78-4a22-adf1-7dfa7c11c252-model-cache\") pod \"e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz\" (UID: \"e696adaf-bb78-4a22-adf1-7dfa7c11c252\") " pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"
Sep 11 13:10:17.830283 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.830258    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e696adaf-bb78-4a22-adf1-7dfa7c11c252-dshm\") pod \"e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz\" (UID: \"e696adaf-bb78-4a22-adf1-7dfa7c11c252\") " pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"
Sep 11 13:10:17.830452 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.830437    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e696adaf-bb78-4a22-adf1-7dfa7c11c252-tls-certs\") pod \"e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz\" (UID: \"e696adaf-bb78-4a22-adf1-7dfa7c11c252\") " pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"
Sep 11 13:10:17.855768 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.855732    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx5pr\" (UniqueName: \"kubernetes.io/projected/e696adaf-bb78-4a22-adf1-7dfa7c11c252-kube-api-access-mx5pr\") pod \"e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz\" (UID: \"e696adaf-bb78-4a22-adf1-7dfa7c11c252\") " pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"
Sep 11 13:10:17.859415 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.859383    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:17.974735 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.974625    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:17.990432 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:17.990387    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"
Sep 11 13:10:18.292247 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:18.291936    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"]
Sep 11 13:10:19.201346 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:19.201309    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:19.292822 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:19.292785    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz" event={"ID":"e696adaf-bb78-4a22-adf1-7dfa7c11c252","Type":"ContainerStarted","Data":"e6d6a2d29c904281448e7dd6f6fc5a2555df56354ce14aa613eae31ea086550e"}
Sep 11 13:10:19.293003 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:19.292833    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz" event={"ID":"e696adaf-bb78-4a22-adf1-7dfa7c11c252","Type":"ContainerStarted","Data":"35525a248bad972da6c4b79df94514430d7d73aefee7ea52043e868799f0b8b4"}
Sep 11 13:10:19.327529 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:19.327462    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz" podStartSLOduration=2.327444658 podStartE2EDuration="2.327444658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:10:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:10:19.32726077 +0000 UTC m=+886.188734960" watchObservedRunningTime="2026-09-11 13:10:19.327444658 +0000 UTC m=+886.188918845"
Sep 11 13:10:20.283679 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:20.283639    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:21.413329 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:21.413290    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"]
Sep 11 13:10:21.505618 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:21.505577    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:22.054484 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:22.054448    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:22.987560 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:22.987530    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:23.099259 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:23.099219    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:23.231013 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:23.230979    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:23.352390 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:23.352354    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-48769560-kt7xk"]
Sep 11 13:10:23.354821 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:23.354796    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:23.363691 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:23.363666    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-48769560-kt7xk"]
Sep 11 13:10:23.455866 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:23.455825    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:23.664545 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:23.664462    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7483f299-c78b-4b13-b0f4-31e61ec80c40" path="/var/lib/kubelet/pods/7483f299-c78b-4b13-b0f4-31e61ec80c40/volumes"
Sep 11 13:10:23.843585 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:23.843545    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:24.621290 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:24.621194    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:25.032494 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:25.032402    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:25.142600 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:25.142562    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:25.421194 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:25.421157    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:25.857552 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:25.857519    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:26.008884 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:26.008843    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:27.991381 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:27.991340    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"
Sep 11 13:10:27.991871 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:27.991397    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"
Sep 11 13:10:28.004259 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:28.004229    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"
Sep 11 13:10:28.354924 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:28.354892    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"
Sep 11 13:10:29.824598 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:29.824558    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:30.470783 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:30.470749    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:30.643054 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:30.643009    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:31.217008 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:31.214600    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:32.203256 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:32.203218    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:33.436655 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:33.436620    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:33.548415 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:33.548386    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:33.650916 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:33.650886    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-b7gsm_b22738d7-e796-4173-8fb4-80f9208b99dd/console-operator/2.log"
Sep 11 13:10:33.651480 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:33.651456    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-b7gsm_b22738d7-e796-4173-8fb4-80f9208b99dd/console-operator/2.log"
Sep 11 13:10:33.912984 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:33.912942    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:34.446630 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:34.446595    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:34.616643 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:34.616609    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:34.809370 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:34.809338    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a30ab725-5b8d567b46-czr6z"]
Sep 11 13:10:34.814043 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:34.814025    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-a30ab725-5b8d567b46-czr6z"
Sep 11 13:10:34.817246 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:34.817220    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-a30ab725\""
Sep 11 13:10:34.817366 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:34.817284    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-a30ab725-dockercfg-dxqz6\""
Sep 11 13:10:34.838535 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:34.838509    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a30ab725-5b8d567b46-czr6z"]
Sep 11 13:10:34.999503 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:34.999467    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29v4b\" (UniqueName: \"kubernetes.io/projected/13a39e0a-868d-42b3-b63a-141bb9a7dc81-kube-api-access-29v4b\") pod \"payload-pre-processing-e2e-derive-a30ab725-5b8d567b46-czr6z\" (UID: \"13a39e0a-868d-42b3-b63a-141bb9a7dc81\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a30ab725-5b8d567b46-czr6z"
Sep 11 13:10:34.999696 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:34.999594    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13a39e0a-868d-42b3-b63a-141bb9a7dc81-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-a30ab725-5b8d567b46-czr6z\" (UID: \"13a39e0a-868d-42b3-b63a-141bb9a7dc81\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a30ab725-5b8d567b46-czr6z"
Sep 11 13:10:35.100204 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:35.100115    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29v4b\" (UniqueName: \"kubernetes.io/projected/13a39e0a-868d-42b3-b63a-141bb9a7dc81-kube-api-access-29v4b\") pod \"payload-pre-processing-e2e-derive-a30ab725-5b8d567b46-czr6z\" (UID: \"13a39e0a-868d-42b3-b63a-141bb9a7dc81\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a30ab725-5b8d567b46-czr6z"
Sep 11 13:10:35.100371 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:35.100234    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13a39e0a-868d-42b3-b63a-141bb9a7dc81-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-a30ab725-5b8d567b46-czr6z\" (UID: \"13a39e0a-868d-42b3-b63a-141bb9a7dc81\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a30ab725-5b8d567b46-czr6z"
Sep 11 13:10:35.100901 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:35.100881    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13a39e0a-868d-42b3-b63a-141bb9a7dc81-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-a30ab725-5b8d567b46-czr6z\" (UID: \"13a39e0a-868d-42b3-b63a-141bb9a7dc81\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a30ab725-5b8d567b46-czr6z"
Sep 11 13:10:35.110203 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:35.110179    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29v4b\" (UniqueName: \"kubernetes.io/projected/13a39e0a-868d-42b3-b63a-141bb9a7dc81-kube-api-access-29v4b\") pod \"payload-pre-processing-e2e-derive-a30ab725-5b8d567b46-czr6z\" (UID: \"13a39e0a-868d-42b3-b63a-141bb9a7dc81\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a30ab725-5b8d567b46-czr6z"
Sep 11 13:10:35.124849 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:35.124824    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-a30ab725-5b8d567b46-czr6z"
Sep 11 13:10:35.421871 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:35.421850    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a30ab725-5b8d567b46-czr6z"]
Sep 11 13:10:35.423978 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:10:35.423950    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13a39e0a_868d_42b3_b63a_141bb9a7dc81.slice/crio-8e0158d35af0ef25cc18b41cda7dc25a756569e29b56b1e772973d0296eb4ac8 WatchSource:0}: Error finding container 8e0158d35af0ef25cc18b41cda7dc25a756569e29b56b1e772973d0296eb4ac8: Status 404 returned error can't find the container with id 8e0158d35af0ef25cc18b41cda7dc25a756569e29b56b1e772973d0296eb4ac8
Sep 11 13:10:36.389099 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:36.388993    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-a30ab725-5b8d567b46-czr6z" event={"ID":"13a39e0a-868d-42b3-b63a-141bb9a7dc81","Type":"ContainerStarted","Data":"d982b65735230d274353150d2d6a0c06784eb0a24e4cf813449816b3447913c4"}
Sep 11 13:10:36.389099 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:36.389054    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-a30ab725-5b8d567b46-czr6z" event={"ID":"13a39e0a-868d-42b3-b63a-141bb9a7dc81","Type":"ContainerStarted","Data":"8e0158d35af0ef25cc18b41cda7dc25a756569e29b56b1e772973d0296eb4ac8"}
Sep 11 13:10:36.389099 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:36.389093    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-a30ab725-5b8d567b46-czr6z"
Sep 11 13:10:36.433522 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:36.433492    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9" podUID="5e76a306-b456-4c9b-ab29-7bf6f66a4365" containerName="main" containerID="cri-o://594d0360101ce78e9664ab03fedf38ad4234041411fe0a534929693a0c21b2e4" gracePeriod=45
Sep 11 13:10:36.434511 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:36.434469    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-a30ab725-5b8d567b46-czr6z" podStartSLOduration=2.434451632 podStartE2EDuration="2.434451632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:10:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:10:36.434304948 +0000 UTC m=+903.295779138" watchObservedRunningTime="2026-09-11 13:10:36.434451632 +0000 UTC m=+903.295925820"
Sep 11 13:10:36.682837 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:36.682815    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"
Sep 11 13:10:36.713555 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:36.713529    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e76a306-b456-4c9b-ab29-7bf6f66a4365-dshm\") pod \"5e76a306-b456-4c9b-ab29-7bf6f66a4365\" (UID: \"5e76a306-b456-4c9b-ab29-7bf6f66a4365\") "
Sep 11 13:10:36.713696 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:36.713561    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e76a306-b456-4c9b-ab29-7bf6f66a4365-model-cache\") pod \"5e76a306-b456-4c9b-ab29-7bf6f66a4365\" (UID: \"5e76a306-b456-4c9b-ab29-7bf6f66a4365\") "
Sep 11 13:10:36.713696 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:36.713604    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e76a306-b456-4c9b-ab29-7bf6f66a4365-home\") pod \"5e76a306-b456-4c9b-ab29-7bf6f66a4365\" (UID: \"5e76a306-b456-4c9b-ab29-7bf6f66a4365\") "
Sep 11 13:10:36.713696 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:36.713638    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e76a306-b456-4c9b-ab29-7bf6f66a4365-tmp-dir\") pod \"5e76a306-b456-4c9b-ab29-7bf6f66a4365\" (UID: \"5e76a306-b456-4c9b-ab29-7bf6f66a4365\") "
Sep 11 13:10:36.713696 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:36.713695    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e76a306-b456-4c9b-ab29-7bf6f66a4365-tls-certs\") pod \"5e76a306-b456-4c9b-ab29-7bf6f66a4365\" (UID: \"5e76a306-b456-4c9b-ab29-7bf6f66a4365\") "
Sep 11 13:10:36.713941 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:36.713774    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jg7sx\" (UniqueName: \"kubernetes.io/projected/5e76a306-b456-4c9b-ab29-7bf6f66a4365-kube-api-access-jg7sx\") pod \"5e76a306-b456-4c9b-ab29-7bf6f66a4365\" (UID: \"5e76a306-b456-4c9b-ab29-7bf6f66a4365\") "
Sep 11 13:10:36.713941 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:36.713901    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e76a306-b456-4c9b-ab29-7bf6f66a4365-model-cache" (OuterVolumeSpecName: "model-cache") pod "5e76a306-b456-4c9b-ab29-7bf6f66a4365" (UID: "5e76a306-b456-4c9b-ab29-7bf6f66a4365"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:10:36.713941 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:36.713922    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e76a306-b456-4c9b-ab29-7bf6f66a4365-home" (OuterVolumeSpecName: "home") pod "5e76a306-b456-4c9b-ab29-7bf6f66a4365" (UID: "5e76a306-b456-4c9b-ab29-7bf6f66a4365"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:10:36.714064 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:36.713936    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e76a306-b456-4c9b-ab29-7bf6f66a4365-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5e76a306-b456-4c9b-ab29-7bf6f66a4365" (UID: "5e76a306-b456-4c9b-ab29-7bf6f66a4365"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:10:36.714184 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:36.714165    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e76a306-b456-4c9b-ab29-7bf6f66a4365-model-cache\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:10:36.714245 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:36.714190    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e76a306-b456-4c9b-ab29-7bf6f66a4365-home\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:10:36.714245 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:36.714204    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e76a306-b456-4c9b-ab29-7bf6f66a4365-tmp-dir\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:10:36.716157 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:36.716111    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e76a306-b456-4c9b-ab29-7bf6f66a4365-kube-api-access-jg7sx" (OuterVolumeSpecName: "kube-api-access-jg7sx") pod "5e76a306-b456-4c9b-ab29-7bf6f66a4365" (UID: "5e76a306-b456-4c9b-ab29-7bf6f66a4365"). InnerVolumeSpecName "kube-api-access-jg7sx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:10:36.716263 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:36.716165    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e76a306-b456-4c9b-ab29-7bf6f66a4365-dshm" (OuterVolumeSpecName: "dshm") pod "5e76a306-b456-4c9b-ab29-7bf6f66a4365" (UID: "5e76a306-b456-4c9b-ab29-7bf6f66a4365"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:10:36.716263 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:36.716166    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e76a306-b456-4c9b-ab29-7bf6f66a4365-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5e76a306-b456-4c9b-ab29-7bf6f66a4365" (UID: "5e76a306-b456-4c9b-ab29-7bf6f66a4365"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:10:36.814902 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:36.814872    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e76a306-b456-4c9b-ab29-7bf6f66a4365-tls-certs\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:10:36.814902 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:36.814908    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jg7sx\" (UniqueName: \"kubernetes.io/projected/5e76a306-b456-4c9b-ab29-7bf6f66a4365-kube-api-access-jg7sx\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:10:36.815082 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:36.814917    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e76a306-b456-4c9b-ab29-7bf6f66a4365-dshm\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:10:37.396215 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:37.396184    2547 generic.go:356] "Generic (PLEG): container finished" podID="5e76a306-b456-4c9b-ab29-7bf6f66a4365" containerID="594d0360101ce78e9664ab03fedf38ad4234041411fe0a534929693a0c21b2e4" exitCode=0
Sep 11 13:10:37.396684 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:37.396231    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"
Sep 11 13:10:37.396684 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:37.396275    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9" event={"ID":"5e76a306-b456-4c9b-ab29-7bf6f66a4365","Type":"ContainerDied","Data":"594d0360101ce78e9664ab03fedf38ad4234041411fe0a534929693a0c21b2e4"}
Sep 11 13:10:37.396684 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:37.396322    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9" event={"ID":"5e76a306-b456-4c9b-ab29-7bf6f66a4365","Type":"ContainerDied","Data":"603cf27638feef9e622cbffe4bb65942efb2f2f03391787c2c6a813cc3562eec"}
Sep 11 13:10:37.396684 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:37.396348    2547 scope.go:117] "RemoveContainer" containerID="594d0360101ce78e9664ab03fedf38ad4234041411fe0a534929693a0c21b2e4"
Sep 11 13:10:37.406459 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:37.406442    2547 scope.go:117] "RemoveContainer" containerID="594d0360101ce78e9664ab03fedf38ad4234041411fe0a534929693a0c21b2e4"
Sep 11 13:10:37.406771 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:10:37.406752    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"594d0360101ce78e9664ab03fedf38ad4234041411fe0a534929693a0c21b2e4\": container with ID starting with 594d0360101ce78e9664ab03fedf38ad4234041411fe0a534929693a0c21b2e4 not found: ID does not exist" containerID="594d0360101ce78e9664ab03fedf38ad4234041411fe0a534929693a0c21b2e4"
Sep 11 13:10:37.406843 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:37.406779    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"594d0360101ce78e9664ab03fedf38ad4234041411fe0a534929693a0c21b2e4"} err="failed to get container status \"594d0360101ce78e9664ab03fedf38ad4234041411fe0a534929693a0c21b2e4\": rpc error: code = NotFound desc = could not find container \"594d0360101ce78e9664ab03fedf38ad4234041411fe0a534929693a0c21b2e4\": container with ID starting with 594d0360101ce78e9664ab03fedf38ad4234041411fe0a534929693a0c21b2e4 not found: ID does not exist"
Sep 11 13:10:37.419616 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:37.419592    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"]
Sep 11 13:10:37.425170 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:37.425147    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-efc023/autores-model-efc023-kserve-584d5ddf75-z49b9"]
Sep 11 13:10:37.664163 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:37.664077    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e76a306-b456-4c9b-ab29-7bf6f66a4365" path="/var/lib/kubelet/pods/5e76a306-b456-4c9b-ab29-7bf6f66a4365/volumes"
Sep 11 13:10:39.614618 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:39.614573    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:47.398498 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:47.398467    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-a30ab725-5b8d567b46-czr6z"
Sep 11 13:10:55.327601 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:55.327558    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:57.183437 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:57.183401    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:58.218299 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:58.218262    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:59.403469 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:10:59.403428    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:00.240971 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:00.240932    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:00.398674 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:00.398635    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a30ab725-bczrt"]
Sep 11 13:11:00.399078 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:00.399065    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e76a306-b456-4c9b-ab29-7bf6f66a4365" containerName="main"
Sep 11 13:11:00.399125 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:00.399080    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e76a306-b456-4c9b-ab29-7bf6f66a4365" containerName="main"
Sep 11 13:11:00.399164 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:00.399139    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e76a306-b456-4c9b-ab29-7bf6f66a4365" containerName="main"
Sep 11 13:11:00.402215 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:00.402196    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a30ab725-bczrt"
Sep 11 13:11:00.406281 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:00.406259    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:11:00.406593 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:00.406283    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kt2vz\""
Sep 11 13:11:00.411627 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:00.411592    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:00.412834 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:00.412807    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a30ab725-bczrt"]
Sep 11 13:11:00.527370 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:00.527266    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:00.529644 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:00.529613    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d45b3a04-65df-463d-813f-cb5de60f287d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a30ab725-bczrt\" (UID: \"d45b3a04-65df-463d-813f-cb5de60f287d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a30ab725-bczrt"
Sep 11 13:11:00.630892 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:00.630850    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d45b3a04-65df-463d-813f-cb5de60f287d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a30ab725-bczrt\" (UID: \"d45b3a04-65df-463d-813f-cb5de60f287d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a30ab725-bczrt"
Sep 11 13:11:00.631501 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:00.631479    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d45b3a04-65df-463d-813f-cb5de60f287d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a30ab725-bczrt\" (UID: \"d45b3a04-65df-463d-813f-cb5de60f287d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a30ab725-bczrt"
Sep 11 13:11:00.714526 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:00.714486    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a30ab725-bczrt"
Sep 11 13:11:00.925907 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:00.925866    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:01.006075 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:01.006040    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a30ab725-bczrt"]
Sep 11 13:11:01.006306 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:11:01.006277    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd45b3a04_65df_463d_813f_cb5de60f287d.slice/crio-6d20f47fea58a7fac84e9e356c595a48be29053bf8473a4e70c550acd5691b49 WatchSource:0}: Error finding container 6d20f47fea58a7fac84e9e356c595a48be29053bf8473a4e70c550acd5691b49: Status 404 returned error can't find the container with id 6d20f47fea58a7fac84e9e356c595a48be29053bf8473a4e70c550acd5691b49
Sep 11 13:11:01.354860 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:01.354804    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:01.542598 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:01.542502    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a30ab725-bczrt" event={"ID":"d45b3a04-65df-463d-813f-cb5de60f287d","Type":"ContainerStarted","Data":"e6c9f4b6a074600d98f27ffe87e98468063ceff5ae4085457b241688619130d3"}
Sep 11 13:11:01.542991 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:01.542608    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a30ab725-bczrt" event={"ID":"d45b3a04-65df-463d-813f-cb5de60f287d","Type":"ContainerStarted","Data":"6d20f47fea58a7fac84e9e356c595a48be29053bf8473a4e70c550acd5691b49"}
Sep 11 13:11:01.567306 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:01.567231    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a30ab725-bczrt" podStartSLOduration=1.567205811 podStartE2EDuration="1.567205811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:11:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:11:01.561272963 +0000 UTC m=+928.422747150" watchObservedRunningTime="2026-09-11 13:11:01.567205811 +0000 UTC m=+928.428680002"
Sep 11 13:11:01.737420 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:01.737373    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:01.969807 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:01.969767    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:02.551580 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:02.551546    2547 generic.go:356] "Generic (PLEG): container finished" podID="d45b3a04-65df-463d-813f-cb5de60f287d" containerID="e6c9f4b6a074600d98f27ffe87e98468063ceff5ae4085457b241688619130d3" exitCode=0
Sep 11 13:11:02.552019 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:02.551627    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a30ab725-bczrt" event={"ID":"d45b3a04-65df-463d-813f-cb5de60f287d","Type":"ContainerDied","Data":"e6c9f4b6a074600d98f27ffe87e98468063ceff5ae4085457b241688619130d3"}
Sep 11 13:11:02.835541 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:02.835474    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:03.694630 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:03.694604    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a30ab725-bczrt"
Sep 11 13:11:03.734402 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:03.734364    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:03.760838 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:03.760806    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d45b3a04-65df-463d-813f-cb5de60f287d-maas-api-service-ca\") pod \"d45b3a04-65df-463d-813f-cb5de60f287d\" (UID: \"d45b3a04-65df-463d-813f-cb5de60f287d\") "
Sep 11 13:11:03.761180 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:03.761152    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d45b3a04-65df-463d-813f-cb5de60f287d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d45b3a04-65df-463d-813f-cb5de60f287d" (UID: "d45b3a04-65df-463d-813f-cb5de60f287d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:11:03.862295 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:03.862212    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d45b3a04-65df-463d-813f-cb5de60f287d-maas-api-service-ca\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:11:04.124962 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:04.124873    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"]
Sep 11 13:11:04.181069 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:04.181033    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:04.571505 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:04.571464    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a30ab725-bczrt"
Sep 11 13:11:04.571705 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:04.571458    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a30ab725-bczrt" event={"ID":"d45b3a04-65df-463d-813f-cb5de60f287d","Type":"ContainerDied","Data":"6d20f47fea58a7fac84e9e356c595a48be29053bf8473a4e70c550acd5691b49"}
Sep 11 13:11:04.571705 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:04.571629    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d20f47fea58a7fac84e9e356c595a48be29053bf8473a4e70c550acd5691b49"
Sep 11 13:11:04.634976 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:04.634938    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"]
Sep 11 13:11:04.674275 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:04.674236    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:05.134335 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:05.134300    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:05.235147 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:05.235108    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:06.388589 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:06.388555    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:07.259178 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:07.259143    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:08.285590 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:08.285549    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:09.176932 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:09.176890    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:09.277146 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:09.277112    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:09.376101 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:09.376065    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:09.718899 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:09.718851    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:09.821809 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:09.821764    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:09.860805 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:09.860770    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-ecc2b9-6686fd7485-lkk9q"]
Sep 11 13:11:09.861304 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:09.861288    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d45b3a04-65df-463d-813f-cb5de60f287d" containerName="revoke-keys"
Sep 11 13:11:09.861371 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:09.861307    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d45b3a04-65df-463d-813f-cb5de60f287d" containerName="revoke-keys"
Sep 11 13:11:09.861408 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:09.861383    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="d45b3a04-65df-463d-813f-cb5de60f287d" containerName="revoke-keys"
Sep 11 13:11:09.864706 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:09.864687    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-ecc2b9-6686fd7485-lkk9q"
Sep 11 13:11:09.867836 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:09.867813    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-ecc2b9-dockercfg-x7lrr\""
Sep 11 13:11:09.868306 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:09.868286    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-ecc2b9\""
Sep 11 13:11:09.886820 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:09.886788    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-ecc2b9-6686fd7485-lkk9q"]
Sep 11 13:11:09.918690 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:09.918650    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-ecc2b9-6746b55d46-4l2vk"]
Sep 11 13:11:09.922288 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:09.922268    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ecc2b9-6746b55d46-4l2vk"
Sep 11 13:11:09.938810 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:09.938770    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-ecc2b9-6746b55d46-4l2vk"]
Sep 11 13:11:10.022661 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:10.022566    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2br4m\" (UniqueName: \"kubernetes.io/projected/12eb7c1b-5a5a-41f2-8720-cd811424dca4-kube-api-access-2br4m\") pod \"payload-pre-processing-e2e-explicit-ecc2b9-6746b55d46-4l2vk\" (UID: \"12eb7c1b-5a5a-41f2-8720-cd811424dca4\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-ecc2b9-6746b55d46-4l2vk"
Sep 11 13:11:10.022661 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:10.022624    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80bef7da-deeb-4129-b2b6-ea170e2480c1-plugins-config-volume\") pod \"payload-processing-e2e-explicit-ecc2b9-6686fd7485-lkk9q\" (UID: \"80bef7da-deeb-4129-b2b6-ea170e2480c1\") " pod="openshift-ingress/payload-processing-e2e-explicit-ecc2b9-6686fd7485-lkk9q"
Sep 11 13:11:10.022895 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:10.022698    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12eb7c1b-5a5a-41f2-8720-cd811424dca4-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-ecc2b9-6746b55d46-4l2vk\" (UID: \"12eb7c1b-5a5a-41f2-8720-cd811424dca4\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-ecc2b9-6746b55d46-4l2vk"
Sep 11 13:11:10.022895 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:10.022785    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtd7t\" (UniqueName: \"kubernetes.io/projected/80bef7da-deeb-4129-b2b6-ea170e2480c1-kube-api-access-vtd7t\") pod \"payload-processing-e2e-explicit-ecc2b9-6686fd7485-lkk9q\" (UID: \"80bef7da-deeb-4129-b2b6-ea170e2480c1\") " pod="openshift-ingress/payload-processing-e2e-explicit-ecc2b9-6686fd7485-lkk9q"
Sep 11 13:11:10.124191 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:10.124149    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80bef7da-deeb-4129-b2b6-ea170e2480c1-plugins-config-volume\") pod \"payload-processing-e2e-explicit-ecc2b9-6686fd7485-lkk9q\" (UID: \"80bef7da-deeb-4129-b2b6-ea170e2480c1\") " pod="openshift-ingress/payload-processing-e2e-explicit-ecc2b9-6686fd7485-lkk9q"
Sep 11 13:11:10.124370 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:10.124214    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12eb7c1b-5a5a-41f2-8720-cd811424dca4-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-ecc2b9-6746b55d46-4l2vk\" (UID: \"12eb7c1b-5a5a-41f2-8720-cd811424dca4\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-ecc2b9-6746b55d46-4l2vk"
Sep 11 13:11:10.124370 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:10.124244    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtd7t\" (UniqueName: \"kubernetes.io/projected/80bef7da-deeb-4129-b2b6-ea170e2480c1-kube-api-access-vtd7t\") pod \"payload-processing-e2e-explicit-ecc2b9-6686fd7485-lkk9q\" (UID: \"80bef7da-deeb-4129-b2b6-ea170e2480c1\") " pod="openshift-ingress/payload-processing-e2e-explicit-ecc2b9-6686fd7485-lkk9q"
Sep 11 13:11:10.124370 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:10.124281    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2br4m\" (UniqueName: \"kubernetes.io/projected/12eb7c1b-5a5a-41f2-8720-cd811424dca4-kube-api-access-2br4m\") pod \"payload-pre-processing-e2e-explicit-ecc2b9-6746b55d46-4l2vk\" (UID: \"12eb7c1b-5a5a-41f2-8720-cd811424dca4\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-ecc2b9-6746b55d46-4l2vk"
Sep 11 13:11:10.125152 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:10.125128    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12eb7c1b-5a5a-41f2-8720-cd811424dca4-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-ecc2b9-6746b55d46-4l2vk\" (UID: \"12eb7c1b-5a5a-41f2-8720-cd811424dca4\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-ecc2b9-6746b55d46-4l2vk"
Sep 11 13:11:10.125210 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:10.125128    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80bef7da-deeb-4129-b2b6-ea170e2480c1-plugins-config-volume\") pod \"payload-processing-e2e-explicit-ecc2b9-6686fd7485-lkk9q\" (UID: \"80bef7da-deeb-4129-b2b6-ea170e2480c1\") " pod="openshift-ingress/payload-processing-e2e-explicit-ecc2b9-6686fd7485-lkk9q"
Sep 11 13:11:10.139122 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:10.139083    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtd7t\" (UniqueName: \"kubernetes.io/projected/80bef7da-deeb-4129-b2b6-ea170e2480c1-kube-api-access-vtd7t\") pod \"payload-processing-e2e-explicit-ecc2b9-6686fd7485-lkk9q\" (UID: \"80bef7da-deeb-4129-b2b6-ea170e2480c1\") " pod="openshift-ingress/payload-processing-e2e-explicit-ecc2b9-6686fd7485-lkk9q"
Sep 11 13:11:10.140677 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:10.140653    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2br4m\" (UniqueName: \"kubernetes.io/projected/12eb7c1b-5a5a-41f2-8720-cd811424dca4-kube-api-access-2br4m\") pod \"payload-pre-processing-e2e-explicit-ecc2b9-6746b55d46-4l2vk\" (UID: \"12eb7c1b-5a5a-41f2-8720-cd811424dca4\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-ecc2b9-6746b55d46-4l2vk"
Sep 11 13:11:10.175706 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:10.175671    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-ecc2b9-6686fd7485-lkk9q"
Sep 11 13:11:10.233202 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:10.233171    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ecc2b9-6746b55d46-4l2vk"
Sep 11 13:11:10.473496 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:10.473458    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-ecc2b9-6686fd7485-lkk9q"]
Sep 11 13:11:10.475309 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:11:10.475281    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80bef7da_deeb_4129_b2b6_ea170e2480c1.slice/crio-81f965daa848ae0bd84f4971707dfd19bd6e63fc7cc9aa84237217f32f2f7d59 WatchSource:0}: Error finding container 81f965daa848ae0bd84f4971707dfd19bd6e63fc7cc9aa84237217f32f2f7d59: Status 404 returned error can't find the container with id 81f965daa848ae0bd84f4971707dfd19bd6e63fc7cc9aa84237217f32f2f7d59
Sep 11 13:11:10.523775 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:10.523743    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-ecc2b9-6746b55d46-4l2vk"]
Sep 11 13:11:10.529127 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:11:10.529097    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12eb7c1b_5a5a_41f2_8720_cd811424dca4.slice/crio-3a7d2ff11b0e4acaa1e8b674dc468d0bf34d70433a17bef11cb5a41a425f1b63 WatchSource:0}: Error finding container 3a7d2ff11b0e4acaa1e8b674dc468d0bf34d70433a17bef11cb5a41a425f1b63: Status 404 returned error can't find the container with id 3a7d2ff11b0e4acaa1e8b674dc468d0bf34d70433a17bef11cb5a41a425f1b63
Sep 11 13:11:10.618292 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:10.618255    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ecc2b9-6746b55d46-4l2vk" event={"ID":"12eb7c1b-5a5a-41f2-8720-cd811424dca4","Type":"ContainerStarted","Data":"ff2f2feebb52dbfbc555e4992c344f879b7045023c5d72549efdf24a68a522cc"}
Sep 11 13:11:10.618479 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:10.618321    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ecc2b9-6746b55d46-4l2vk" event={"ID":"12eb7c1b-5a5a-41f2-8720-cd811424dca4","Type":"ContainerStarted","Data":"3a7d2ff11b0e4acaa1e8b674dc468d0bf34d70433a17bef11cb5a41a425f1b63"}
Sep 11 13:11:10.620229 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:10.620191    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-ecc2b9-6686fd7485-lkk9q" event={"ID":"80bef7da-deeb-4129-b2b6-ea170e2480c1","Type":"ContainerStarted","Data":"4a54af3fe2a29a8a66ee666d95044ac80851810937232fb0c8408686aa3a7f34"}
Sep 11 13:11:10.620381 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:10.620241    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-ecc2b9-6686fd7485-lkk9q" event={"ID":"80bef7da-deeb-4129-b2b6-ea170e2480c1","Type":"ContainerStarted","Data":"81f965daa848ae0bd84f4971707dfd19bd6e63fc7cc9aa84237217f32f2f7d59"}
Sep 11 13:11:10.620448 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:10.620372    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-ecc2b9-6686fd7485-lkk9q"
Sep 11 13:11:10.649234 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:10.649167    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-ecc2b9-6686fd7485-lkk9q" podStartSLOduration=1.649150637 podStartE2EDuration="1.649150637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:11:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:11:10.645372531 +0000 UTC m=+937.506846730" watchObservedRunningTime="2026-09-11 13:11:10.649150637 +0000 UTC m=+937.510624825"
Sep 11 13:11:11.647578 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:11.647520    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ecc2b9-6746b55d46-4l2vk" podStartSLOduration=2.647502893 podStartE2EDuration="2.647502893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:11:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:11:11.644379807 +0000 UTC m=+938.505854030" watchObservedRunningTime="2026-09-11 13:11:11.647502893 +0000 UTC m=+938.508977081"
Sep 11 13:11:11.802134 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:11.802100    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:12.546599 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:12.546562    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:12.601141 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:12.601105    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a30ab725-5b8d567b46-czr6z"]
Sep 11 13:11:12.601373 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:12.601350    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-a30ab725-5b8d567b46-czr6z" podUID="13a39e0a-868d-42b3-b63a-141bb9a7dc81" containerName="payload-pre-processing" containerID="cri-o://d982b65735230d274353150d2d6a0c06784eb0a24e4cf813449816b3447913c4" gracePeriod=30
Sep 11 13:11:12.633320 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:12.633293    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ecc2b9-6746b55d46-4l2vk"
Sep 11 13:11:12.656905 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:12.656873    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:12.758933 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:12.758899    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:12.821236 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:12.821204    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a30ab725-bczrt"]
Sep 11 13:11:12.826174 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:12.826150    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a30ab725-bczrt"]
Sep 11 13:11:12.849478 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:12.849443    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:12.863941 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:12.863922    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-a30ab725-5b8d567b46-czr6z"
Sep 11 13:11:13.054077 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:13.054041    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29v4b\" (UniqueName: \"kubernetes.io/projected/13a39e0a-868d-42b3-b63a-141bb9a7dc81-kube-api-access-29v4b\") pod \"13a39e0a-868d-42b3-b63a-141bb9a7dc81\" (UID: \"13a39e0a-868d-42b3-b63a-141bb9a7dc81\") "
Sep 11 13:11:13.054077 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:13.054081    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13a39e0a-868d-42b3-b63a-141bb9a7dc81-plugins-config-volume\") pod \"13a39e0a-868d-42b3-b63a-141bb9a7dc81\" (UID: \"13a39e0a-868d-42b3-b63a-141bb9a7dc81\") "
Sep 11 13:11:13.054477 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:13.054451    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13a39e0a-868d-42b3-b63a-141bb9a7dc81-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "13a39e0a-868d-42b3-b63a-141bb9a7dc81" (UID: "13a39e0a-868d-42b3-b63a-141bb9a7dc81"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:11:13.056377 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:13.056349    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13a39e0a-868d-42b3-b63a-141bb9a7dc81-kube-api-access-29v4b" (OuterVolumeSpecName: "kube-api-access-29v4b") pod "13a39e0a-868d-42b3-b63a-141bb9a7dc81" (UID: "13a39e0a-868d-42b3-b63a-141bb9a7dc81"). InnerVolumeSpecName "kube-api-access-29v4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:11:13.057396 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:13.057367    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:13.155561 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:13.155465    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29v4b\" (UniqueName: \"kubernetes.io/projected/13a39e0a-868d-42b3-b63a-141bb9a7dc81-kube-api-access-29v4b\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:11:13.155561 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:13.155502    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13a39e0a-868d-42b3-b63a-141bb9a7dc81-plugins-config-volume\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:11:13.480855 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:13.480738    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:13.640899 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:13.640860    2547 generic.go:356] "Generic (PLEG): container finished" podID="13a39e0a-868d-42b3-b63a-141bb9a7dc81" containerID="d982b65735230d274353150d2d6a0c06784eb0a24e4cf813449816b3447913c4" exitCode=0
Sep 11 13:11:13.641079 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:13.640913    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-a30ab725-5b8d567b46-czr6z"
Sep 11 13:11:13.641079 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:13.640945    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-a30ab725-5b8d567b46-czr6z" event={"ID":"13a39e0a-868d-42b3-b63a-141bb9a7dc81","Type":"ContainerDied","Data":"d982b65735230d274353150d2d6a0c06784eb0a24e4cf813449816b3447913c4"}
Sep 11 13:11:13.641079 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:13.641035    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-a30ab725-5b8d567b46-czr6z" event={"ID":"13a39e0a-868d-42b3-b63a-141bb9a7dc81","Type":"ContainerDied","Data":"8e0158d35af0ef25cc18b41cda7dc25a756569e29b56b1e772973d0296eb4ac8"}
Sep 11 13:11:13.641079 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:13.641067    2547 scope.go:117] "RemoveContainer" containerID="d982b65735230d274353150d2d6a0c06784eb0a24e4cf813449816b3447913c4"
Sep 11 13:11:13.651361 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:13.651341    2547 scope.go:117] "RemoveContainer" containerID="d982b65735230d274353150d2d6a0c06784eb0a24e4cf813449816b3447913c4"
Sep 11 13:11:13.651608 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:11:13.651590    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d982b65735230d274353150d2d6a0c06784eb0a24e4cf813449816b3447913c4\": container with ID starting with d982b65735230d274353150d2d6a0c06784eb0a24e4cf813449816b3447913c4 not found: ID does not exist" containerID="d982b65735230d274353150d2d6a0c06784eb0a24e4cf813449816b3447913c4"
Sep 11 13:11:13.651676 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:13.651615    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d982b65735230d274353150d2d6a0c06784eb0a24e4cf813449816b3447913c4"} err="failed to get container status \"d982b65735230d274353150d2d6a0c06784eb0a24e4cf813449816b3447913c4\": rpc error: code = NotFound desc = could not find container \"d982b65735230d274353150d2d6a0c06784eb0a24e4cf813449816b3447913c4\": container with ID starting with d982b65735230d274353150d2d6a0c06784eb0a24e4cf813449816b3447913c4 not found: ID does not exist"
Sep 11 13:11:13.664529 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:13.664507    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d45b3a04-65df-463d-813f-cb5de60f287d" path="/var/lib/kubelet/pods/d45b3a04-65df-463d-813f-cb5de60f287d/volumes"
Sep 11 13:11:13.696709 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:13.696679    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a30ab725-5b8d567b46-czr6z"]
Sep 11 13:11:13.700683 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:13.700653    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a30ab725-5b8d567b46-czr6z"]
Sep 11 13:11:13.749799 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:13.749697    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:13.887811 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:13.887775    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:14.667002 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:14.666967    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:15.344621 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:15.344583    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:15.664074 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:15.663994    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13a39e0a-868d-42b3-b63a-141bb9a7dc81" path="/var/lib/kubelet/pods/13a39e0a-868d-42b3-b63a-141bb9a7dc81/volumes"
Sep 11 13:11:15.798547 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:15.798515    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:17.038943 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:17.038905    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:18.228798 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:18.228760    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:18.994877 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:18.994833    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:19.144692 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.144654    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99" podUID="b00a6f1e-3c45-497e-8392-97c702209e25" containerName="main" containerID="cri-o://d19831d61dcc3caf5b222e08c2a8f1a34c2d957418ca803ddb12e81867473ffc" gracePeriod=45
Sep 11 13:11:19.400632 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.400608    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"
Sep 11 13:11:19.413469 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.413443    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzmsx\" (UniqueName: \"kubernetes.io/projected/b00a6f1e-3c45-497e-8392-97c702209e25-kube-api-access-vzmsx\") pod \"b00a6f1e-3c45-497e-8392-97c702209e25\" (UID: \"b00a6f1e-3c45-497e-8392-97c702209e25\") "
Sep 11 13:11:19.413589 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.413477    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b00a6f1e-3c45-497e-8392-97c702209e25-dshm\") pod \"b00a6f1e-3c45-497e-8392-97c702209e25\" (UID: \"b00a6f1e-3c45-497e-8392-97c702209e25\") "
Sep 11 13:11:19.413589 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.413531    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b00a6f1e-3c45-497e-8392-97c702209e25-home\") pod \"b00a6f1e-3c45-497e-8392-97c702209e25\" (UID: \"b00a6f1e-3c45-497e-8392-97c702209e25\") "
Sep 11 13:11:19.413661 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.413636    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b00a6f1e-3c45-497e-8392-97c702209e25-model-cache\") pod \"b00a6f1e-3c45-497e-8392-97c702209e25\" (UID: \"b00a6f1e-3c45-497e-8392-97c702209e25\") "
Sep 11 13:11:19.413701 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.413691    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b00a6f1e-3c45-497e-8392-97c702209e25-tls-certs\") pod \"b00a6f1e-3c45-497e-8392-97c702209e25\" (UID: \"b00a6f1e-3c45-497e-8392-97c702209e25\") "
Sep 11 13:11:19.413803 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.413734    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b00a6f1e-3c45-497e-8392-97c702209e25-home" (OuterVolumeSpecName: "home") pod "b00a6f1e-3c45-497e-8392-97c702209e25" (UID: "b00a6f1e-3c45-497e-8392-97c702209e25"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:11:19.413803 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.413784    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b00a6f1e-3c45-497e-8392-97c702209e25-tmp-dir\") pod \"b00a6f1e-3c45-497e-8392-97c702209e25\" (UID: \"b00a6f1e-3c45-497e-8392-97c702209e25\") "
Sep 11 13:11:19.413927 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.413903    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b00a6f1e-3c45-497e-8392-97c702209e25-model-cache" (OuterVolumeSpecName: "model-cache") pod "b00a6f1e-3c45-497e-8392-97c702209e25" (UID: "b00a6f1e-3c45-497e-8392-97c702209e25"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:11:19.414063 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.414038    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b00a6f1e-3c45-497e-8392-97c702209e25-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b00a6f1e-3c45-497e-8392-97c702209e25" (UID: "b00a6f1e-3c45-497e-8392-97c702209e25"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:11:19.414194 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.414180    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b00a6f1e-3c45-497e-8392-97c702209e25-home\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:11:19.414253 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.414197    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b00a6f1e-3c45-497e-8392-97c702209e25-model-cache\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:11:19.414253 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.414208    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b00a6f1e-3c45-497e-8392-97c702209e25-tmp-dir\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:11:19.416004 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.415977    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b00a6f1e-3c45-497e-8392-97c702209e25-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b00a6f1e-3c45-497e-8392-97c702209e25" (UID: "b00a6f1e-3c45-497e-8392-97c702209e25"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:11:19.416242 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.416216    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b00a6f1e-3c45-497e-8392-97c702209e25-dshm" (OuterVolumeSpecName: "dshm") pod "b00a6f1e-3c45-497e-8392-97c702209e25" (UID: "b00a6f1e-3c45-497e-8392-97c702209e25"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:11:19.416242 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.416231    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b00a6f1e-3c45-497e-8392-97c702209e25-kube-api-access-vzmsx" (OuterVolumeSpecName: "kube-api-access-vzmsx") pod "b00a6f1e-3c45-497e-8392-97c702209e25" (UID: "b00a6f1e-3c45-497e-8392-97c702209e25"). InnerVolumeSpecName "kube-api-access-vzmsx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:11:19.515373 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.515297    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b00a6f1e-3c45-497e-8392-97c702209e25-dshm\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:11:19.515373 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.515322    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b00a6f1e-3c45-497e-8392-97c702209e25-tls-certs\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:11:19.515373 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.515333    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzmsx\" (UniqueName: \"kubernetes.io/projected/b00a6f1e-3c45-497e-8392-97c702209e25-kube-api-access-vzmsx\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:11:19.655163 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.655123    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz" podUID="e696adaf-bb78-4a22-adf1-7dfa7c11c252" containerName="main" containerID="cri-o://e6d6a2d29c904281448e7dd6f6fc5a2555df56354ce14aa613eae31ea086550e" gracePeriod=45
Sep 11 13:11:19.678176 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.678154    2547 generic.go:356] "Generic (PLEG): container finished" podID="b00a6f1e-3c45-497e-8392-97c702209e25" containerID="d19831d61dcc3caf5b222e08c2a8f1a34c2d957418ca803ddb12e81867473ffc" exitCode=0
Sep 11 13:11:19.678271 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.678192    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"
Sep 11 13:11:19.678271 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.678242    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99" event={"ID":"b00a6f1e-3c45-497e-8392-97c702209e25","Type":"ContainerDied","Data":"d19831d61dcc3caf5b222e08c2a8f1a34c2d957418ca803ddb12e81867473ffc"}
Sep 11 13:11:19.678352 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.678278    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99" event={"ID":"b00a6f1e-3c45-497e-8392-97c702209e25","Type":"ContainerDied","Data":"6f2574b688fa30766470be696a3865245058c2c01ba1100a7c53b2c7375ca839"}
Sep 11 13:11:19.678352 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.678295    2547 scope.go:117] "RemoveContainer" containerID="d19831d61dcc3caf5b222e08c2a8f1a34c2d957418ca803ddb12e81867473ffc"
Sep 11 13:11:19.740260 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.740233    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"]
Sep 11 13:11:19.746690 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.746666    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-a-ae83ed5e-kserve-68754c9cd5-6bv99"]
Sep 11 13:11:19.750425 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.750398    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:19.768049 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.768030    2547 scope.go:117] "RemoveContainer" containerID="d19831d61dcc3caf5b222e08c2a8f1a34c2d957418ca803ddb12e81867473ffc"
Sep 11 13:11:19.768389 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:11:19.768365    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d19831d61dcc3caf5b222e08c2a8f1a34c2d957418ca803ddb12e81867473ffc\": container with ID starting with d19831d61dcc3caf5b222e08c2a8f1a34c2d957418ca803ddb12e81867473ffc not found: ID does not exist" containerID="d19831d61dcc3caf5b222e08c2a8f1a34c2d957418ca803ddb12e81867473ffc"
Sep 11 13:11:19.768468 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.768403    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d19831d61dcc3caf5b222e08c2a8f1a34c2d957418ca803ddb12e81867473ffc"} err="failed to get container status \"d19831d61dcc3caf5b222e08c2a8f1a34c2d957418ca803ddb12e81867473ffc\": rpc error: code = NotFound desc = could not find container \"d19831d61dcc3caf5b222e08c2a8f1a34c2d957418ca803ddb12e81867473ffc\": container with ID starting with d19831d61dcc3caf5b222e08c2a8f1a34c2d957418ca803ddb12e81867473ffc not found: ID does not exist"
Sep 11 13:11:19.899598 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.899574    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"
Sep 11 13:11:19.919108 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.919084    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mx5pr\" (UniqueName: \"kubernetes.io/projected/e696adaf-bb78-4a22-adf1-7dfa7c11c252-kube-api-access-mx5pr\") pod \"e696adaf-bb78-4a22-adf1-7dfa7c11c252\" (UID: \"e696adaf-bb78-4a22-adf1-7dfa7c11c252\") "
Sep 11 13:11:19.919216 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.919121    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e696adaf-bb78-4a22-adf1-7dfa7c11c252-tmp-dir\") pod \"e696adaf-bb78-4a22-adf1-7dfa7c11c252\" (UID: \"e696adaf-bb78-4a22-adf1-7dfa7c11c252\") "
Sep 11 13:11:19.919216 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.919146    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e696adaf-bb78-4a22-adf1-7dfa7c11c252-dshm\") pod \"e696adaf-bb78-4a22-adf1-7dfa7c11c252\" (UID: \"e696adaf-bb78-4a22-adf1-7dfa7c11c252\") "
Sep 11 13:11:19.919216 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.919202    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e696adaf-bb78-4a22-adf1-7dfa7c11c252-model-cache\") pod \"e696adaf-bb78-4a22-adf1-7dfa7c11c252\" (UID: \"e696adaf-bb78-4a22-adf1-7dfa7c11c252\") "
Sep 11 13:11:19.919378 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.919238    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e696adaf-bb78-4a22-adf1-7dfa7c11c252-home\") pod \"e696adaf-bb78-4a22-adf1-7dfa7c11c252\" (UID: \"e696adaf-bb78-4a22-adf1-7dfa7c11c252\") "
Sep 11 13:11:19.919378 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.919282    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e696adaf-bb78-4a22-adf1-7dfa7c11c252-tls-certs\") pod \"e696adaf-bb78-4a22-adf1-7dfa7c11c252\" (UID: \"e696adaf-bb78-4a22-adf1-7dfa7c11c252\") "
Sep 11 13:11:19.919378 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.919357    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e696adaf-bb78-4a22-adf1-7dfa7c11c252-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e696adaf-bb78-4a22-adf1-7dfa7c11c252" (UID: "e696adaf-bb78-4a22-adf1-7dfa7c11c252"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:11:19.919648 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.919626    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e696adaf-bb78-4a22-adf1-7dfa7c11c252-model-cache" (OuterVolumeSpecName: "model-cache") pod "e696adaf-bb78-4a22-adf1-7dfa7c11c252" (UID: "e696adaf-bb78-4a22-adf1-7dfa7c11c252"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:11:19.919746 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.919645    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e696adaf-bb78-4a22-adf1-7dfa7c11c252-home" (OuterVolumeSpecName: "home") pod "e696adaf-bb78-4a22-adf1-7dfa7c11c252" (UID: "e696adaf-bb78-4a22-adf1-7dfa7c11c252"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:11:19.919746 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.919677    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e696adaf-bb78-4a22-adf1-7dfa7c11c252-tmp-dir\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:11:19.921447 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.921418    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e696adaf-bb78-4a22-adf1-7dfa7c11c252-dshm" (OuterVolumeSpecName: "dshm") pod "e696adaf-bb78-4a22-adf1-7dfa7c11c252" (UID: "e696adaf-bb78-4a22-adf1-7dfa7c11c252"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:11:19.921530 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.921458    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e696adaf-bb78-4a22-adf1-7dfa7c11c252-kube-api-access-mx5pr" (OuterVolumeSpecName: "kube-api-access-mx5pr") pod "e696adaf-bb78-4a22-adf1-7dfa7c11c252" (UID: "e696adaf-bb78-4a22-adf1-7dfa7c11c252"). InnerVolumeSpecName "kube-api-access-mx5pr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:11:19.921530 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:19.921456    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e696adaf-bb78-4a22-adf1-7dfa7c11c252-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e696adaf-bb78-4a22-adf1-7dfa7c11c252" (UID: "e696adaf-bb78-4a22-adf1-7dfa7c11c252"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:11:20.021109 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:20.021031    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e696adaf-bb78-4a22-adf1-7dfa7c11c252-tls-certs\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:11:20.021109 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:20.021058    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mx5pr\" (UniqueName: \"kubernetes.io/projected/e696adaf-bb78-4a22-adf1-7dfa7c11c252-kube-api-access-mx5pr\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:11:20.021109 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:20.021071    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e696adaf-bb78-4a22-adf1-7dfa7c11c252-dshm\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:11:20.021109 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:20.021080    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e696adaf-bb78-4a22-adf1-7dfa7c11c252-model-cache\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:11:20.021109 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:20.021088    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e696adaf-bb78-4a22-adf1-7dfa7c11c252-home\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:11:20.101756 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:20.101704    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:20.687307 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:20.687272    2547 generic.go:356] "Generic (PLEG): container finished" podID="e696adaf-bb78-4a22-adf1-7dfa7c11c252" containerID="e6d6a2d29c904281448e7dd6f6fc5a2555df56354ce14aa613eae31ea086550e" exitCode=0
Sep 11 13:11:20.687833 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:20.687313    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"
Sep 11 13:11:20.687833 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:20.687336    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz" event={"ID":"e696adaf-bb78-4a22-adf1-7dfa7c11c252","Type":"ContainerDied","Data":"e6d6a2d29c904281448e7dd6f6fc5a2555df56354ce14aa613eae31ea086550e"}
Sep 11 13:11:20.687833 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:20.687387    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz" event={"ID":"e696adaf-bb78-4a22-adf1-7dfa7c11c252","Type":"ContainerDied","Data":"35525a248bad972da6c4b79df94514430d7d73aefee7ea52043e868799f0b8b4"}
Sep 11 13:11:20.687833 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:20.687411    2547 scope.go:117] "RemoveContainer" containerID="e6d6a2d29c904281448e7dd6f6fc5a2555df56354ce14aa613eae31ea086550e"
Sep 11 13:11:20.697415 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:20.697393    2547 scope.go:117] "RemoveContainer" containerID="e6d6a2d29c904281448e7dd6f6fc5a2555df56354ce14aa613eae31ea086550e"
Sep 11 13:11:20.697730 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:11:20.697696    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6d6a2d29c904281448e7dd6f6fc5a2555df56354ce14aa613eae31ea086550e\": container with ID starting with e6d6a2d29c904281448e7dd6f6fc5a2555df56354ce14aa613eae31ea086550e not found: ID does not exist" containerID="e6d6a2d29c904281448e7dd6f6fc5a2555df56354ce14aa613eae31ea086550e"
Sep 11 13:11:20.697780 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:20.697736    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6d6a2d29c904281448e7dd6f6fc5a2555df56354ce14aa613eae31ea086550e"} err="failed to get container status \"e6d6a2d29c904281448e7dd6f6fc5a2555df56354ce14aa613eae31ea086550e\": rpc error: code = NotFound desc = could not find container \"e6d6a2d29c904281448e7dd6f6fc5a2555df56354ce14aa613eae31ea086550e\": container with ID starting with e6d6a2d29c904281448e7dd6f6fc5a2555df56354ce14aa613eae31ea086550e not found: ID does not exist"
Sep 11 13:11:20.711946 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:20.711921    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"]
Sep 11 13:11:20.716437 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:20.716414    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-b-ae83ed5e-kserve-5dcb87b57f-tl2zz"]
Sep 11 13:11:20.926868 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:20.926817    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:21.628182 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:21.628153    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-ecc2b9-6686fd7485-lkk9q"
Sep 11 13:11:21.664613 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:21.664581    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b00a6f1e-3c45-497e-8392-97c702209e25" path="/var/lib/kubelet/pods/b00a6f1e-3c45-497e-8392-97c702209e25/volumes"
Sep 11 13:11:21.665017 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:21.665002    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e696adaf-bb78-4a22-adf1-7dfa7c11c252" path="/var/lib/kubelet/pods/e696adaf-bb78-4a22-adf1-7dfa7c11c252/volumes"
Sep 11 13:11:21.993062 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:21.992967    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:22.154137 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.154106    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:22.460286 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.460251    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"]
Sep 11 13:11:22.460664 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.460652    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e696adaf-bb78-4a22-adf1-7dfa7c11c252" containerName="main"
Sep 11 13:11:22.460709 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.460666    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="e696adaf-bb78-4a22-adf1-7dfa7c11c252" containerName="main"
Sep 11 13:11:22.460709 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.460677    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13a39e0a-868d-42b3-b63a-141bb9a7dc81" containerName="payload-pre-processing"
Sep 11 13:11:22.460709 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.460682    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="13a39e0a-868d-42b3-b63a-141bb9a7dc81" containerName="payload-pre-processing"
Sep 11 13:11:22.460709 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.460690    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b00a6f1e-3c45-497e-8392-97c702209e25" containerName="main"
Sep 11 13:11:22.460709 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.460696    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="b00a6f1e-3c45-497e-8392-97c702209e25" containerName="main"
Sep 11 13:11:22.460963 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.460777    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="e696adaf-bb78-4a22-adf1-7dfa7c11c252" containerName="main"
Sep 11 13:11:22.460963 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.460786    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="13a39e0a-868d-42b3-b63a-141bb9a7dc81" containerName="payload-pre-processing"
Sep 11 13:11:22.460963 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.460796    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="b00a6f1e-3c45-497e-8392-97c702209e25" containerName="main"
Sep 11 13:11:22.465214 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.465193    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"
Sep 11 13:11:22.472262 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.472239    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-a6ba91\"/\"openshift-service-ca.crt\""
Sep 11 13:11:22.472400 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.472258    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-a6ba91\"/\"kube-root-ca.crt\""
Sep 11 13:11:22.476309 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.476294    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-a6ba91\"/\"test-model-a6ba91-kserve-self-signed-certs\""
Sep 11 13:11:22.486280 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.486261    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-a6ba91\"/\"default-dockercfg-h864n\""
Sep 11 13:11:22.495841 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.495822    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"]
Sep 11 13:11:22.534549 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.534522    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:22.546734 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.546689    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-dshm\") pod \"test-model-a6ba91-kserve-65c9c99fc-qqtcs\" (UID: \"90c847e9-6df0-4d8e-b573-9d7cee6cf43f\") " pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"
Sep 11 13:11:22.546854 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.546746    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-tmp-dir\") pod \"test-model-a6ba91-kserve-65c9c99fc-qqtcs\" (UID: \"90c847e9-6df0-4d8e-b573-9d7cee6cf43f\") " pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"
Sep 11 13:11:22.546854 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.546811    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7jlr\" (UniqueName: \"kubernetes.io/projected/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-kube-api-access-g7jlr\") pod \"test-model-a6ba91-kserve-65c9c99fc-qqtcs\" (UID: \"90c847e9-6df0-4d8e-b573-9d7cee6cf43f\") " pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"
Sep 11 13:11:22.546854 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.546850    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-model-cache\") pod \"test-model-a6ba91-kserve-65c9c99fc-qqtcs\" (UID: \"90c847e9-6df0-4d8e-b573-9d7cee6cf43f\") " pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"
Sep 11 13:11:22.546990 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.546898    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-tls-certs\") pod \"test-model-a6ba91-kserve-65c9c99fc-qqtcs\" (UID: \"90c847e9-6df0-4d8e-b573-9d7cee6cf43f\") " pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"
Sep 11 13:11:22.546990 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.546923    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-home\") pod \"test-model-a6ba91-kserve-65c9c99fc-qqtcs\" (UID: \"90c847e9-6df0-4d8e-b573-9d7cee6cf43f\") " pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"
Sep 11 13:11:22.647765 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.647711    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-tls-certs\") pod \"test-model-a6ba91-kserve-65c9c99fc-qqtcs\" (UID: \"90c847e9-6df0-4d8e-b573-9d7cee6cf43f\") " pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"
Sep 11 13:11:22.647765 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.647765    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-home\") pod \"test-model-a6ba91-kserve-65c9c99fc-qqtcs\" (UID: \"90c847e9-6df0-4d8e-b573-9d7cee6cf43f\") " pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"
Sep 11 13:11:22.647993 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.647815    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-dshm\") pod \"test-model-a6ba91-kserve-65c9c99fc-qqtcs\" (UID: \"90c847e9-6df0-4d8e-b573-9d7cee6cf43f\") " pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"
Sep 11 13:11:22.647993 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.647839    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-tmp-dir\") pod \"test-model-a6ba91-kserve-65c9c99fc-qqtcs\" (UID: \"90c847e9-6df0-4d8e-b573-9d7cee6cf43f\") " pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"
Sep 11 13:11:22.647993 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.647868    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7jlr\" (UniqueName: \"kubernetes.io/projected/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-kube-api-access-g7jlr\") pod \"test-model-a6ba91-kserve-65c9c99fc-qqtcs\" (UID: \"90c847e9-6df0-4d8e-b573-9d7cee6cf43f\") " pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"
Sep 11 13:11:22.647993 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.647895    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-model-cache\") pod \"test-model-a6ba91-kserve-65c9c99fc-qqtcs\" (UID: \"90c847e9-6df0-4d8e-b573-9d7cee6cf43f\") " pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"
Sep 11 13:11:22.648254 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.648232    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-home\") pod \"test-model-a6ba91-kserve-65c9c99fc-qqtcs\" (UID: \"90c847e9-6df0-4d8e-b573-9d7cee6cf43f\") " pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"
Sep 11 13:11:22.648328 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.648292    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-tmp-dir\") pod \"test-model-a6ba91-kserve-65c9c99fc-qqtcs\" (UID: \"90c847e9-6df0-4d8e-b573-9d7cee6cf43f\") " pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"
Sep 11 13:11:22.648377 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.648330    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-model-cache\") pod \"test-model-a6ba91-kserve-65c9c99fc-qqtcs\" (UID: \"90c847e9-6df0-4d8e-b573-9d7cee6cf43f\") " pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"
Sep 11 13:11:22.650177 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.650155    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-dshm\") pod \"test-model-a6ba91-kserve-65c9c99fc-qqtcs\" (UID: \"90c847e9-6df0-4d8e-b573-9d7cee6cf43f\") " pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"
Sep 11 13:11:22.650362 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.650344    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-tls-certs\") pod \"test-model-a6ba91-kserve-65c9c99fc-qqtcs\" (UID: \"90c847e9-6df0-4d8e-b573-9d7cee6cf43f\") " pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"
Sep 11 13:11:22.665778 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.665754    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7jlr\" (UniqueName: \"kubernetes.io/projected/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-kube-api-access-g7jlr\") pod \"test-model-a6ba91-kserve-65c9c99fc-qqtcs\" (UID: \"90c847e9-6df0-4d8e-b573-9d7cee6cf43f\") " pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"
Sep 11 13:11:22.726132 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.726060    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:22.774297 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.774277    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"
Sep 11 13:11:22.896319 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:22.896278    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:23.058931 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:23.058903    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"]
Sep 11 13:11:23.059860 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:11:23.059832    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90c847e9_6df0_4d8e_b573_9d7cee6cf43f.slice/crio-fc5e0418a7af8d7e871cbf45e67f62f2c8fe44b3c35085afc0317023b9efa9c7 WatchSource:0}: Error finding container fc5e0418a7af8d7e871cbf45e67f62f2c8fe44b3c35085afc0317023b9efa9c7: Status 404 returned error can't find the container with id fc5e0418a7af8d7e871cbf45e67f62f2c8fe44b3c35085afc0317023b9efa9c7
Sep 11 13:11:23.643787 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:23.643752    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ecc2b9-6746b55d46-4l2vk"
Sep 11 13:11:23.709789 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:23.709753    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs" event={"ID":"90c847e9-6df0-4d8e-b573-9d7cee6cf43f","Type":"ContainerStarted","Data":"5f1157d03096dfcbe3785eb9233f8188aa2d39e47d0c559056a42b07480a9ba8"}
Sep 11 13:11:23.709961 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:23.709808    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs" event={"ID":"90c847e9-6df0-4d8e-b573-9d7cee6cf43f","Type":"ContainerStarted","Data":"fc5e0418a7af8d7e871cbf45e67f62f2c8fe44b3c35085afc0317023b9efa9c7"}
Sep 11 13:11:23.734087 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:23.734032    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs" podStartSLOduration=1.73401026 podStartE2EDuration="1.73401026s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:11:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:11:23.733880546 +0000 UTC m=+950.595354735" watchObservedRunningTime="2026-09-11 13:11:23.73401026 +0000 UTC m=+950.595484451"
Sep 11 13:11:27.694857 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:27.694819    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:30.198870 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:30.198835    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:32.774580 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:32.774546    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"
Sep 11 13:11:32.774580 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:32.774588    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"
Sep 11 13:11:32.787924 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:32.787899    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"
Sep 11 13:11:33.777503 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:33.777469    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"
Sep 11 13:11:35.029887 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:35.029850    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:35.124651 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:35.124617    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ecc2b9-kz4wd"]
Sep 11 13:11:35.129733 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:35.129690    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ecc2b9-kz4wd"
Sep 11 13:11:35.132428 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:35.132405    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:11:35.132598 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:35.132581    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kt2vz\""
Sep 11 13:11:35.140889 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:35.140863    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ecc2b9-kz4wd"]
Sep 11 13:11:35.267018 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:35.266982    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22757de5-1a37-42b0-84d0-51d2ca39aa17-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-ecc2b9-kz4wd\" (UID: \"22757de5-1a37-42b0-84d0-51d2ca39aa17\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ecc2b9-kz4wd"
Sep 11 13:11:35.367983 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:35.367939    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22757de5-1a37-42b0-84d0-51d2ca39aa17-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-ecc2b9-kz4wd\" (UID: \"22757de5-1a37-42b0-84d0-51d2ca39aa17\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ecc2b9-kz4wd"
Sep 11 13:11:35.368585 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:35.368565    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22757de5-1a37-42b0-84d0-51d2ca39aa17-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-ecc2b9-kz4wd\" (UID: \"22757de5-1a37-42b0-84d0-51d2ca39aa17\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ecc2b9-kz4wd"
Sep 11 13:11:35.441673 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:35.441636    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ecc2b9-kz4wd"
Sep 11 13:11:35.724064 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:35.724039    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ecc2b9-kz4wd"]
Sep 11 13:11:35.777600 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:35.777563    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ecc2b9-kz4wd" event={"ID":"22757de5-1a37-42b0-84d0-51d2ca39aa17","Type":"ContainerStarted","Data":"926732dfff2235071dfca8a0a00d99f3890befc832086e03aaca187742dc1c73"}
Sep 11 13:11:36.094727 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:36.094690    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:36.785060 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:36.784970    2547 generic.go:356] "Generic (PLEG): container finished" podID="22757de5-1a37-42b0-84d0-51d2ca39aa17" containerID="431b9f0468efab3e8ddfeb285b46c00fac0281ba8b478284a7cfd9cfbca664f9" exitCode=0
Sep 11 13:11:36.785214 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:36.785068    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ecc2b9-kz4wd" event={"ID":"22757de5-1a37-42b0-84d0-51d2ca39aa17","Type":"ContainerDied","Data":"431b9f0468efab3e8ddfeb285b46c00fac0281ba8b478284a7cfd9cfbca664f9"}
Sep 11 13:11:37.087061 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:37.087026    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:37.921196 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:37.921174    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ecc2b9-kz4wd"
Sep 11 13:11:37.990233 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:37.990205    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22757de5-1a37-42b0-84d0-51d2ca39aa17-maas-api-service-ca\") pod \"22757de5-1a37-42b0-84d0-51d2ca39aa17\" (UID: \"22757de5-1a37-42b0-84d0-51d2ca39aa17\") "
Sep 11 13:11:37.990559 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:37.990539    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22757de5-1a37-42b0-84d0-51d2ca39aa17-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "22757de5-1a37-42b0-84d0-51d2ca39aa17" (UID: "22757de5-1a37-42b0-84d0-51d2ca39aa17"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:11:38.091921 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:38.091877    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22757de5-1a37-42b0-84d0-51d2ca39aa17-maas-api-service-ca\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:11:38.657793 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:38.657754    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:38.797486 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:38.797451    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ecc2b9-kz4wd"
Sep 11 13:11:38.797664 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:38.797487    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ecc2b9-kz4wd" event={"ID":"22757de5-1a37-42b0-84d0-51d2ca39aa17","Type":"ContainerDied","Data":"926732dfff2235071dfca8a0a00d99f3890befc832086e03aaca187742dc1c73"}
Sep 11 13:11:38.797664 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:38.797538    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="926732dfff2235071dfca8a0a00d99f3890befc832086e03aaca187742dc1c73"
Sep 11 13:11:39.427508 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:39.427473    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:47.600394 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:47.600348    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:47.684068 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:47.684037    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-ecc2b9-6686fd7485-lkk9q"]
Sep 11 13:11:47.684258 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:47.684238    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-ecc2b9-6686fd7485-lkk9q" podUID="80bef7da-deeb-4129-b2b6-ea170e2480c1" containerName="payload-processing" containerID="cri-o://4a54af3fe2a29a8a66ee666d95044ac80851810937232fb0c8408686aa3a7f34" gracePeriod=30
Sep 11 13:11:47.699407 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:47.699377    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-ecc2b9-6746b55d46-4l2vk"]
Sep 11 13:11:47.699674 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:47.699574    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ecc2b9-6746b55d46-4l2vk" podUID="12eb7c1b-5a5a-41f2-8720-cd811424dca4" containerName="payload-pre-processing" containerID="cri-o://ff2f2feebb52dbfbc555e4992c344f879b7045023c5d72549efdf24a68a522cc" gracePeriod=30
Sep 11 13:11:47.815735 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:47.815673    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:47.854521 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:47.854413    2547 generic.go:356] "Generic (PLEG): container finished" podID="12eb7c1b-5a5a-41f2-8720-cd811424dca4" containerID="ff2f2feebb52dbfbc555e4992c344f879b7045023c5d72549efdf24a68a522cc" exitCode=0
Sep 11 13:11:47.854521 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:47.854465    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ecc2b9-6746b55d46-4l2vk" event={"ID":"12eb7c1b-5a5a-41f2-8720-cd811424dca4","Type":"ContainerDied","Data":"ff2f2feebb52dbfbc555e4992c344f879b7045023c5d72549efdf24a68a522cc"}
Sep 11 13:11:47.856481 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:47.856455    2547 generic.go:356] "Generic (PLEG): container finished" podID="80bef7da-deeb-4129-b2b6-ea170e2480c1" containerID="4a54af3fe2a29a8a66ee666d95044ac80851810937232fb0c8408686aa3a7f34" exitCode=0
Sep 11 13:11:47.856610 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:47.856535    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-ecc2b9-6686fd7485-lkk9q" event={"ID":"80bef7da-deeb-4129-b2b6-ea170e2480c1","Type":"ContainerDied","Data":"4a54af3fe2a29a8a66ee666d95044ac80851810937232fb0c8408686aa3a7f34"}
Sep 11 13:11:47.986317 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:47.986289    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ecc2b9-6746b55d46-4l2vk"
Sep 11 13:11:47.989621 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:47.989593    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-ecc2b9-6686fd7485-lkk9q"
Sep 11 13:11:48.011205 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:48.011166    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:48.084584 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:48.084555    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtd7t\" (UniqueName: \"kubernetes.io/projected/80bef7da-deeb-4129-b2b6-ea170e2480c1-kube-api-access-vtd7t\") pod \"80bef7da-deeb-4129-b2b6-ea170e2480c1\" (UID: \"80bef7da-deeb-4129-b2b6-ea170e2480c1\") "
Sep 11 13:11:48.084771 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:48.084599    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80bef7da-deeb-4129-b2b6-ea170e2480c1-plugins-config-volume\") pod \"80bef7da-deeb-4129-b2b6-ea170e2480c1\" (UID: \"80bef7da-deeb-4129-b2b6-ea170e2480c1\") "
Sep 11 13:11:48.084771 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:48.084644    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2br4m\" (UniqueName: \"kubernetes.io/projected/12eb7c1b-5a5a-41f2-8720-cd811424dca4-kube-api-access-2br4m\") pod \"12eb7c1b-5a5a-41f2-8720-cd811424dca4\" (UID: \"12eb7c1b-5a5a-41f2-8720-cd811424dca4\") "
Sep 11 13:11:48.084771 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:48.084691    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12eb7c1b-5a5a-41f2-8720-cd811424dca4-plugins-config-volume\") pod \"12eb7c1b-5a5a-41f2-8720-cd811424dca4\" (UID: \"12eb7c1b-5a5a-41f2-8720-cd811424dca4\") "
Sep 11 13:11:48.085154 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:48.085119    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80bef7da-deeb-4129-b2b6-ea170e2480c1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "80bef7da-deeb-4129-b2b6-ea170e2480c1" (UID: "80bef7da-deeb-4129-b2b6-ea170e2480c1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:11:48.085154 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:48.085135    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12eb7c1b-5a5a-41f2-8720-cd811424dca4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "12eb7c1b-5a5a-41f2-8720-cd811424dca4" (UID: "12eb7c1b-5a5a-41f2-8720-cd811424dca4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:11:48.087353 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:48.087325    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12eb7c1b-5a5a-41f2-8720-cd811424dca4-kube-api-access-2br4m" (OuterVolumeSpecName: "kube-api-access-2br4m") pod "12eb7c1b-5a5a-41f2-8720-cd811424dca4" (UID: "12eb7c1b-5a5a-41f2-8720-cd811424dca4"). InnerVolumeSpecName "kube-api-access-2br4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:11:48.087568 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:48.087549    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80bef7da-deeb-4129-b2b6-ea170e2480c1-kube-api-access-vtd7t" (OuterVolumeSpecName: "kube-api-access-vtd7t") pod "80bef7da-deeb-4129-b2b6-ea170e2480c1" (UID: "80bef7da-deeb-4129-b2b6-ea170e2480c1"). InnerVolumeSpecName "kube-api-access-vtd7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:11:48.089596 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:48.089574    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ecc2b9-kz4wd"]
Sep 11 13:11:48.098010 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:48.097984    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ecc2b9-kz4wd"]
Sep 11 13:11:48.155521 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:48.155435    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:48.185984 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:48.185944    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtd7t\" (UniqueName: \"kubernetes.io/projected/80bef7da-deeb-4129-b2b6-ea170e2480c1-kube-api-access-vtd7t\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:11:48.185984 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:48.185983    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80bef7da-deeb-4129-b2b6-ea170e2480c1-plugins-config-volume\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:11:48.185984 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:48.185995    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2br4m\" (UniqueName: \"kubernetes.io/projected/12eb7c1b-5a5a-41f2-8720-cd811424dca4-kube-api-access-2br4m\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:11:48.186221 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:48.186004    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12eb7c1b-5a5a-41f2-8720-cd811424dca4-plugins-config-volume\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:11:48.533422 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:48.533336    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:48.674862 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:48.674823    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:48.863342 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:48.863305    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ecc2b9-6746b55d46-4l2vk"
Sep 11 13:11:48.863538 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:48.863336    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ecc2b9-6746b55d46-4l2vk" event={"ID":"12eb7c1b-5a5a-41f2-8720-cd811424dca4","Type":"ContainerDied","Data":"3a7d2ff11b0e4acaa1e8b674dc468d0bf34d70433a17bef11cb5a41a425f1b63"}
Sep 11 13:11:48.863538 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:48.863437    2547 scope.go:117] "RemoveContainer" containerID="ff2f2feebb52dbfbc555e4992c344f879b7045023c5d72549efdf24a68a522cc"
Sep 11 13:11:48.864881 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:48.864802    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-ecc2b9-6686fd7485-lkk9q" event={"ID":"80bef7da-deeb-4129-b2b6-ea170e2480c1","Type":"ContainerDied","Data":"81f965daa848ae0bd84f4971707dfd19bd6e63fc7cc9aa84237217f32f2f7d59"}
Sep 11 13:11:48.864881 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:48.864830    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-ecc2b9-6686fd7485-lkk9q"
Sep 11 13:11:48.874824 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:48.874798    2547 scope.go:117] "RemoveContainer" containerID="4a54af3fe2a29a8a66ee666d95044ac80851810937232fb0c8408686aa3a7f34"
Sep 11 13:11:48.894324 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:48.894300    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-ecc2b9-6746b55d46-4l2vk"]
Sep 11 13:11:48.898371 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:48.898346    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-ecc2b9-6746b55d46-4l2vk"]
Sep 11 13:11:48.932367 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:48.932339    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-ecc2b9-6686fd7485-lkk9q"]
Sep 11 13:11:48.951113 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:48.951081    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-ecc2b9-6686fd7485-lkk9q"]
Sep 11 13:11:49.057537 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:49.057495    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:49.663686 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:49.663641    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12eb7c1b-5a5a-41f2-8720-cd811424dca4" path="/var/lib/kubelet/pods/12eb7c1b-5a5a-41f2-8720-cd811424dca4/volumes"
Sep 11 13:11:49.664109 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:49.664091    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22757de5-1a37-42b0-84d0-51d2ca39aa17" path="/var/lib/kubelet/pods/22757de5-1a37-42b0-84d0-51d2ca39aa17/volumes"
Sep 11 13:11:49.664471 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:49.664455    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80bef7da-deeb-4129-b2b6-ea170e2480c1" path="/var/lib/kubelet/pods/80bef7da-deeb-4129-b2b6-ea170e2480c1/volumes"
Sep 11 13:11:49.896041 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:49.896005    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:50.919937 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:50.919897    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:55.609845 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:55.609710    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:55.717409 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:55.717367    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:56.013282 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:56.013180    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:56.371679 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:56.371644    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:56.769708 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:56.769591    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:56.885137 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:56.885098    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:57.069226 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:57.069182    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:57.197838 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:57.197799    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:57.286912 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:57.286875    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:58.723589 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:58.723553    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:58.845042 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:58.844995    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:59.004439 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:11:59.004350    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:08.388937 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:08.388897    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:08.499486 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:08.499449    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:11.619565 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.619527    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b"]
Sep 11 13:12:11.620090 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.620071    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22757de5-1a37-42b0-84d0-51d2ca39aa17" containerName="revoke-keys"
Sep 11 13:12:11.620188 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.620093    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="22757de5-1a37-42b0-84d0-51d2ca39aa17" containerName="revoke-keys"
Sep 11 13:12:11.620188 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.620117    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80bef7da-deeb-4129-b2b6-ea170e2480c1" containerName="payload-processing"
Sep 11 13:12:11.620188 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.620126    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="80bef7da-deeb-4129-b2b6-ea170e2480c1" containerName="payload-processing"
Sep 11 13:12:11.620188 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.620154    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12eb7c1b-5a5a-41f2-8720-cd811424dca4" containerName="payload-pre-processing"
Sep 11 13:12:11.620188 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.620163    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="12eb7c1b-5a5a-41f2-8720-cd811424dca4" containerName="payload-pre-processing"
Sep 11 13:12:11.620443 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.620283    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="12eb7c1b-5a5a-41f2-8720-cd811424dca4" containerName="payload-pre-processing"
Sep 11 13:12:11.620443 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.620295    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="22757de5-1a37-42b0-84d0-51d2ca39aa17" containerName="revoke-keys"
Sep 11 13:12:11.620443 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.620307    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="80bef7da-deeb-4129-b2b6-ea170e2480c1" containerName="payload-processing"
Sep 11 13:12:11.623675 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.623653    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b"
Sep 11 13:12:11.627309 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.627291    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-4e381b\"/\"kube-root-ca.crt\""
Sep 11 13:12:11.628268 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.628246    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-4e381b\"/\"openshift-service-ca.crt\""
Sep 11 13:12:11.628377 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.628248    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-4e381b\"/\"noten-model-4e381b-kserve-self-signed-certs\""
Sep 11 13:12:11.628377 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.628251    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-4e381b\"/\"default-dockercfg-79pjg\""
Sep 11 13:12:11.641686 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.641667    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b"]
Sep 11 13:12:11.673745 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.673701    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:11.699863 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.699833    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-dshm\") pod \"noten-model-4e381b-kserve-58f96685f5-95g9b\" (UID: \"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0\") " pod="ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b"
Sep 11 13:12:11.700022 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.699872    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-tmp-dir\") pod \"noten-model-4e381b-kserve-58f96685f5-95g9b\" (UID: \"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0\") " pod="ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b"
Sep 11 13:12:11.700022 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.699946    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-home\") pod \"noten-model-4e381b-kserve-58f96685f5-95g9b\" (UID: \"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0\") " pod="ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b"
Sep 11 13:12:11.700163 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.700068    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-model-cache\") pod \"noten-model-4e381b-kserve-58f96685f5-95g9b\" (UID: \"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0\") " pod="ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b"
Sep 11 13:12:11.700208 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.700190    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-tls-certs\") pod \"noten-model-4e381b-kserve-58f96685f5-95g9b\" (UID: \"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0\") " pod="ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b"
Sep 11 13:12:11.700255 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.700231    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd4dv\" (UniqueName: \"kubernetes.io/projected/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-kube-api-access-nd4dv\") pod \"noten-model-4e381b-kserve-58f96685f5-95g9b\" (UID: \"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0\") " pod="ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b"
Sep 11 13:12:11.801648 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.801614    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-tls-certs\") pod \"noten-model-4e381b-kserve-58f96685f5-95g9b\" (UID: \"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0\") " pod="ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b"
Sep 11 13:12:11.801797 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.801657    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd4dv\" (UniqueName: \"kubernetes.io/projected/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-kube-api-access-nd4dv\") pod \"noten-model-4e381b-kserve-58f96685f5-95g9b\" (UID: \"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0\") " pod="ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b"
Sep 11 13:12:11.801924 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.801907    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-dshm\") pod \"noten-model-4e381b-kserve-58f96685f5-95g9b\" (UID: \"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0\") " pod="ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b"
Sep 11 13:12:11.801981 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.801936    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-tmp-dir\") pod \"noten-model-4e381b-kserve-58f96685f5-95g9b\" (UID: \"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0\") " pod="ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b"
Sep 11 13:12:11.802022 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.801993    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-home\") pod \"noten-model-4e381b-kserve-58f96685f5-95g9b\" (UID: \"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0\") " pod="ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b"
Sep 11 13:12:11.802085 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.802057    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-model-cache\") pod \"noten-model-4e381b-kserve-58f96685f5-95g9b\" (UID: \"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0\") " pod="ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b"
Sep 11 13:12:11.802366 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.802341    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-tmp-dir\") pod \"noten-model-4e381b-kserve-58f96685f5-95g9b\" (UID: \"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0\") " pod="ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b"
Sep 11 13:12:11.802487 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.802417    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-home\") pod \"noten-model-4e381b-kserve-58f96685f5-95g9b\" (UID: \"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0\") " pod="ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b"
Sep 11 13:12:11.802487 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.802443    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-model-cache\") pod \"noten-model-4e381b-kserve-58f96685f5-95g9b\" (UID: \"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0\") " pod="ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b"
Sep 11 13:12:11.804211 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.804191    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-dshm\") pod \"noten-model-4e381b-kserve-58f96685f5-95g9b\" (UID: \"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0\") " pod="ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b"
Sep 11 13:12:11.804485 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.804467    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-tls-certs\") pod \"noten-model-4e381b-kserve-58f96685f5-95g9b\" (UID: \"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0\") " pod="ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b"
Sep 11 13:12:11.810011 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.809990    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd4dv\" (UniqueName: \"kubernetes.io/projected/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-kube-api-access-nd4dv\") pod \"noten-model-4e381b-kserve-58f96685f5-95g9b\" (UID: \"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0\") " pod="ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b"
Sep 11 13:12:11.933925 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:11.933848    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b"
Sep 11 13:12:12.211270 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:12.211244    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b"]
Sep 11 13:12:12.212819 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:12:12.212791    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e0852a2_d0d0_4d0d_b1d8_937fdc308dc0.slice/crio-588aa725706bbf0b518846c62a0c4c17e5e1fbfd1638b6b80fa70b963dd1f3e3 WatchSource:0}: Error finding container 588aa725706bbf0b518846c62a0c4c17e5e1fbfd1638b6b80fa70b963dd1f3e3: Status 404 returned error can't find the container with id 588aa725706bbf0b518846c62a0c4c17e5e1fbfd1638b6b80fa70b963dd1f3e3
Sep 11 13:12:13.011431 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:13.011391    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b" event={"ID":"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0","Type":"ContainerStarted","Data":"7eb27313f820d776e23c724fbbda14448b1f35cf50cf55de2f0dd198df97fb61"}
Sep 11 13:12:13.011832 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:13.011439    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b" event={"ID":"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0","Type":"ContainerStarted","Data":"588aa725706bbf0b518846c62a0c4c17e5e1fbfd1638b6b80fa70b963dd1f3e3"}
Sep 11 13:12:13.036040 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:13.035987    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b" podStartSLOduration=2.035971513 podStartE2EDuration="2.035971513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:12:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:12:13.034791118 +0000 UTC m=+999.896265308" watchObservedRunningTime="2026-09-11 13:12:13.035971513 +0000 UTC m=+999.897445721"
Sep 11 13:12:13.108554 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:13.108516    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:17.562169 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:17.562132    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b"]
Sep 11 13:12:17.579452 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:17.579418    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:17.681638 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:17.681598    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:17.893117 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:17.893025    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:18.082363 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:18.082320    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:20.042318 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:20.042282    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:20.253566 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:20.253536    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:20.417244 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:20.417207    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:21.934541 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:21.934508    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b"
Sep 11 13:12:23.097480 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:23.097445    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:30.779888 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:30.779841    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:31.600326 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:31.600290    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:32.288562 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:32.288517    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:32.581950 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:32.581909    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b" podUID="2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0" containerName="main" containerID="cri-o://7eb27313f820d776e23c724fbbda14448b1f35cf50cf55de2f0dd198df97fb61" gracePeriod=45
Sep 11 13:12:32.844065 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:32.844007    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b"
Sep 11 13:12:33.003737 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:33.003677    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-dshm\") pod \"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0\" (UID: \"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0\") "
Sep 11 13:12:33.003922 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:33.003754    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nd4dv\" (UniqueName: \"kubernetes.io/projected/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-kube-api-access-nd4dv\") pod \"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0\" (UID: \"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0\") "
Sep 11 13:12:33.003922 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:33.003790    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-home\") pod \"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0\" (UID: \"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0\") "
Sep 11 13:12:33.003922 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:33.003820    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-tmp-dir\") pod \"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0\" (UID: \"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0\") "
Sep 11 13:12:33.003922 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:33.003862    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-tls-certs\") pod \"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0\" (UID: \"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0\") "
Sep 11 13:12:33.003922 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:33.003909    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-model-cache\") pod \"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0\" (UID: \"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0\") "
Sep 11 13:12:33.004222 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:33.004077    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-home" (OuterVolumeSpecName: "home") pod "2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0" (UID: "2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:33.004222 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:33.004167    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0" (UID: "2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:33.004348 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:33.004287    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-home\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:12:33.004348 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:33.004305    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-tmp-dir\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:12:33.004426 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:33.004360    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-model-cache" (OuterVolumeSpecName: "model-cache") pod "2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0" (UID: "2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:33.006212 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:33.006185    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-kube-api-access-nd4dv" (OuterVolumeSpecName: "kube-api-access-nd4dv") pod "2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0" (UID: "2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0"). InnerVolumeSpecName "kube-api-access-nd4dv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:12:33.006323 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:33.006217    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-dshm" (OuterVolumeSpecName: "dshm") pod "2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0" (UID: "2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:33.006323 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:33.006217    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0" (UID: "2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:12:33.105512 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:33.105418    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-dshm\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:12:33.105512 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:33.105455    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nd4dv\" (UniqueName: \"kubernetes.io/projected/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-kube-api-access-nd4dv\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:12:33.105512 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:33.105466    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-tls-certs\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:12:33.105512 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:33.105475    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0-model-cache\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:12:33.128742 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:33.128686    2547 generic.go:356] "Generic (PLEG): container finished" podID="2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0" containerID="7eb27313f820d776e23c724fbbda14448b1f35cf50cf55de2f0dd198df97fb61" exitCode=0
Sep 11 13:12:33.128916 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:33.128741    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b" event={"ID":"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0","Type":"ContainerDied","Data":"7eb27313f820d776e23c724fbbda14448b1f35cf50cf55de2f0dd198df97fb61"}
Sep 11 13:12:33.128916 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:33.128772    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b"
Sep 11 13:12:33.128916 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:33.128797    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b" event={"ID":"2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0","Type":"ContainerDied","Data":"588aa725706bbf0b518846c62a0c4c17e5e1fbfd1638b6b80fa70b963dd1f3e3"}
Sep 11 13:12:33.128916 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:33.128822    2547 scope.go:117] "RemoveContainer" containerID="7eb27313f820d776e23c724fbbda14448b1f35cf50cf55de2f0dd198df97fb61"
Sep 11 13:12:33.138671 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:33.138655    2547 scope.go:117] "RemoveContainer" containerID="7eb27313f820d776e23c724fbbda14448b1f35cf50cf55de2f0dd198df97fb61"
Sep 11 13:12:33.138988 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:12:33.138966    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7eb27313f820d776e23c724fbbda14448b1f35cf50cf55de2f0dd198df97fb61\": container with ID starting with 7eb27313f820d776e23c724fbbda14448b1f35cf50cf55de2f0dd198df97fb61 not found: ID does not exist" containerID="7eb27313f820d776e23c724fbbda14448b1f35cf50cf55de2f0dd198df97fb61"
Sep 11 13:12:33.139049 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:33.138998    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7eb27313f820d776e23c724fbbda14448b1f35cf50cf55de2f0dd198df97fb61"} err="failed to get container status \"7eb27313f820d776e23c724fbbda14448b1f35cf50cf55de2f0dd198df97fb61\": rpc error: code = NotFound desc = could not find container \"7eb27313f820d776e23c724fbbda14448b1f35cf50cf55de2f0dd198df97fb61\": container with ID starting with 7eb27313f820d776e23c724fbbda14448b1f35cf50cf55de2f0dd198df97fb61 not found: ID does not exist"
Sep 11 13:12:33.153872 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:33.153848    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b"]
Sep 11 13:12:33.156356 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:33.156336    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-4e381b/noten-model-4e381b-kserve-58f96685f5-95g9b"]
Sep 11 13:12:33.329229 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:33.329198    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"]
Sep 11 13:12:33.378459 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:33.378375    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:33.663571 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:33.663495    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0" path="/var/lib/kubelet/pods/2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0/volumes"
Sep 11 13:12:34.514817 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:34.514772    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:35.345774 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:35.345740    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:36.304418 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:36.304378    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:39.903104 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:39.903050    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:40.083382 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:40.083338    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:40.247037 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:40.246940    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:41.192162 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:41.192121    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:41.411761 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:41.411702    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:43.008847 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:43.008810    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:44.504226 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:44.504184    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:44.583784 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:44.583753    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-528ff6-847dc875bc-9ldxf"]
Sep 11 13:12:44.584016 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:44.583990    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-528ff6-847dc875bc-9ldxf" podUID="f1ab0c2f-8a7b-467f-a7ab-891c2166ef00" containerName="payload-processing" containerID="cri-o://54ad91d0a367cb4ff94c27fbf53261ab0ceeb8b40cbc02565c398ac56b1df97c" gracePeriod=30
Sep 11 13:12:44.729249 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:44.729213    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:44.846012 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:44.845987    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-528ff6-847dc875bc-9ldxf"
Sep 11 13:12:44.917959 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:44.917930    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1ab0c2f-8a7b-467f-a7ab-891c2166ef00-plugins-config-volume\") pod \"f1ab0c2f-8a7b-467f-a7ab-891c2166ef00\" (UID: \"f1ab0c2f-8a7b-467f-a7ab-891c2166ef00\") "
Sep 11 13:12:44.917959 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:44.917964    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72n8r\" (UniqueName: \"kubernetes.io/projected/f1ab0c2f-8a7b-467f-a7ab-891c2166ef00-kube-api-access-72n8r\") pod \"f1ab0c2f-8a7b-467f-a7ab-891c2166ef00\" (UID: \"f1ab0c2f-8a7b-467f-a7ab-891c2166ef00\") "
Sep 11 13:12:44.918280 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:44.918255    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1ab0c2f-8a7b-467f-a7ab-891c2166ef00-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f1ab0c2f-8a7b-467f-a7ab-891c2166ef00" (UID: "f1ab0c2f-8a7b-467f-a7ab-891c2166ef00"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:12:44.920212 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:44.920190    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1ab0c2f-8a7b-467f-a7ab-891c2166ef00-kube-api-access-72n8r" (OuterVolumeSpecName: "kube-api-access-72n8r") pod "f1ab0c2f-8a7b-467f-a7ab-891c2166ef00" (UID: "f1ab0c2f-8a7b-467f-a7ab-891c2166ef00"). InnerVolumeSpecName "kube-api-access-72n8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:12:45.019387 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:45.019313    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1ab0c2f-8a7b-467f-a7ab-891c2166ef00-plugins-config-volume\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:12:45.019387 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:45.019338    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72n8r\" (UniqueName: \"kubernetes.io/projected/f1ab0c2f-8a7b-467f-a7ab-891c2166ef00-kube-api-access-72n8r\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:12:45.032169 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:45.032133    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:45.200635 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:45.200602    2547 generic.go:356] "Generic (PLEG): container finished" podID="f1ab0c2f-8a7b-467f-a7ab-891c2166ef00" containerID="54ad91d0a367cb4ff94c27fbf53261ab0ceeb8b40cbc02565c398ac56b1df97c" exitCode=0
Sep 11 13:12:45.200830 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:45.200648    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-528ff6-847dc875bc-9ldxf"
Sep 11 13:12:45.200830 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:45.200684    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-528ff6-847dc875bc-9ldxf" event={"ID":"f1ab0c2f-8a7b-467f-a7ab-891c2166ef00","Type":"ContainerDied","Data":"54ad91d0a367cb4ff94c27fbf53261ab0ceeb8b40cbc02565c398ac56b1df97c"}
Sep 11 13:12:45.200830 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:45.200763    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-528ff6-847dc875bc-9ldxf" event={"ID":"f1ab0c2f-8a7b-467f-a7ab-891c2166ef00","Type":"ContainerDied","Data":"e98fc222053241c63b001a96aedd3c276601b06e6a6dbabb181dcd15d7737874"}
Sep 11 13:12:45.200830 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:45.200788    2547 scope.go:117] "RemoveContainer" containerID="54ad91d0a367cb4ff94c27fbf53261ab0ceeb8b40cbc02565c398ac56b1df97c"
Sep 11 13:12:45.210230 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:45.210214    2547 scope.go:117] "RemoveContainer" containerID="54ad91d0a367cb4ff94c27fbf53261ab0ceeb8b40cbc02565c398ac56b1df97c"
Sep 11 13:12:45.210573 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:12:45.210528    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54ad91d0a367cb4ff94c27fbf53261ab0ceeb8b40cbc02565c398ac56b1df97c\": container with ID starting with 54ad91d0a367cb4ff94c27fbf53261ab0ceeb8b40cbc02565c398ac56b1df97c not found: ID does not exist" containerID="54ad91d0a367cb4ff94c27fbf53261ab0ceeb8b40cbc02565c398ac56b1df97c"
Sep 11 13:12:45.210573 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:45.210559    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54ad91d0a367cb4ff94c27fbf53261ab0ceeb8b40cbc02565c398ac56b1df97c"} err="failed to get container status \"54ad91d0a367cb4ff94c27fbf53261ab0ceeb8b40cbc02565c398ac56b1df97c\": rpc error: code = NotFound desc = could not find container \"54ad91d0a367cb4ff94c27fbf53261ab0ceeb8b40cbc02565c398ac56b1df97c\": container with ID starting with 54ad91d0a367cb4ff94c27fbf53261ab0ceeb8b40cbc02565c398ac56b1df97c not found: ID does not exist"
Sep 11 13:12:45.274577 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:45.274461    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-528ff6-847dc875bc-9ldxf"]
Sep 11 13:12:45.276899 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:45.276874    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-528ff6-847dc875bc-9ldxf"]
Sep 11 13:12:45.318330 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:45.318307    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:45.529306 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:45.529217    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:45.664400 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:45.664373    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1ab0c2f-8a7b-467f-a7ab-891c2166ef00" path="/var/lib/kubelet/pods/f1ab0c2f-8a7b-467f-a7ab-891c2166ef00/volumes"
Sep 11 13:12:45.703123 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:45.703085    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:47.518299 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:47.518265    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:48.348857 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:48.348814    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs" podUID="90c847e9-6df0-4d8e-b573-9d7cee6cf43f" containerName="main" containerID="cri-o://5f1157d03096dfcbe3785eb9233f8188aa2d39e47d0c559056a42b07480a9ba8" gracePeriod=45
Sep 11 13:12:48.599841 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:48.599769    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"
Sep 11 13:12:48.649334 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:48.649300    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-tls-certs\") pod \"90c847e9-6df0-4d8e-b573-9d7cee6cf43f\" (UID: \"90c847e9-6df0-4d8e-b573-9d7cee6cf43f\") "
Sep 11 13:12:48.649474 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:48.649401    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-tmp-dir\") pod \"90c847e9-6df0-4d8e-b573-9d7cee6cf43f\" (UID: \"90c847e9-6df0-4d8e-b573-9d7cee6cf43f\") "
Sep 11 13:12:48.649474 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:48.649424    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-dshm\") pod \"90c847e9-6df0-4d8e-b573-9d7cee6cf43f\" (UID: \"90c847e9-6df0-4d8e-b573-9d7cee6cf43f\") "
Sep 11 13:12:48.649474 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:48.649452    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-home\") pod \"90c847e9-6df0-4d8e-b573-9d7cee6cf43f\" (UID: \"90c847e9-6df0-4d8e-b573-9d7cee6cf43f\") "
Sep 11 13:12:48.649656 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:48.649494    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7jlr\" (UniqueName: \"kubernetes.io/projected/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-kube-api-access-g7jlr\") pod \"90c847e9-6df0-4d8e-b573-9d7cee6cf43f\" (UID: \"90c847e9-6df0-4d8e-b573-9d7cee6cf43f\") "
Sep 11 13:12:48.649656 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:48.649538    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-model-cache\") pod \"90c847e9-6df0-4d8e-b573-9d7cee6cf43f\" (UID: \"90c847e9-6df0-4d8e-b573-9d7cee6cf43f\") "
Sep 11 13:12:48.649789 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:48.649664    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "90c847e9-6df0-4d8e-b573-9d7cee6cf43f" (UID: "90c847e9-6df0-4d8e-b573-9d7cee6cf43f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:48.649789 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:48.649700    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-home" (OuterVolumeSpecName: "home") pod "90c847e9-6df0-4d8e-b573-9d7cee6cf43f" (UID: "90c847e9-6df0-4d8e-b573-9d7cee6cf43f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:48.649891 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:48.649873    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-model-cache" (OuterVolumeSpecName: "model-cache") pod "90c847e9-6df0-4d8e-b573-9d7cee6cf43f" (UID: "90c847e9-6df0-4d8e-b573-9d7cee6cf43f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:48.649953 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:48.649903    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-tmp-dir\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:12:48.649953 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:48.649925    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-home\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:12:48.652022 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:48.651996    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "90c847e9-6df0-4d8e-b573-9d7cee6cf43f" (UID: "90c847e9-6df0-4d8e-b573-9d7cee6cf43f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:12:48.652120 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:48.652085    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-dshm" (OuterVolumeSpecName: "dshm") pod "90c847e9-6df0-4d8e-b573-9d7cee6cf43f" (UID: "90c847e9-6df0-4d8e-b573-9d7cee6cf43f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:48.652173 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:48.652124    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-kube-api-access-g7jlr" (OuterVolumeSpecName: "kube-api-access-g7jlr") pod "90c847e9-6df0-4d8e-b573-9d7cee6cf43f" (UID: "90c847e9-6df0-4d8e-b573-9d7cee6cf43f"). InnerVolumeSpecName "kube-api-access-g7jlr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:12:48.750880 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:48.750844    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-tls-certs\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:12:48.750880 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:48.750874    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-dshm\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:12:48.750880 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:48.750886    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7jlr\" (UniqueName: \"kubernetes.io/projected/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-kube-api-access-g7jlr\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:12:48.751104 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:48.750898    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90c847e9-6df0-4d8e-b573-9d7cee6cf43f-model-cache\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:12:49.225520 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:49.225485    2547 generic.go:356] "Generic (PLEG): container finished" podID="90c847e9-6df0-4d8e-b573-9d7cee6cf43f" containerID="5f1157d03096dfcbe3785eb9233f8188aa2d39e47d0c559056a42b07480a9ba8" exitCode=0
Sep 11 13:12:49.225697 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:49.225531    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"
Sep 11 13:12:49.225697 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:49.225570    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs" event={"ID":"90c847e9-6df0-4d8e-b573-9d7cee6cf43f","Type":"ContainerDied","Data":"5f1157d03096dfcbe3785eb9233f8188aa2d39e47d0c559056a42b07480a9ba8"}
Sep 11 13:12:49.225697 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:49.225616    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs" event={"ID":"90c847e9-6df0-4d8e-b573-9d7cee6cf43f","Type":"ContainerDied","Data":"fc5e0418a7af8d7e871cbf45e67f62f2c8fe44b3c35085afc0317023b9efa9c7"}
Sep 11 13:12:49.225697 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:49.225635    2547 scope.go:117] "RemoveContainer" containerID="5f1157d03096dfcbe3785eb9233f8188aa2d39e47d0c559056a42b07480a9ba8"
Sep 11 13:12:49.235460 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:49.235444    2547 scope.go:117] "RemoveContainer" containerID="5f1157d03096dfcbe3785eb9233f8188aa2d39e47d0c559056a42b07480a9ba8"
Sep 11 13:12:49.235763 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:12:49.235742    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f1157d03096dfcbe3785eb9233f8188aa2d39e47d0c559056a42b07480a9ba8\": container with ID starting with 5f1157d03096dfcbe3785eb9233f8188aa2d39e47d0c559056a42b07480a9ba8 not found: ID does not exist" containerID="5f1157d03096dfcbe3785eb9233f8188aa2d39e47d0c559056a42b07480a9ba8"
Sep 11 13:12:49.235840 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:49.235773    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f1157d03096dfcbe3785eb9233f8188aa2d39e47d0c559056a42b07480a9ba8"} err="failed to get container status \"5f1157d03096dfcbe3785eb9233f8188aa2d39e47d0c559056a42b07480a9ba8\": rpc error: code = NotFound desc = could not find container \"5f1157d03096dfcbe3785eb9233f8188aa2d39e47d0c559056a42b07480a9ba8\": container with ID starting with 5f1157d03096dfcbe3785eb9233f8188aa2d39e47d0c559056a42b07480a9ba8 not found: ID does not exist"
Sep 11 13:12:49.252887 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:49.252862    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"]
Sep 11 13:12:49.256573 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:49.256552    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-a6ba91/test-model-a6ba91-kserve-65c9c99fc-qqtcs"]
Sep 11 13:12:49.664890 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:49.664862    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90c847e9-6df0-4d8e-b573-9d7cee6cf43f" path="/var/lib/kubelet/pods/90c847e9-6df0-4d8e-b573-9d7cee6cf43f/volumes"
Sep 11 13:12:51.403206 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:51.403170    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:51.531587 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:51.531548    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:52.159857 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:52.159820    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:54.183971 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:54.183935    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:54.300680 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:54.300646    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:54.607115 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:54.607081    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:54.925770 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:54.925661    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a6ba91-9nv9j"]
Sep 11 13:12:54.926065 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:54.926052    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90c847e9-6df0-4d8e-b573-9d7cee6cf43f" containerName="main"
Sep 11 13:12:54.926118 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:54.926067    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="90c847e9-6df0-4d8e-b573-9d7cee6cf43f" containerName="main"
Sep 11 13:12:54.926118 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:54.926086    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0" containerName="main"
Sep 11 13:12:54.926118 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:54.926092    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0" containerName="main"
Sep 11 13:12:54.926118 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:54.926099    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1ab0c2f-8a7b-467f-a7ab-891c2166ef00" containerName="payload-processing"
Sep 11 13:12:54.926118 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:54.926109    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1ab0c2f-8a7b-467f-a7ab-891c2166ef00" containerName="payload-processing"
Sep 11 13:12:54.926293 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:54.926187    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e0852a2-d0d0-4d0d-b1d8-937fdc308dc0" containerName="main"
Sep 11 13:12:54.926293 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:54.926195    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1ab0c2f-8a7b-467f-a7ab-891c2166ef00" containerName="payload-processing"
Sep 11 13:12:54.926293 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:54.926202    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="90c847e9-6df0-4d8e-b573-9d7cee6cf43f" containerName="main"
Sep 11 13:12:54.930532 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:54.930512    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a6ba91-9nv9j"
Sep 11 13:12:54.937642 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:54.937590    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kt2vz\""
Sep 11 13:12:54.937785 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:54.937613    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:12:54.961854 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:54.961825    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a6ba91-9nv9j"]
Sep 11 13:12:55.016836 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:55.016803    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ced161cb-f2e2-44f7-87c9-cc7c852ea0b3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-a6ba91-9nv9j\" (UID: \"ced161cb-f2e2-44f7-87c9-cc7c852ea0b3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a6ba91-9nv9j"
Sep 11 13:12:55.117878 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:55.117846    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ced161cb-f2e2-44f7-87c9-cc7c852ea0b3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-a6ba91-9nv9j\" (UID: \"ced161cb-f2e2-44f7-87c9-cc7c852ea0b3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a6ba91-9nv9j"
Sep 11 13:12:55.118495 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:55.118470    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ced161cb-f2e2-44f7-87c9-cc7c852ea0b3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-a6ba91-9nv9j\" (UID: \"ced161cb-f2e2-44f7-87c9-cc7c852ea0b3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a6ba91-9nv9j"
Sep 11 13:12:55.247315 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:55.247224    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a6ba91-9nv9j"
Sep 11 13:12:55.536255 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:55.536225    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a6ba91-9nv9j"]
Sep 11 13:12:55.538099 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:12:55.538072    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podced161cb_f2e2_44f7_87c9_cc7c852ea0b3.slice/crio-de3ea858b58ce41e842fed8cf331d174bc6d74a7df3c860eedc33ee99116622d WatchSource:0}: Error finding container de3ea858b58ce41e842fed8cf331d174bc6d74a7df3c860eedc33ee99116622d: Status 404 returned error can't find the container with id de3ea858b58ce41e842fed8cf331d174bc6d74a7df3c860eedc33ee99116622d
Sep 11 13:12:56.271867 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:56.271834    2547 generic.go:356] "Generic (PLEG): container finished" podID="ced161cb-f2e2-44f7-87c9-cc7c852ea0b3" containerID="bb8d00d52d90f029f4a144ccc63f696336edf08c66ed1ee08faf9ac810ad1507" exitCode=0
Sep 11 13:12:56.272222 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:56.271920    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a6ba91-9nv9j" event={"ID":"ced161cb-f2e2-44f7-87c9-cc7c852ea0b3","Type":"ContainerDied","Data":"bb8d00d52d90f029f4a144ccc63f696336edf08c66ed1ee08faf9ac810ad1507"}
Sep 11 13:12:56.272222 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:56.271976    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a6ba91-9nv9j" event={"ID":"ced161cb-f2e2-44f7-87c9-cc7c852ea0b3","Type":"ContainerStarted","Data":"de3ea858b58ce41e842fed8cf331d174bc6d74a7df3c860eedc33ee99116622d"}
Sep 11 13:12:56.394186 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:56.394143    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:57.418587 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:57.418563    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a6ba91-9nv9j"
Sep 11 13:12:57.537463 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:57.537377    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ced161cb-f2e2-44f7-87c9-cc7c852ea0b3-maas-api-service-ca\") pod \"ced161cb-f2e2-44f7-87c9-cc7c852ea0b3\" (UID: \"ced161cb-f2e2-44f7-87c9-cc7c852ea0b3\") "
Sep 11 13:12:57.537771 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:57.537748    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ced161cb-f2e2-44f7-87c9-cc7c852ea0b3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ced161cb-f2e2-44f7-87c9-cc7c852ea0b3" (UID: "ced161cb-f2e2-44f7-87c9-cc7c852ea0b3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:12:57.638984 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:57.638953    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ced161cb-f2e2-44f7-87c9-cc7c852ea0b3-maas-api-service-ca\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:12:57.731098 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:57.731060    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:58.285222 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:58.285192    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a6ba91-9nv9j"
Sep 11 13:12:58.285430 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:58.285232    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a6ba91-9nv9j" event={"ID":"ced161cb-f2e2-44f7-87c9-cc7c852ea0b3","Type":"ContainerDied","Data":"de3ea858b58ce41e842fed8cf331d174bc6d74a7df3c860eedc33ee99116622d"}
Sep 11 13:12:58.285430 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:12:58.285275    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de3ea858b58ce41e842fed8cf331d174bc6d74a7df3c860eedc33ee99116622d"
Sep 11 13:13:01.065883 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:01.065833    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:01.255009 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:01.254976    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:01.416513 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:01.416410    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:01.953080 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:01.953050    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:02.133252 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:02.133216    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:02.855468 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:02.855428    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:05.012251 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:05.012216    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:05.220539 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:05.220505    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:05.564494 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:05.564453    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:06.955599 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:06.955555    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:07.074591 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:07.074559    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:07.807274 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:07.807244    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:07.931974 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:07.931936    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:08.052185 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:08.052158    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1e58f711-794c846ffd-8c9pd"]
Sep 11 13:13:08.052549 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:08.052495    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ced161cb-f2e2-44f7-87c9-cc7c852ea0b3" containerName="revoke-keys"
Sep 11 13:13:08.052549 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:08.052505    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="ced161cb-f2e2-44f7-87c9-cc7c852ea0b3" containerName="revoke-keys"
Sep 11 13:13:08.052624 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:08.052576    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="ced161cb-f2e2-44f7-87c9-cc7c852ea0b3" containerName="revoke-keys"
Sep 11 13:13:08.055706 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:08.055686    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1e58f711-794c846ffd-8c9pd"
Sep 11 13:13:08.059038 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:08.058980    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-1e58f711\""
Sep 11 13:13:08.059455 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:08.059432    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-1e58f711-dockercfg-bc528\""
Sep 11 13:13:08.084984 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:08.084959    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1e58f711-794c846ffd-8c9pd"]
Sep 11 13:13:08.136602 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:08.136568    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3aa14221-a6c1-401c-a399-1ac103f5b07a-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1e58f711-794c846ffd-8c9pd\" (UID: \"3aa14221-a6c1-401c-a399-1ac103f5b07a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1e58f711-794c846ffd-8c9pd"
Sep 11 13:13:08.136773 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:08.136627    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2lhs\" (UniqueName: \"kubernetes.io/projected/3aa14221-a6c1-401c-a399-1ac103f5b07a-kube-api-access-d2lhs\") pod \"payload-pre-processing-e2e-mt-1e58f711-794c846ffd-8c9pd\" (UID: \"3aa14221-a6c1-401c-a399-1ac103f5b07a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1e58f711-794c846ffd-8c9pd"
Sep 11 13:13:08.237494 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:08.237460    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2lhs\" (UniqueName: \"kubernetes.io/projected/3aa14221-a6c1-401c-a399-1ac103f5b07a-kube-api-access-d2lhs\") pod \"payload-pre-processing-e2e-mt-1e58f711-794c846ffd-8c9pd\" (UID: \"3aa14221-a6c1-401c-a399-1ac103f5b07a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1e58f711-794c846ffd-8c9pd"
Sep 11 13:13:08.237644 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:08.237535    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3aa14221-a6c1-401c-a399-1ac103f5b07a-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1e58f711-794c846ffd-8c9pd\" (UID: \"3aa14221-a6c1-401c-a399-1ac103f5b07a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1e58f711-794c846ffd-8c9pd"
Sep 11 13:13:08.238194 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:08.238177    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3aa14221-a6c1-401c-a399-1ac103f5b07a-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1e58f711-794c846ffd-8c9pd\" (UID: \"3aa14221-a6c1-401c-a399-1ac103f5b07a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1e58f711-794c846ffd-8c9pd"
Sep 11 13:13:08.269304 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:08.269278    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2lhs\" (UniqueName: \"kubernetes.io/projected/3aa14221-a6c1-401c-a399-1ac103f5b07a-kube-api-access-d2lhs\") pod \"payload-pre-processing-e2e-mt-1e58f711-794c846ffd-8c9pd\" (UID: \"3aa14221-a6c1-401c-a399-1ac103f5b07a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1e58f711-794c846ffd-8c9pd"
Sep 11 13:13:08.366386 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:08.366299    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1e58f711-794c846ffd-8c9pd"
Sep 11 13:13:08.428500 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:08.428468    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:08.541619 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:08.541585    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-a6ba91-5699f887dc-bv6cq"]
Sep 11 13:13:08.541845 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:08.541819    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-a6ba91-5699f887dc-bv6cq" podUID="c6b5b119-96c1-4c0c-be2d-888cfc2695c7" containerName="payload-processing" containerID="cri-o://155d610a0aea9fb687c4d4fa73bcd5d71579d0ca6936e91d52147dc48aecaf40" gracePeriod=30
Sep 11 13:13:08.695313 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:08.695263    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1e58f711-794c846ffd-8c9pd"]
Sep 11 13:13:08.697406 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:13:08.697377    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aa14221_a6c1_401c_a399_1ac103f5b07a.slice/crio-af7ec60baa6346992e349f16a315ccb18ef2a0077b878096676916335d6dfff5 WatchSource:0}: Error finding container af7ec60baa6346992e349f16a315ccb18ef2a0077b878096676916335d6dfff5: Status 404 returned error can't find the container with id af7ec60baa6346992e349f16a315ccb18ef2a0077b878096676916335d6dfff5
Sep 11 13:13:08.755245 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:08.755219    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:08.810660 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:08.810637    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-a6ba91-5699f887dc-bv6cq"
Sep 11 13:13:08.894603 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:08.894551    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:08.943760 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:08.943663    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zm27\" (UniqueName: \"kubernetes.io/projected/c6b5b119-96c1-4c0c-be2d-888cfc2695c7-kube-api-access-2zm27\") pod \"c6b5b119-96c1-4c0c-be2d-888cfc2695c7\" (UID: \"c6b5b119-96c1-4c0c-be2d-888cfc2695c7\") "
Sep 11 13:13:08.943903 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:08.943811    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6b5b119-96c1-4c0c-be2d-888cfc2695c7-plugins-config-volume\") pod \"c6b5b119-96c1-4c0c-be2d-888cfc2695c7\" (UID: \"c6b5b119-96c1-4c0c-be2d-888cfc2695c7\") "
Sep 11 13:13:08.944220 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:08.944194    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6b5b119-96c1-4c0c-be2d-888cfc2695c7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c6b5b119-96c1-4c0c-be2d-888cfc2695c7" (UID: "c6b5b119-96c1-4c0c-be2d-888cfc2695c7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:13:08.946053 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:08.946033    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6b5b119-96c1-4c0c-be2d-888cfc2695c7-kube-api-access-2zm27" (OuterVolumeSpecName: "kube-api-access-2zm27") pod "c6b5b119-96c1-4c0c-be2d-888cfc2695c7" (UID: "c6b5b119-96c1-4c0c-be2d-888cfc2695c7"). InnerVolumeSpecName "kube-api-access-2zm27". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:13:08.950373 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:08.950352    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a6ba91-9nv9j"]
Sep 11 13:13:08.955527 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:08.955509    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a6ba91-9nv9j"]
Sep 11 13:13:09.045394 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:09.045364    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zm27\" (UniqueName: \"kubernetes.io/projected/c6b5b119-96c1-4c0c-be2d-888cfc2695c7-kube-api-access-2zm27\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:13:09.045394 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:09.045391    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6b5b119-96c1-4c0c-be2d-888cfc2695c7-plugins-config-volume\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:13:09.158558 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:09.158521    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:09.354003 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:09.353966    2547 generic.go:356] "Generic (PLEG): container finished" podID="c6b5b119-96c1-4c0c-be2d-888cfc2695c7" containerID="155d610a0aea9fb687c4d4fa73bcd5d71579d0ca6936e91d52147dc48aecaf40" exitCode=0
Sep 11 13:13:09.354180 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:09.354039    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-a6ba91-5699f887dc-bv6cq"
Sep 11 13:13:09.354180 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:09.354064    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-a6ba91-5699f887dc-bv6cq" event={"ID":"c6b5b119-96c1-4c0c-be2d-888cfc2695c7","Type":"ContainerDied","Data":"155d610a0aea9fb687c4d4fa73bcd5d71579d0ca6936e91d52147dc48aecaf40"}
Sep 11 13:13:09.354180 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:09.354156    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-a6ba91-5699f887dc-bv6cq" event={"ID":"c6b5b119-96c1-4c0c-be2d-888cfc2695c7","Type":"ContainerDied","Data":"4ec5c10369add97ecbde11246b7cfa7d81e6f8eb30f2d120ede96abd577554ee"}
Sep 11 13:13:09.354379 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:09.354187    2547 scope.go:117] "RemoveContainer" containerID="155d610a0aea9fb687c4d4fa73bcd5d71579d0ca6936e91d52147dc48aecaf40"
Sep 11 13:13:09.356101 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:09.356076    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1e58f711-794c846ffd-8c9pd" event={"ID":"3aa14221-a6c1-401c-a399-1ac103f5b07a","Type":"ContainerStarted","Data":"48b8255e2ed2606762fca45c7bb6df9f1e260ba2f609c6c09268ce2d32f0ee84"}
Sep 11 13:13:09.356225 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:09.356122    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1e58f711-794c846ffd-8c9pd" event={"ID":"3aa14221-a6c1-401c-a399-1ac103f5b07a","Type":"ContainerStarted","Data":"af7ec60baa6346992e349f16a315ccb18ef2a0077b878096676916335d6dfff5"}
Sep 11 13:13:09.356288 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:09.356242    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-1e58f711-794c846ffd-8c9pd"
Sep 11 13:13:09.367362 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:09.367340    2547 scope.go:117] "RemoveContainer" containerID="155d610a0aea9fb687c4d4fa73bcd5d71579d0ca6936e91d52147dc48aecaf40"
Sep 11 13:13:09.367920 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:13:09.367898    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"155d610a0aea9fb687c4d4fa73bcd5d71579d0ca6936e91d52147dc48aecaf40\": container with ID starting with 155d610a0aea9fb687c4d4fa73bcd5d71579d0ca6936e91d52147dc48aecaf40 not found: ID does not exist" containerID="155d610a0aea9fb687c4d4fa73bcd5d71579d0ca6936e91d52147dc48aecaf40"
Sep 11 13:13:09.368002 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:09.367931    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"155d610a0aea9fb687c4d4fa73bcd5d71579d0ca6936e91d52147dc48aecaf40"} err="failed to get container status \"155d610a0aea9fb687c4d4fa73bcd5d71579d0ca6936e91d52147dc48aecaf40\": rpc error: code = NotFound desc = could not find container \"155d610a0aea9fb687c4d4fa73bcd5d71579d0ca6936e91d52147dc48aecaf40\": container with ID starting with 155d610a0aea9fb687c4d4fa73bcd5d71579d0ca6936e91d52147dc48aecaf40 not found: ID does not exist"
Sep 11 13:13:09.410207 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:09.410159    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-1e58f711-794c846ffd-8c9pd" podStartSLOduration=1.410144838 podStartE2EDuration="1.410144838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:13:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:13:09.40873891 +0000 UTC m=+1056.270213092" watchObservedRunningTime="2026-09-11 13:13:09.410144838 +0000 UTC m=+1056.271619026"
Sep 11 13:13:09.438914 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:09.438881    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-a6ba91-5699f887dc-bv6cq"]
Sep 11 13:13:09.446794 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:09.446738    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-a6ba91-5699f887dc-bv6cq"]
Sep 11 13:13:09.447293 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:09.447268    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:09.664651 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:09.664619    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6b5b119-96c1-4c0c-be2d-888cfc2695c7" path="/var/lib/kubelet/pods/c6b5b119-96c1-4c0c-be2d-888cfc2695c7/volumes"
Sep 11 13:13:09.664963 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:09.664951    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ced161cb-f2e2-44f7-87c9-cc7c852ea0b3" path="/var/lib/kubelet/pods/ced161cb-f2e2-44f7-87c9-cc7c852ea0b3/volumes"
Sep 11 13:13:09.728075 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:09.728013    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-inf-b-a6ba91-5699f887dc-bv6cq" podUID="c6b5b119-96c1-4c0c-be2d-888cfc2695c7" containerName="payload-processing" probeResult="failure" output="dial tcp 10.133.0.54:9004: i/o timeout"
Sep 11 13:13:10.092335 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:10.092298    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:11.638871 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:11.638839    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:17.861587 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:17.861539    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:18.028763 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:18.028728    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:18.207517 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:18.207430    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:18.815924 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:18.815887    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:19.143990 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.143909    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"]
Sep 11 13:13:19.144509 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.144486    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6b5b119-96c1-4c0c-be2d-888cfc2695c7" containerName="payload-processing"
Sep 11 13:13:19.144612 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.144512    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6b5b119-96c1-4c0c-be2d-888cfc2695c7" containerName="payload-processing"
Sep 11 13:13:19.144672 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.144659    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6b5b119-96c1-4c0c-be2d-888cfc2695c7" containerName="payload-processing"
Sep 11 13:13:19.149112 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.149093    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:19.159251 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.159233    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-1841da-openshift-default-dockercfg-vjjs8\""
Sep 11 13:13:19.169895 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.169870    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 13:13:19.186389 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.186360    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"]
Sep 11 13:13:19.263110 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.263080    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:19.338630 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.338598    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bc48f20-9192-477b-b5f7-24cf7b942b18-workload-certs\") pod \"e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") " pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:19.338823 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.338649    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bc48f20-9192-477b-b5f7-24cf7b942b18-istio-data\") pod \"e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") " pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:19.338823 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.338733    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bc48f20-9192-477b-b5f7-24cf7b942b18-istio-envoy\") pod \"e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") " pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:19.338823 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.338767    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bc48f20-9192-477b-b5f7-24cf7b942b18-istiod-ca-cert\") pod \"e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") " pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:19.338823 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.338802    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bc48f20-9192-477b-b5f7-24cf7b942b18-istio-podinfo\") pod \"e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") " pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:19.338823 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.338821    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7mrr\" (UniqueName: \"kubernetes.io/projected/2bc48f20-9192-477b-b5f7-24cf7b942b18-kube-api-access-f7mrr\") pod \"e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") " pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:19.339025 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.338871    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bc48f20-9192-477b-b5f7-24cf7b942b18-workload-socket\") pod \"e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") " pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:19.339025 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.338917    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bc48f20-9192-477b-b5f7-24cf7b942b18-credential-socket\") pod \"e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") " pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:19.339025 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.338958    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bc48f20-9192-477b-b5f7-24cf7b942b18-istio-token\") pod \"e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") " pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:19.409772 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.409670    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:19.439489 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.439459    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bc48f20-9192-477b-b5f7-24cf7b942b18-istio-envoy\") pod \"e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") " pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:19.439660 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.439494    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bc48f20-9192-477b-b5f7-24cf7b942b18-istiod-ca-cert\") pod \"e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") " pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:19.439660 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.439522    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bc48f20-9192-477b-b5f7-24cf7b942b18-istio-podinfo\") pod \"e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") " pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:19.439660 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.439640    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7mrr\" (UniqueName: \"kubernetes.io/projected/2bc48f20-9192-477b-b5f7-24cf7b942b18-kube-api-access-f7mrr\") pod \"e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") " pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:19.439879 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.439685    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bc48f20-9192-477b-b5f7-24cf7b942b18-workload-socket\") pod \"e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") " pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:19.439879 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.439745    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bc48f20-9192-477b-b5f7-24cf7b942b18-credential-socket\") pod \"e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") " pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:19.439879 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.439803    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bc48f20-9192-477b-b5f7-24cf7b942b18-istio-token\") pod \"e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") " pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:19.439879 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.439833    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bc48f20-9192-477b-b5f7-24cf7b942b18-workload-certs\") pod \"e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") " pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:19.440096 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.439900    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bc48f20-9192-477b-b5f7-24cf7b942b18-istio-data\") pod \"e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") " pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:19.440096 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.440027    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bc48f20-9192-477b-b5f7-24cf7b942b18-workload-socket\") pod \"e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") " pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:19.440261 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.440239    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bc48f20-9192-477b-b5f7-24cf7b942b18-istio-data\") pod \"e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") " pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:19.440491 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.440277    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bc48f20-9192-477b-b5f7-24cf7b942b18-workload-certs\") pod \"e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") " pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:19.440491 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.440313    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bc48f20-9192-477b-b5f7-24cf7b942b18-credential-socket\") pod \"e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") " pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:19.440491 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.440334    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bc48f20-9192-477b-b5f7-24cf7b942b18-istiod-ca-cert\") pod \"e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") " pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:19.442120 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.442098    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bc48f20-9192-477b-b5f7-24cf7b942b18-istio-envoy\") pod \"e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") " pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:19.442243 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.442229    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bc48f20-9192-477b-b5f7-24cf7b942b18-istio-podinfo\") pod \"e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") " pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:19.463786 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.463763    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bc48f20-9192-477b-b5f7-24cf7b942b18-istio-token\") pod \"e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") " pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:19.467034 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.467006    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7mrr\" (UniqueName: \"kubernetes.io/projected/2bc48f20-9192-477b-b5f7-24cf7b942b18-kube-api-access-f7mrr\") pod \"e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") " pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:19.760409 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:19.760325    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:20.080965 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:20.080941    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"]
Sep 11 13:13:20.083249 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:13:20.083222    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bc48f20_9192_477b_b5f7_24cf7b942b18.slice/crio-86ac48a3f8beb66dae3e5ffbdc10e5d53fd40f1897bdb0e7abc341cac82ee967 WatchSource:0}: Error finding container 86ac48a3f8beb66dae3e5ffbdc10e5d53fd40f1897bdb0e7abc341cac82ee967: Status 404 returned error can't find the container with id 86ac48a3f8beb66dae3e5ffbdc10e5d53fd40f1897bdb0e7abc341cac82ee967
Sep 11 13:13:20.085182 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:20.085163    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 13:13:20.365526 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:20.365447    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-1e58f711-794c846ffd-8c9pd"
Sep 11 13:13:20.420782 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:20.420748    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm" event={"ID":"2bc48f20-9192-477b-b5f7-24cf7b942b18","Type":"ContainerStarted","Data":"86ac48a3f8beb66dae3e5ffbdc10e5d53fd40f1897bdb0e7abc341cac82ee967"}
Sep 11 13:13:22.866702 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:22.866658    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:13:22.867114 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:22.866782    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:13:22.867114 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:22.866836    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:13:23.441003 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:23.440969    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm" event={"ID":"2bc48f20-9192-477b-b5f7-24cf7b942b18","Type":"ContainerStarted","Data":"9a9b7c1848f280cc870f65861dc6a00431b34664f51b9decd9135058acf5c4e5"}
Sep 11 13:13:23.495030 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:23.494969    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm" podStartSLOduration=1.713983504 podStartE2EDuration="4.494953226s" totalImagesPullingTime="2.780969722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:13:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:13:23.49305257 +0000 UTC m=+1070.354526760" watchObservedRunningTime="2026-09-11 13:13:23.494953226 +0000 UTC m=+1070.356427413"
Sep 11 13:13:23.761405 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:23.761317    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:23.766725 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:23.766686    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:24.446359 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:24.446326    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:24.447248 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:24.447229    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:24.891317 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:24.891281    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:25.715669 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:25.715632    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:25.952525 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:25.952483    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:26.322567 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:26.322533    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:27.675250 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:27.675216    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:27.849405 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:27.849371    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:28.010215 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:28.010118    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:28.574254 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:28.574206    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:28.797589 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:28.797558    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:28.945654 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:28.945571    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf"]
Sep 11 13:13:28.949439 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:28.949422    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf"
Sep 11 13:13:28.961332 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:13:28.961293    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf\" is forbidden: User \"system:node:ip-10-0-133-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-133-79.ec2.internal' and this object" podUID="f8e4400f-71aa-462f-a054-7f24fe710d8b" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf"
Sep 11 13:13:28.961332 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:13:28.961320    2547 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"payload-processing-e2e-shared-a-w3-1841da-dockercfg-s2bn5\" is forbidden: User \"system:node:ip-10-0-133-79.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-133-79.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-1841da-dockercfg-s2bn5\"" type="*v1.Secret"
Sep 11 13:13:28.969299 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:13:28.969265    2547 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"payload-processing-plugins-e2e-shared-a-w3-1841da\" is forbidden: User \"system:node:ip-10-0-133-79.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-133-79.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-1841da\"" type="*v1.ConfigMap"
Sep 11 13:13:29.017666 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:29.017629    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8e4400f-71aa-462f-a054-7f24fe710d8b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf\" (UID: \"f8e4400f-71aa-462f-a054-7f24fe710d8b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf"
Sep 11 13:13:29.017833 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:29.017726    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ldth\" (UniqueName: \"kubernetes.io/projected/f8e4400f-71aa-462f-a054-7f24fe710d8b-kube-api-access-5ldth\") pod \"payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf\" (UID: \"f8e4400f-71aa-462f-a054-7f24fe710d8b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf"
Sep 11 13:13:29.029965 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:29.029927    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf"]
Sep 11 13:13:29.118928 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:29.118888    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8e4400f-71aa-462f-a054-7f24fe710d8b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf\" (UID: \"f8e4400f-71aa-462f-a054-7f24fe710d8b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf"
Sep 11 13:13:29.119164 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:29.118948    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ldth\" (UniqueName: \"kubernetes.io/projected/f8e4400f-71aa-462f-a054-7f24fe710d8b-kube-api-access-5ldth\") pod \"payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf\" (UID: \"f8e4400f-71aa-462f-a054-7f24fe710d8b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf"
Sep 11 13:13:29.138956 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:29.138922    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ldth\" (UniqueName: \"kubernetes.io/projected/f8e4400f-71aa-462f-a054-7f24fe710d8b-kube-api-access-5ldth\") pod \"payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf\" (UID: \"f8e4400f-71aa-462f-a054-7f24fe710d8b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf"
Sep 11 13:13:29.633008 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:29.632973    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:29.870448 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:29.870412    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-1841da\""
Sep 11 13:13:29.880518 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:29.880486    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8e4400f-71aa-462f-a054-7f24fe710d8b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf\" (UID: \"f8e4400f-71aa-462f-a054-7f24fe710d8b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf"
Sep 11 13:13:30.026981 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:30.026891    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:30.306432 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:30.306402    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-1841da-dockercfg-s2bn5\""
Sep 11 13:13:30.310767 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:30.310743    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf"
Sep 11 13:13:30.620555 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:30.620525    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf"]
Sep 11 13:13:30.622449 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:13:30.622418    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8e4400f_71aa_462f_a054_7f24fe710d8b.slice/crio-c998e2c001d5777a2e7c5a5c38c1ec12d0d2ed4b67e7ed328226f84068c489f6 WatchSource:0}: Error finding container c998e2c001d5777a2e7c5a5c38c1ec12d0d2ed4b67e7ed328226f84068c489f6: Status 404 returned error can't find the container with id c998e2c001d5777a2e7c5a5c38c1ec12d0d2ed4b67e7ed328226f84068c489f6
Sep 11 13:13:30.795613 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:30.795574    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:30.968632 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:30.968522    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:31.286822 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:31.286705    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:31.488961 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:31.488929    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf" event={"ID":"f8e4400f-71aa-462f-a054-7f24fe710d8b","Type":"ContainerStarted","Data":"d318fa3a67f5c4233155c8459241c2ddaa43e7e751b991314b190f110c300d0f"}
Sep 11 13:13:31.489148 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:31.488981    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf" event={"ID":"f8e4400f-71aa-462f-a054-7f24fe710d8b","Type":"ContainerStarted","Data":"c998e2c001d5777a2e7c5a5c38c1ec12d0d2ed4b67e7ed328226f84068c489f6"}
Sep 11 13:13:31.489148 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:31.489027    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf"
Sep 11 13:13:31.538625 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:31.538497    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf" podStartSLOduration=3.538477793 podStartE2EDuration="3.538477793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:13:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:13:31.536259117 +0000 UTC m=+1078.397733306" watchObservedRunningTime="2026-09-11 13:13:31.538477793 +0000 UTC m=+1078.399952035"
Sep 11 13:13:31.644069 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:31.644031    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:33.208749 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:33.208611    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:36.472826 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:36.472786    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:38.007513 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:38.007474    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:38.139823 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:38.139779    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:38.570442 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:38.570410    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:38.747014 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:38.746958    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:39.303228 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:39.303136    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:40.488941 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:40.488888    2547 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 13:13:40.489387 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:40.488983    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm" podUID="2bc48f20-9192-477b-b5f7-24cf7b942b18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 13:13:40.514516 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:40.514472    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:41.736625 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:41.736579    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:42.497609 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:42.497580    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf"
Sep 11 13:13:42.558637 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:42.558605    2547 generic.go:356] "Generic (PLEG): container finished" podID="2bc48f20-9192-477b-b5f7-24cf7b942b18" containerID="9a9b7c1848f280cc870f65861dc6a00431b34664f51b9decd9135058acf5c4e5" exitCode=0
Sep 11 13:13:42.558831 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:42.558682    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm" event={"ID":"2bc48f20-9192-477b-b5f7-24cf7b942b18","Type":"ContainerDied","Data":"9a9b7c1848f280cc870f65861dc6a00431b34664f51b9decd9135058acf5c4e5"}
Sep 11 13:13:42.559195 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:42.559178    2547 scope.go:117] "RemoveContainer" containerID="9a9b7c1848f280cc870f65861dc6a00431b34664f51b9decd9135058acf5c4e5"
Sep 11 13:13:42.560467 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:42.560436    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:13:42.560557 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:42.560509    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:13:42.560557 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:42.560543    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:13:43.050610 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:43.050573    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:43.575597 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:43.575556    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm" event={"ID":"2bc48f20-9192-477b-b5f7-24cf7b942b18","Type":"ContainerStarted","Data":"fe48c98f0c1bc31335ae73f9e1825656a3073efb819710b55450250f40f47785"}
Sep 11 13:13:43.761143 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:43.761105    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:43.761473 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:43.761435    2547 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 11 13:13:43.761705 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:43.761678    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm" podUID="2bc48f20-9192-477b-b5f7-24cf7b942b18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 11 13:13:44.615707 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:44.615671    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:44.761941 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:44.761899    2547 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 11 13:13:44.762263 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:44.762233    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm" podUID="2bc48f20-9192-477b-b5f7-24cf7b942b18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 11 13:13:45.461546 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:45.461502    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:45.761490 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:45.761382    2547 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 11 13:13:45.762149 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:45.762114    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm" podUID="2bc48f20-9192-477b-b5f7-24cf7b942b18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 11 13:13:45.821203 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:45.821167    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:46.058428 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.058357    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:46.198480 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.198442    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"]
Sep 11 13:13:46.201074 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.201052    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:46.204132 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.204109    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-82825f-openshift-default-dockercfg-8cr74\""
Sep 11 13:13:46.225347 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.225312    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"]
Sep 11 13:13:46.261875 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.261836    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:46.293363 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.293320    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-istio-podinfo\") pod \"e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") " pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:46.293363 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.293368    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-istio-data\") pod \"e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") " pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:46.293654 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.293447    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-workload-certs\") pod \"e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") " pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:46.293654 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.293488    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-istiod-ca-cert\") pod \"e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") " pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:46.293654 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.293531    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-credential-socket\") pod \"e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") " pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:46.293654 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.293569    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5gx2\" (UniqueName: \"kubernetes.io/projected/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-kube-api-access-c5gx2\") pod \"e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") " pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:46.293654 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.293617    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-workload-socket\") pod \"e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") " pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:46.293654 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.293632    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-istio-token\") pod \"e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") " pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:46.293654 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.293649    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-istio-envoy\") pod \"e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") " pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:46.394421 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.394318    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-istio-podinfo\") pod \"e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") " pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:46.394421 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.394368    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-istio-data\") pod \"e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") " pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:46.394421 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.394403    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-workload-certs\") pod \"e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") " pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:46.394421 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.394419    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-istiod-ca-cert\") pod \"e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") " pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:46.394813 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.394445    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-credential-socket\") pod \"e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") " pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:46.394813 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.394476    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5gx2\" (UniqueName: \"kubernetes.io/projected/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-kube-api-access-c5gx2\") pod \"e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") " pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:46.394813 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.394624    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-workload-socket\") pod \"e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") " pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:46.394813 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.394667    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-istio-token\") pod \"e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") " pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:46.394813 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.394699    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-istio-envoy\") pod \"e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") " pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:46.395097 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.394912    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-workload-certs\") pod \"e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") " pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:46.395097 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.394960    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-credential-socket\") pod \"e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") " pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:46.395097 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.395068    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-workload-socket\") pod \"e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") " pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:46.395311 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.395290    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-istiod-ca-cert\") pod \"e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") " pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:46.395376 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.395333    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-istio-data\") pod \"e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") " pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:46.397173 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.397151    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-istio-envoy\") pod \"e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") " pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:46.397173 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.397169    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-istio-podinfo\") pod \"e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") " pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:46.410410 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.410381    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-istio-token\") pod \"e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") " pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:46.410568 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.410550    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5gx2\" (UniqueName: \"kubernetes.io/projected/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-kube-api-access-c5gx2\") pod \"e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") " pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:46.511932 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.511886    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:46.765279 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.765165    2547 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 11 13:13:46.765279 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.765232    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm" podUID="2bc48f20-9192-477b-b5f7-24cf7b942b18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 11 13:13:46.825744 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.825701    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"]
Sep 11 13:13:46.827908 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:13:46.827878    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd735ca6d_078b_4cd3_ae5e_a7ceec5bbd49.slice/crio-326e29df22dea05d3a7a3add7c69dc5d7c24bce5a7299ca7198b02826a226e14 WatchSource:0}: Error finding container 326e29df22dea05d3a7a3add7c69dc5d7c24bce5a7299ca7198b02826a226e14: Status 404 returned error can't find the container with id 326e29df22dea05d3a7a3add7c69dc5d7c24bce5a7299ca7198b02826a226e14
Sep 11 13:13:46.830384 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.830350    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:13:46.830470 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.830420    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:13:46.830470 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:46.830447    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:13:47.149576 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:47.149533    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:47.417498 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:47.417400    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:47.609784 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:47.609745    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds" event={"ID":"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49","Type":"ContainerStarted","Data":"ce51b8a3276c9ddd39cba7833ff813fd2c1cdd79aac37f5591a1e0f094608a7a"}
Sep 11 13:13:47.609978 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:47.609826    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds" event={"ID":"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49","Type":"ContainerStarted","Data":"326e29df22dea05d3a7a3add7c69dc5d7c24bce5a7299ca7198b02826a226e14"}
Sep 11 13:13:47.654309 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:47.654231    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds" podStartSLOduration=1.6542075299999999 podStartE2EDuration="1.65420753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:13:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:13:47.652339724 +0000 UTC m=+1094.513813936" watchObservedRunningTime="2026-09-11 13:13:47.65420753 +0000 UTC m=+1094.515681717"
Sep 11 13:13:47.761632 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:47.761514    2547 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 11 13:13:47.761632 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:47.761597    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm" podUID="2bc48f20-9192-477b-b5f7-24cf7b942b18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 11 13:13:48.512360 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:48.512321    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:48.518285 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:48.518253    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:48.616257 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:48.616226    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:48.617435 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:48.617407    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:13:48.764452 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:48.764366    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:48.764679 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:48.764654    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:48.765375 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:48.765360    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:13:49.675306 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:49.675269    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:49.781202 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:49.781166    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:50.867504 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:50.867438    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:51.645813 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:51.645776    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:51.700809 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:51.700776    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1e58f711-794c846ffd-8c9pd"]
Sep 11 13:13:51.701012 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:51.700991    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-1e58f711-794c846ffd-8c9pd" podUID="3aa14221-a6c1-401c-a399-1ac103f5b07a" containerName="payload-pre-processing" containerID="cri-o://48b8255e2ed2606762fca45c7bb6df9f1e260ba2f609c6c09268ce2d32f0ee84" gracePeriod=30
Sep 11 13:13:51.756915 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:51.756874    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:51.872883 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:51.872844    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:51.954865 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:51.954841    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1e58f711-794c846ffd-8c9pd"
Sep 11 13:13:51.989786 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:51.989693    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:52.050321 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:52.050275    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2lhs\" (UniqueName: \"kubernetes.io/projected/3aa14221-a6c1-401c-a399-1ac103f5b07a-kube-api-access-d2lhs\") pod \"3aa14221-a6c1-401c-a399-1ac103f5b07a\" (UID: \"3aa14221-a6c1-401c-a399-1ac103f5b07a\") "
Sep 11 13:13:52.050482 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:52.050397    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3aa14221-a6c1-401c-a399-1ac103f5b07a-plugins-config-volume\") pod \"3aa14221-a6c1-401c-a399-1ac103f5b07a\" (UID: \"3aa14221-a6c1-401c-a399-1ac103f5b07a\") "
Sep 11 13:13:52.050806 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:52.050783    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3aa14221-a6c1-401c-a399-1ac103f5b07a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3aa14221-a6c1-401c-a399-1ac103f5b07a" (UID: "3aa14221-a6c1-401c-a399-1ac103f5b07a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:13:52.052682 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:52.052661    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3aa14221-a6c1-401c-a399-1ac103f5b07a-kube-api-access-d2lhs" (OuterVolumeSpecName: "kube-api-access-d2lhs") pod "3aa14221-a6c1-401c-a399-1ac103f5b07a" (UID: "3aa14221-a6c1-401c-a399-1ac103f5b07a"). InnerVolumeSpecName "kube-api-access-d2lhs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:13:52.072403 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:52.072367    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:52.152262 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:52.152222    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3aa14221-a6c1-401c-a399-1ac103f5b07a-plugins-config-volume\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:13:52.152262 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:52.152255    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2lhs\" (UniqueName: \"kubernetes.io/projected/3aa14221-a6c1-401c-a399-1ac103f5b07a-kube-api-access-d2lhs\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:13:52.159254 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:52.159220    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:52.374004 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:52.373968    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:52.520892 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:52.520858    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:52.641920 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:52.641831    2547 generic.go:356] "Generic (PLEG): container finished" podID="3aa14221-a6c1-401c-a399-1ac103f5b07a" containerID="48b8255e2ed2606762fca45c7bb6df9f1e260ba2f609c6c09268ce2d32f0ee84" exitCode=0
Sep 11 13:13:52.641920 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:52.641891    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1e58f711-794c846ffd-8c9pd"
Sep 11 13:13:52.642128 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:52.641920    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1e58f711-794c846ffd-8c9pd" event={"ID":"3aa14221-a6c1-401c-a399-1ac103f5b07a","Type":"ContainerDied","Data":"48b8255e2ed2606762fca45c7bb6df9f1e260ba2f609c6c09268ce2d32f0ee84"}
Sep 11 13:13:52.642128 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:52.641981    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1e58f711-794c846ffd-8c9pd" event={"ID":"3aa14221-a6c1-401c-a399-1ac103f5b07a","Type":"ContainerDied","Data":"af7ec60baa6346992e349f16a315ccb18ef2a0077b878096676916335d6dfff5"}
Sep 11 13:13:52.642128 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:52.642011    2547 scope.go:117] "RemoveContainer" containerID="48b8255e2ed2606762fca45c7bb6df9f1e260ba2f609c6c09268ce2d32f0ee84"
Sep 11 13:13:52.651824 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:52.651806    2547 scope.go:117] "RemoveContainer" containerID="48b8255e2ed2606762fca45c7bb6df9f1e260ba2f609c6c09268ce2d32f0ee84"
Sep 11 13:13:52.652131 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:13:52.652110    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48b8255e2ed2606762fca45c7bb6df9f1e260ba2f609c6c09268ce2d32f0ee84\": container with ID starting with 48b8255e2ed2606762fca45c7bb6df9f1e260ba2f609c6c09268ce2d32f0ee84 not found: ID does not exist" containerID="48b8255e2ed2606762fca45c7bb6df9f1e260ba2f609c6c09268ce2d32f0ee84"
Sep 11 13:13:52.652213 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:52.652140    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48b8255e2ed2606762fca45c7bb6df9f1e260ba2f609c6c09268ce2d32f0ee84"} err="failed to get container status \"48b8255e2ed2606762fca45c7bb6df9f1e260ba2f609c6c09268ce2d32f0ee84\": rpc error: code = NotFound desc = could not find container \"48b8255e2ed2606762fca45c7bb6df9f1e260ba2f609c6c09268ce2d32f0ee84\": container with ID starting with 48b8255e2ed2606762fca45c7bb6df9f1e260ba2f609c6c09268ce2d32f0ee84 not found: ID does not exist"
Sep 11 13:13:52.674938 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:52.674902    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1e58f711-794c846ffd-8c9pd"]
Sep 11 13:13:52.693231 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:52.693195    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1e58f711-794c846ffd-8c9pd"]
Sep 11 13:13:52.923539 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:52.923433    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:53.044403 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:53.044365    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:53.502831 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:53.502782    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:53.664556 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:53.664522    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3aa14221-a6c1-401c-a399-1ac103f5b07a" path="/var/lib/kubelet/pods/3aa14221-a6c1-401c-a399-1ac103f5b07a/volumes"
Sep 11 13:13:54.470058 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:54.470016    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:55.247682 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:55.247645    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:59.156964 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:59.156924    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:59.310521 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:59.310476    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:59.503261 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:59.503164    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:59.870023 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:13:59.869985    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:00.000551 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:00.000513    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:00.115663 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:00.115618    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:05.900510 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:05.900457    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:06.014391 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:06.014346    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:06.101102 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:06.101064    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:06.429082 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:06.429046    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:08.746565 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:08.746524    2547 generic.go:356] "Generic (PLEG): container finished" podID="d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49" containerID="ce51b8a3276c9ddd39cba7833ff813fd2c1cdd79aac37f5591a1e0f094608a7a" exitCode=0
Sep 11 13:14:08.747069 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:08.746597    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds" event={"ID":"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49","Type":"ContainerDied","Data":"ce51b8a3276c9ddd39cba7833ff813fd2c1cdd79aac37f5591a1e0f094608a7a"}
Sep 11 13:14:08.747069 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:08.747060    2547 scope.go:117] "RemoveContainer" containerID="ce51b8a3276c9ddd39cba7833ff813fd2c1cdd79aac37f5591a1e0f094608a7a"
Sep 11 13:14:08.748238 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:08.748207    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:14:08.748318 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:08.748301    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:14:08.748374 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:08.748361    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:14:09.765050 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:09.765004    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds" event={"ID":"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49","Type":"ContainerStarted","Data":"e1efc2e08df56a3d0dc2d72968389dcd4eafdde666e29a1b11f89765fa773dd7"}
Sep 11 13:14:10.512250 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:10.512210    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:14:10.512510 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:10.512487    2547 patch_prober.go:28] interesting pod/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 11 13:14:10.512560 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:10.512543    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds" podUID="d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 11 13:14:11.513139 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:11.513088    2547 patch_prober.go:28] interesting pod/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 11 13:14:11.513640 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:11.513159    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds" podUID="d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 11 13:14:12.512936 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:12.512897    2547 patch_prober.go:28] interesting pod/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 11 13:14:12.513130 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:12.512972    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds" podUID="d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 11 13:14:13.512961 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:13.512923    2547 patch_prober.go:28] interesting pod/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 11 13:14:13.513446 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:13.512988    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds" podUID="d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 11 13:14:14.327885 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:14.327841    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:14.512914 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:14.512873    2547 patch_prober.go:28] interesting pod/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 11 13:14:14.513105 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:14.512934    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds" podUID="d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 11 13:14:14.664729 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:14.664613    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:15.473631 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:15.473598    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:15.517247 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:15.517211    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:14:15.517761 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:15.517607    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:14:15.518371 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:15.518349    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:14:16.032971 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:16.032933    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:16.167843 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:16.167800    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:16.300834 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:16.300710    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:17.428766 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:17.428707    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:18.822829 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:18.822783    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:19.391598 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:19.391558    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:19.579888 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:19.579850    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:19.823845 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:19.823812    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:20.288312 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:20.288215    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:22.245323 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:22.245286    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:22.590492 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:22.590459    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"]
Sep 11 13:14:22.590866 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:22.590852    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3aa14221-a6c1-401c-a399-1ac103f5b07a" containerName="payload-pre-processing"
Sep 11 13:14:22.590915 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:22.590867    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="3aa14221-a6c1-401c-a399-1ac103f5b07a" containerName="payload-pre-processing"
Sep 11 13:14:22.590959 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:22.590950    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="3aa14221-a6c1-401c-a399-1ac103f5b07a" containerName="payload-pre-processing"
Sep 11 13:14:22.592996 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:22.592976    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"
Sep 11 13:14:22.603536 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:22.603508    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-1841da\"/\"kube-root-ca.crt\""
Sep 11 13:14:22.604298 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:22.604279    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-1841da\"/\"default-dockercfg-9nsw8\""
Sep 11 13:14:22.604401 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:22.604287    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-1841da\"/\"openshift-service-ca.crt\""
Sep 11 13:14:22.604401 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:22.604388    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-1841da\"/\"auth-test-model-1841da-kserve-self-signed-certs\""
Sep 11 13:14:22.631285 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:22.631246    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"]
Sep 11 13:14:22.666612 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:22.666534    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed34e897-1452-4d52-80d2-4a7884345b65-home\") pod \"auth-test-model-1841da-kserve-65f996569f-dtmr4\" (UID: \"ed34e897-1452-4d52-80d2-4a7884345b65\") " pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"
Sep 11 13:14:22.666857 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:22.666681    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed34e897-1452-4d52-80d2-4a7884345b65-model-cache\") pod \"auth-test-model-1841da-kserve-65f996569f-dtmr4\" (UID: \"ed34e897-1452-4d52-80d2-4a7884345b65\") " pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"
Sep 11 13:14:22.666857 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:22.666783    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed34e897-1452-4d52-80d2-4a7884345b65-dshm\") pod \"auth-test-model-1841da-kserve-65f996569f-dtmr4\" (UID: \"ed34e897-1452-4d52-80d2-4a7884345b65\") " pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"
Sep 11 13:14:22.666996 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:22.666885    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed34e897-1452-4d52-80d2-4a7884345b65-tmp-dir\") pod \"auth-test-model-1841da-kserve-65f996569f-dtmr4\" (UID: \"ed34e897-1452-4d52-80d2-4a7884345b65\") " pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"
Sep 11 13:14:22.666996 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:22.666921    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j4w4\" (UniqueName: \"kubernetes.io/projected/ed34e897-1452-4d52-80d2-4a7884345b65-kube-api-access-7j4w4\") pod \"auth-test-model-1841da-kserve-65f996569f-dtmr4\" (UID: \"ed34e897-1452-4d52-80d2-4a7884345b65\") " pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"
Sep 11 13:14:22.667101 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:22.666993    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed34e897-1452-4d52-80d2-4a7884345b65-tls-certs\") pod \"auth-test-model-1841da-kserve-65f996569f-dtmr4\" (UID: \"ed34e897-1452-4d52-80d2-4a7884345b65\") " pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"
Sep 11 13:14:22.668231 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:22.668204    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:22.768279 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:22.768240    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed34e897-1452-4d52-80d2-4a7884345b65-home\") pod \"auth-test-model-1841da-kserve-65f996569f-dtmr4\" (UID: \"ed34e897-1452-4d52-80d2-4a7884345b65\") " pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"
Sep 11 13:14:22.768465 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:22.768292    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed34e897-1452-4d52-80d2-4a7884345b65-model-cache\") pod \"auth-test-model-1841da-kserve-65f996569f-dtmr4\" (UID: \"ed34e897-1452-4d52-80d2-4a7884345b65\") " pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"
Sep 11 13:14:22.768556 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:22.768527    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed34e897-1452-4d52-80d2-4a7884345b65-dshm\") pod \"auth-test-model-1841da-kserve-65f996569f-dtmr4\" (UID: \"ed34e897-1452-4d52-80d2-4a7884345b65\") " pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"
Sep 11 13:14:22.768658 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:22.768641    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed34e897-1452-4d52-80d2-4a7884345b65-model-cache\") pod \"auth-test-model-1841da-kserve-65f996569f-dtmr4\" (UID: \"ed34e897-1452-4d52-80d2-4a7884345b65\") " pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"
Sep 11 13:14:22.768752 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:22.768653    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed34e897-1452-4d52-80d2-4a7884345b65-tmp-dir\") pod \"auth-test-model-1841da-kserve-65f996569f-dtmr4\" (UID: \"ed34e897-1452-4d52-80d2-4a7884345b65\") " pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"
Sep 11 13:14:22.768752 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:22.768691    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed34e897-1452-4d52-80d2-4a7884345b65-home\") pod \"auth-test-model-1841da-kserve-65f996569f-dtmr4\" (UID: \"ed34e897-1452-4d52-80d2-4a7884345b65\") " pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"
Sep 11 13:14:22.768752 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:22.768705    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j4w4\" (UniqueName: \"kubernetes.io/projected/ed34e897-1452-4d52-80d2-4a7884345b65-kube-api-access-7j4w4\") pod \"auth-test-model-1841da-kserve-65f996569f-dtmr4\" (UID: \"ed34e897-1452-4d52-80d2-4a7884345b65\") " pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"
Sep 11 13:14:22.768917 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:22.768818    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed34e897-1452-4d52-80d2-4a7884345b65-tls-certs\") pod \"auth-test-model-1841da-kserve-65f996569f-dtmr4\" (UID: \"ed34e897-1452-4d52-80d2-4a7884345b65\") " pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"
Sep 11 13:14:22.768978 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:22.768948    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed34e897-1452-4d52-80d2-4a7884345b65-tmp-dir\") pod \"auth-test-model-1841da-kserve-65f996569f-dtmr4\" (UID: \"ed34e897-1452-4d52-80d2-4a7884345b65\") " pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"
Sep 11 13:14:22.771112 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:22.771085    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed34e897-1452-4d52-80d2-4a7884345b65-dshm\") pod \"auth-test-model-1841da-kserve-65f996569f-dtmr4\" (UID: \"ed34e897-1452-4d52-80d2-4a7884345b65\") " pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"
Sep 11 13:14:22.771404 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:22.771387    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed34e897-1452-4d52-80d2-4a7884345b65-tls-certs\") pod \"auth-test-model-1841da-kserve-65f996569f-dtmr4\" (UID: \"ed34e897-1452-4d52-80d2-4a7884345b65\") " pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"
Sep 11 13:14:22.781188 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:22.781159    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j4w4\" (UniqueName: \"kubernetes.io/projected/ed34e897-1452-4d52-80d2-4a7884345b65-kube-api-access-7j4w4\") pod \"auth-test-model-1841da-kserve-65f996569f-dtmr4\" (UID: \"ed34e897-1452-4d52-80d2-4a7884345b65\") " pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"
Sep 11 13:14:22.903380 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:22.903278    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"
Sep 11 13:14:23.188139 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:23.188113    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"]
Sep 11 13:14:23.188918 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:14:23.188890    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded34e897_1452_4d52_80d2_4a7884345b65.slice/crio-05d0494300de62e869b113a7eb7ab1e8a9772e472912058d307b38d8576d242b WatchSource:0}: Error finding container 05d0494300de62e869b113a7eb7ab1e8a9772e472912058d307b38d8576d242b: Status 404 returned error can't find the container with id 05d0494300de62e869b113a7eb7ab1e8a9772e472912058d307b38d8576d242b
Sep 11 13:14:23.788286 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:23.788244    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:23.851949 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:23.851918    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4" event={"ID":"ed34e897-1452-4d52-80d2-4a7884345b65","Type":"ContainerStarted","Data":"81b4f89708138e60ddfea571d11d4f928a3312aabae567c3d692901f21a4476c"}
Sep 11 13:14:23.852142 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:23.851958    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4" event={"ID":"ed34e897-1452-4d52-80d2-4a7884345b65","Type":"ContainerStarted","Data":"05d0494300de62e869b113a7eb7ab1e8a9772e472912058d307b38d8576d242b"}
Sep 11 13:14:24.023527 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:24.023487    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:24.273660 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:24.273616    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:24.788750 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:24.788696    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:25.040873 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:25.040780    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:32.904380 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:32.904339    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"
Sep 11 13:14:32.904878 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:32.904411    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"
Sep 11 13:14:32.918109 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:32.918075    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"
Sep 11 13:14:32.955981 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:32.955914    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4" podStartSLOduration=10.955890887 podStartE2EDuration="10.955890887s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:14:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:14:23.944827172 +0000 UTC m=+1130.806301360" watchObservedRunningTime="2026-09-11 13:14:32.955890887 +0000 UTC m=+1139.817365076"
Sep 11 13:14:33.933815 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:33.933777    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"
Sep 11 13:14:38.320919 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:38.320875    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:43.190409 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:43.190378    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"]
Sep 11 13:14:43.193553 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:43.193535    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"
Sep 11 13:14:43.198392 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:43.198362    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-82825f\"/\"openshift-service-ca.crt\""
Sep 11 13:14:43.198392 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:43.198362    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-82825f\"/\"kube-root-ca.crt\""
Sep 11 13:14:43.199053 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:43.199037    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-82825f\"/\"auth-test-model-82825f-kserve-self-signed-certs\""
Sep 11 13:14:43.199297 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:43.199280    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-82825f\"/\"default-dockercfg-c46j9\""
Sep 11 13:14:43.291007 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:43.290973    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"]
Sep 11 13:14:43.311296 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:43.311258    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:43.375192 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:43.375155    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-home\") pod \"auth-test-model-82825f-kserve-bd5597f79-cwdn2\" (UID: \"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103\") " pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"
Sep 11 13:14:43.375384 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:43.375217    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-tmp-dir\") pod \"auth-test-model-82825f-kserve-bd5597f79-cwdn2\" (UID: \"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103\") " pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"
Sep 11 13:14:43.375384 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:43.375310    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-dshm\") pod \"auth-test-model-82825f-kserve-bd5597f79-cwdn2\" (UID: \"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103\") " pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"
Sep 11 13:14:43.375384 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:43.375335    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdgk4\" (UniqueName: \"kubernetes.io/projected/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-kube-api-access-bdgk4\") pod \"auth-test-model-82825f-kserve-bd5597f79-cwdn2\" (UID: \"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103\") " pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"
Sep 11 13:14:43.375384 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:43.375355    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-model-cache\") pod \"auth-test-model-82825f-kserve-bd5597f79-cwdn2\" (UID: \"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103\") " pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"
Sep 11 13:14:43.375587 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:43.375490    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-tls-certs\") pod \"auth-test-model-82825f-kserve-bd5597f79-cwdn2\" (UID: \"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103\") " pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"
Sep 11 13:14:43.476948 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:43.476848    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-home\") pod \"auth-test-model-82825f-kserve-bd5597f79-cwdn2\" (UID: \"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103\") " pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"
Sep 11 13:14:43.476948 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:43.476900    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-tmp-dir\") pod \"auth-test-model-82825f-kserve-bd5597f79-cwdn2\" (UID: \"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103\") " pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"
Sep 11 13:14:43.476948 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:43.476949    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-dshm\") pod \"auth-test-model-82825f-kserve-bd5597f79-cwdn2\" (UID: \"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103\") " pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"
Sep 11 13:14:43.477263 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:43.476973    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdgk4\" (UniqueName: \"kubernetes.io/projected/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-kube-api-access-bdgk4\") pod \"auth-test-model-82825f-kserve-bd5597f79-cwdn2\" (UID: \"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103\") " pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"
Sep 11 13:14:43.477263 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:43.476995    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-model-cache\") pod \"auth-test-model-82825f-kserve-bd5597f79-cwdn2\" (UID: \"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103\") " pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"
Sep 11 13:14:43.477263 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:43.477059    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-tls-certs\") pod \"auth-test-model-82825f-kserve-bd5597f79-cwdn2\" (UID: \"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103\") " pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"
Sep 11 13:14:43.477422 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:43.477353    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-home\") pod \"auth-test-model-82825f-kserve-bd5597f79-cwdn2\" (UID: \"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103\") " pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"
Sep 11 13:14:43.477422 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:43.477358    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-tmp-dir\") pod \"auth-test-model-82825f-kserve-bd5597f79-cwdn2\" (UID: \"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103\") " pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"
Sep 11 13:14:43.477512 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:43.477465    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-model-cache\") pod \"auth-test-model-82825f-kserve-bd5597f79-cwdn2\" (UID: \"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103\") " pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"
Sep 11 13:14:43.479455 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:43.479427    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-dshm\") pod \"auth-test-model-82825f-kserve-bd5597f79-cwdn2\" (UID: \"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103\") " pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"
Sep 11 13:14:43.479738 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:43.479704    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-tls-certs\") pod \"auth-test-model-82825f-kserve-bd5597f79-cwdn2\" (UID: \"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103\") " pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"
Sep 11 13:14:43.499214 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:43.499180    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdgk4\" (UniqueName: \"kubernetes.io/projected/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-kube-api-access-bdgk4\") pod \"auth-test-model-82825f-kserve-bd5597f79-cwdn2\" (UID: \"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103\") " pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"
Sep 11 13:14:43.504018 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:43.503995    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"
Sep 11 13:14:43.806066 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:43.806035    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"]
Sep 11 13:14:43.808158 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:14:43.808118    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod27ca2fa7_97f4_4d2d_8e1d_a039ec7a6103.slice/crio-2df3930bf31dc225a1cf17a97cf0eb0e2c1b764b9e18c8560183a6421c04f27e WatchSource:0}: Error finding container 2df3930bf31dc225a1cf17a97cf0eb0e2c1b764b9e18c8560183a6421c04f27e: Status 404 returned error can't find the container with id 2df3930bf31dc225a1cf17a97cf0eb0e2c1b764b9e18c8560183a6421c04f27e
Sep 11 13:14:43.984983 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:43.984943    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2" event={"ID":"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103","Type":"ContainerStarted","Data":"9f2575e3fb3effe92956af56b93c438f25d39c77abbf71b522cd95902e1ff738"}
Sep 11 13:14:43.985179 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:43.984993    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2" event={"ID":"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103","Type":"ContainerStarted","Data":"2df3930bf31dc225a1cf17a97cf0eb0e2c1b764b9e18c8560183a6421c04f27e"}
Sep 11 13:14:44.042205 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:44.042125    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2" podStartSLOduration=1.042105898 podStartE2EDuration="1.042105898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:14:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:14:44.036948218 +0000 UTC m=+1150.898422416" watchObservedRunningTime="2026-09-11 13:14:44.042105898 +0000 UTC m=+1150.903580085"
Sep 11 13:14:47.633413 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:47.633370    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:49.658371 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:49.658322    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:49.925057 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:49.924956    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:50.093395 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:50.093356    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:50.554460 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:50.554418    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:50.666109 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:50.666069    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:51.237194 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:51.237157    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:52.382350 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:52.382313    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:53.504193 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:53.504145    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"
Sep 11 13:14:53.504613 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:53.504215    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"
Sep 11 13:14:53.508969 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:53.508925    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:53.517331 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:53.517302    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"
Sep 11 13:14:53.628835 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:53.628794    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:53.767647 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:53.767555    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:54.057268 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:54.057239    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"
Sep 11 13:14:55.040575 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:55.040462    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:56.242613 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:56.242564    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:57.687457 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:57.687389    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:58.907782 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:58.907702    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:59.106384 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:59.106329    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:59.413119 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:14:59.413079    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:00.053821 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:00.053784    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:00.269976 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:00.269930    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-82825f-29818875-c8vgh"]
Sep 11 13:15:00.270784 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:00.270751    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:00.275053 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:00.275016    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-82825f-29818875-c8vgh"
Sep 11 13:15:00.299831 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:00.299792    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kt2vz\""
Sep 11 13:15:00.301823 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:00.301798    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4d7bb0-29818875-94z2g"]
Sep 11 13:15:00.305632 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:00.305607    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4d7bb0-29818875-94z2g"
Sep 11 13:15:00.308209 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:00.308090    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-82825f-29818875-c8vgh"
Sep 11 13:15:00.313484 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:00.312581    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1841da-29818875-bjrph"]
Sep 11 13:15:00.316646 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:00.316623    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1841da-29818875-bjrph"
Sep 11 13:15:00.324054 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:00.324030    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4d7bb0-29818875-94z2g"
Sep 11 13:15:00.339656 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:00.333767    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4d7bb0-29818875-94z2g"]
Sep 11 13:15:00.339656 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:00.338594    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-82825f-29818875-c8vgh"]
Sep 11 13:15:00.349199 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:00.349162    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1841da-29818875-bjrph"]
Sep 11 13:15:00.373234 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:00.373203    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1841da-29818875-bjrph"
Sep 11 13:15:00.493439 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:00.493394    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f705b6-9d6c4d586-mshrd"]
Sep 11 13:15:00.497387 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:00.497323    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f705b6-9d6c4d586-mshrd"
Sep 11 13:15:00.502986 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:00.502955    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-f705b6\""
Sep 11 13:15:00.527539 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:00.527506    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f705b6-9d6c4d586-mshrd"]
Sep 11 13:15:00.538657 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:00.538620    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llknw\" (UniqueName: \"kubernetes.io/projected/8bf8e379-7f8d-4467-89bc-078256340acb-kube-api-access-llknw\") pod \"payload-pre-processing-e2e-shared-b-w2-f705b6-9d6c4d586-mshrd\" (UID: \"8bf8e379-7f8d-4467-89bc-078256340acb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f705b6-9d6c4d586-mshrd"
Sep 11 13:15:00.538865 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:00.538677    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8bf8e379-7f8d-4467-89bc-078256340acb-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-f705b6-9d6c4d586-mshrd\" (UID: \"8bf8e379-7f8d-4467-89bc-078256340acb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f705b6-9d6c4d586-mshrd"
Sep 11 13:15:00.630549 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:00.630518    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-82825f-29818875-c8vgh"]
Sep 11 13:15:00.631395 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:15:00.631369    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d827145_131a_4881_950f_58b7b1ba769d.slice/crio-05ee21a56e9a069071401dd1763c17ce0df6e4969682835aeff269803b3d3390 WatchSource:0}: Error finding container 05ee21a56e9a069071401dd1763c17ce0df6e4969682835aeff269803b3d3390: Status 404 returned error can't find the container with id 05ee21a56e9a069071401dd1763c17ce0df6e4969682835aeff269803b3d3390
Sep 11 13:15:00.640162 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:00.640115    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llknw\" (UniqueName: \"kubernetes.io/projected/8bf8e379-7f8d-4467-89bc-078256340acb-kube-api-access-llknw\") pod \"payload-pre-processing-e2e-shared-b-w2-f705b6-9d6c4d586-mshrd\" (UID: \"8bf8e379-7f8d-4467-89bc-078256340acb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f705b6-9d6c4d586-mshrd"
Sep 11 13:15:00.640265 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:00.640185    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8bf8e379-7f8d-4467-89bc-078256340acb-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-f705b6-9d6c4d586-mshrd\" (UID: \"8bf8e379-7f8d-4467-89bc-078256340acb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f705b6-9d6c4d586-mshrd"
Sep 11 13:15:00.641141 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:00.641108    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8bf8e379-7f8d-4467-89bc-078256340acb-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-f705b6-9d6c4d586-mshrd\" (UID: \"8bf8e379-7f8d-4467-89bc-078256340acb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f705b6-9d6c4d586-mshrd"
Sep 11 13:15:00.653305 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:00.653274    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llknw\" (UniqueName: \"kubernetes.io/projected/8bf8e379-7f8d-4467-89bc-078256340acb-kube-api-access-llknw\") pod \"payload-pre-processing-e2e-shared-b-w2-f705b6-9d6c4d586-mshrd\" (UID: \"8bf8e379-7f8d-4467-89bc-078256340acb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f705b6-9d6c4d586-mshrd"
Sep 11 13:15:00.654376 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:00.654350    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4d7bb0-29818875-94z2g"]
Sep 11 13:15:00.662822 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:15:00.662790    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb22b26f_8be2_460e_998d_10be3da21034.slice/crio-5b2208c9f9dbcdeb6a80573da8e39f60374db960cd9502b8bdd223db20afac7d WatchSource:0}: Error finding container 5b2208c9f9dbcdeb6a80573da8e39f60374db960cd9502b8bdd223db20afac7d: Status 404 returned error can't find the container with id 5b2208c9f9dbcdeb6a80573da8e39f60374db960cd9502b8bdd223db20afac7d
Sep 11 13:15:00.685035 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:00.685005    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1841da-29818875-bjrph"]
Sep 11 13:15:00.685815 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:15:00.685784    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55580b1b_8687_4035_8d6f_55af33bb6720.slice/crio-9a284b8aaf468846564e02247913fe084ca640c55c0143c627b33a3f696f2a0f WatchSource:0}: Error finding container 9a284b8aaf468846564e02247913fe084ca640c55c0143c627b33a3f696f2a0f: Status 404 returned error can't find the container with id 9a284b8aaf468846564e02247913fe084ca640c55c0143c627b33a3f696f2a0f
Sep 11 13:15:00.809469 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:00.809423    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f705b6-9d6c4d586-mshrd"
Sep 11 13:15:01.094169 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:01.094130    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1841da-29818875-bjrph" event={"ID":"55580b1b-8687-4035-8d6f-55af33bb6720","Type":"ContainerStarted","Data":"d763d182b79d511ed980d733a679e6dcb9090511ca495d6bd8ce231b5e8a80c2"}
Sep 11 13:15:01.094612 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:01.094194    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1841da-29818875-bjrph" event={"ID":"55580b1b-8687-4035-8d6f-55af33bb6720","Type":"ContainerStarted","Data":"9a284b8aaf468846564e02247913fe084ca640c55c0143c627b33a3f696f2a0f"}
Sep 11 13:15:01.095837 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:01.095809    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4d7bb0-29818875-94z2g" event={"ID":"db22b26f-8be2-460e-998d-10be3da21034","Type":"ContainerStarted","Data":"dba3630e337fc4bc80b5c883ace14cfb39eaf72754ece7d1fab27117b88190fc"}
Sep 11 13:15:01.095995 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:01.095857    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4d7bb0-29818875-94z2g" event={"ID":"db22b26f-8be2-460e-998d-10be3da21034","Type":"ContainerStarted","Data":"5b2208c9f9dbcdeb6a80573da8e39f60374db960cd9502b8bdd223db20afac7d"}
Sep 11 13:15:01.097320 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:01.097293    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-82825f-29818875-c8vgh" event={"ID":"4d827145-131a-4881-950f-58b7b1ba769d","Type":"ContainerStarted","Data":"f113e6c51f6e492b1100ba2c49fcd8f3d0888c650d92f0f81d18fb9dbaa9fa7c"}
Sep 11 13:15:01.097433 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:01.097335    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-82825f-29818875-c8vgh" event={"ID":"4d827145-131a-4881-950f-58b7b1ba769d","Type":"ContainerStarted","Data":"05ee21a56e9a069071401dd1763c17ce0df6e4969682835aeff269803b3d3390"}
Sep 11 13:15:01.103043 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:01.103020    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f705b6-9d6c4d586-mshrd"]
Sep 11 13:15:01.104438 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:15:01.104413    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bf8e379_7f8d_4467_89bc_078256340acb.slice/crio-58525392c2dd1f5428e12728adae574625d75beed54c0f29f021d5a1d418ba55 WatchSource:0}: Error finding container 58525392c2dd1f5428e12728adae574625d75beed54c0f29f021d5a1d418ba55: Status 404 returned error can't find the container with id 58525392c2dd1f5428e12728adae574625d75beed54c0f29f021d5a1d418ba55
Sep 11 13:15:01.121490 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:01.121433    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1841da-29818875-bjrph" podStartSLOduration=1.121417439 podStartE2EDuration="1.121417439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:15:01.118988918 +0000 UTC m=+1167.980463106" watchObservedRunningTime="2026-09-11 13:15:01.121417439 +0000 UTC m=+1167.982891628"
Sep 11 13:15:01.145470 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:01.145410    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4d7bb0-29818875-94z2g" podStartSLOduration=1.145392797 podStartE2EDuration="1.145392797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:15:01.140599206 +0000 UTC m=+1168.002073393" watchObservedRunningTime="2026-09-11 13:15:01.145392797 +0000 UTC m=+1168.006866985"
Sep 11 13:15:01.163979 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:01.163931    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-82825f-29818875-c8vgh" podStartSLOduration=1.163913852 podStartE2EDuration="1.163913852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:15:01.161790808 +0000 UTC m=+1168.023264996" watchObservedRunningTime="2026-09-11 13:15:01.163913852 +0000 UTC m=+1168.025388039"
Sep 11 13:15:02.113978 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:02.113942    2547 generic.go:356] "Generic (PLEG): container finished" podID="4d827145-131a-4881-950f-58b7b1ba769d" containerID="f113e6c51f6e492b1100ba2c49fcd8f3d0888c650d92f0f81d18fb9dbaa9fa7c" exitCode=0
Sep 11 13:15:02.114421 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:02.114022    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-82825f-29818875-c8vgh" event={"ID":"4d827145-131a-4881-950f-58b7b1ba769d","Type":"ContainerDied","Data":"f113e6c51f6e492b1100ba2c49fcd8f3d0888c650d92f0f81d18fb9dbaa9fa7c"}
Sep 11 13:15:02.115771 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:02.115741    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f705b6-9d6c4d586-mshrd" event={"ID":"8bf8e379-7f8d-4467-89bc-078256340acb","Type":"ContainerStarted","Data":"e5e06644804c7581c0aa6f184377964203ef182e3b6b2fbc79cdc490051aed62"}
Sep 11 13:15:02.115913 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:02.115798    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f705b6-9d6c4d586-mshrd"
Sep 11 13:15:02.115913 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:02.115826    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f705b6-9d6c4d586-mshrd" event={"ID":"8bf8e379-7f8d-4467-89bc-078256340acb","Type":"ContainerStarted","Data":"58525392c2dd1f5428e12728adae574625d75beed54c0f29f021d5a1d418ba55"}
Sep 11 13:15:02.117262 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:02.117240    2547 generic.go:356] "Generic (PLEG): container finished" podID="55580b1b-8687-4035-8d6f-55af33bb6720" containerID="d763d182b79d511ed980d733a679e6dcb9090511ca495d6bd8ce231b5e8a80c2" exitCode=0
Sep 11 13:15:02.117372 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:02.117305    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1841da-29818875-bjrph" event={"ID":"55580b1b-8687-4035-8d6f-55af33bb6720","Type":"ContainerDied","Data":"d763d182b79d511ed980d733a679e6dcb9090511ca495d6bd8ce231b5e8a80c2"}
Sep 11 13:15:02.118728 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:02.118694    2547 generic.go:356] "Generic (PLEG): container finished" podID="db22b26f-8be2-460e-998d-10be3da21034" containerID="dba3630e337fc4bc80b5c883ace14cfb39eaf72754ece7d1fab27117b88190fc" exitCode=0
Sep 11 13:15:02.118822 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:02.118748    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4d7bb0-29818875-94z2g" event={"ID":"db22b26f-8be2-460e-998d-10be3da21034","Type":"ContainerDied","Data":"dba3630e337fc4bc80b5c883ace14cfb39eaf72754ece7d1fab27117b88190fc"}
Sep 11 13:15:02.281968 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:02.281906    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f705b6-9d6c4d586-mshrd" podStartSLOduration=2.281884068 podStartE2EDuration="2.281884068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:15:02.273451449 +0000 UTC m=+1169.134925636" watchObservedRunningTime="2026-09-11 13:15:02.281884068 +0000 UTC m=+1169.143358257"
Sep 11 13:15:03.283428 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:03.283400    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4d7bb0-29818875-94z2g"
Sep 11 13:15:03.310892 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:03.310863    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1841da-29818875-bjrph"
Sep 11 13:15:03.315691 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:03.315667    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-82825f-29818875-c8vgh"
Sep 11 13:15:04.131895 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:04.131867    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-82825f-29818875-c8vgh"
Sep 11 13:15:04.132064 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:04.131912    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-82825f-29818875-c8vgh" event={"ID":"4d827145-131a-4881-950f-58b7b1ba769d","Type":"ContainerDied","Data":"05ee21a56e9a069071401dd1763c17ce0df6e4969682835aeff269803b3d3390"}
Sep 11 13:15:04.132064 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:04.131966    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05ee21a56e9a069071401dd1763c17ce0df6e4969682835aeff269803b3d3390"
Sep 11 13:15:04.133381 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:04.133364    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1841da-29818875-bjrph"
Sep 11 13:15:04.133510 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:04.133391    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1841da-29818875-bjrph" event={"ID":"55580b1b-8687-4035-8d6f-55af33bb6720","Type":"ContainerDied","Data":"9a284b8aaf468846564e02247913fe084ca640c55c0143c627b33a3f696f2a0f"}
Sep 11 13:15:04.133510 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:04.133435    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a284b8aaf468846564e02247913fe084ca640c55c0143c627b33a3f696f2a0f"
Sep 11 13:15:04.135119 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:04.135097    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4d7bb0-29818875-94z2g" event={"ID":"db22b26f-8be2-460e-998d-10be3da21034","Type":"ContainerDied","Data":"5b2208c9f9dbcdeb6a80573da8e39f60374db960cd9502b8bdd223db20afac7d"}
Sep 11 13:15:04.135119 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:04.135113    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4d7bb0-29818875-94z2g"
Sep 11 13:15:04.135293 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:04.135140    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b2208c9f9dbcdeb6a80573da8e39f60374db960cd9502b8bdd223db20afac7d"
Sep 11 13:15:13.127123 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:13.127085    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f705b6-9d6c4d586-mshrd"
Sep 11 13:15:22.862199 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:22.862153    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:23.544414 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:23.544375    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:23.898919 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:23.898866    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:24.374032 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:24.373997    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7778-6db289"]
Sep 11 13:15:24.374422 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:24.374410    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db22b26f-8be2-460e-998d-10be3da21034" containerName="cleanup"
Sep 11 13:15:24.374470 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:24.374424    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="db22b26f-8be2-460e-998d-10be3da21034" containerName="cleanup"
Sep 11 13:15:24.374470 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:24.374440    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55580b1b-8687-4035-8d6f-55af33bb6720" containerName="cleanup"
Sep 11 13:15:24.374470 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:24.374446    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="55580b1b-8687-4035-8d6f-55af33bb6720" containerName="cleanup"
Sep 11 13:15:24.374470 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:24.374455    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d827145-131a-4881-950f-58b7b1ba769d" containerName="cleanup"
Sep 11 13:15:24.374470 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:24.374460    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d827145-131a-4881-950f-58b7b1ba769d" containerName="cleanup"
Sep 11 13:15:24.374665 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:24.374529    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="db22b26f-8be2-460e-998d-10be3da21034" containerName="cleanup"
Sep 11 13:15:24.374665 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:24.374538    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d827145-131a-4881-950f-58b7b1ba769d" containerName="cleanup"
Sep 11 13:15:24.374665 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:24.374545    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="55580b1b-8687-4035-8d6f-55af33bb6720" containerName="cleanup"
Sep 11 13:15:24.377900 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:24.377882    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7778-6db289"
Sep 11 13:15:24.380401 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:24.380379    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-46lmf\""
Sep 11 13:15:24.386267 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:24.386062    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7778-6db289"]
Sep 11 13:15:24.484832 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:24.484795    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcndr\" (UniqueName: \"kubernetes.io/projected/0aa0a40d-e26b-44d4-81d2-251c2e6f90d4-kube-api-access-kcndr\") pod \"test-curl-7778-6db289\" (UID: \"0aa0a40d-e26b-44d4-81d2-251c2e6f90d4\") " pod="opendatahub/test-curl-7778-6db289"
Sep 11 13:15:24.586028 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:24.585983    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcndr\" (UniqueName: \"kubernetes.io/projected/0aa0a40d-e26b-44d4-81d2-251c2e6f90d4-kube-api-access-kcndr\") pod \"test-curl-7778-6db289\" (UID: \"0aa0a40d-e26b-44d4-81d2-251c2e6f90d4\") " pod="opendatahub/test-curl-7778-6db289"
Sep 11 13:15:24.596780 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:24.596747    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcndr\" (UniqueName: \"kubernetes.io/projected/0aa0a40d-e26b-44d4-81d2-251c2e6f90d4-kube-api-access-kcndr\") pod \"test-curl-7778-6db289\" (UID: \"0aa0a40d-e26b-44d4-81d2-251c2e6f90d4\") " pod="opendatahub/test-curl-7778-6db289"
Sep 11 13:15:24.689103 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:24.689010    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7778-6db289"
Sep 11 13:15:24.865367 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:24.865329    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:24.975238 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:24.975213    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7778-6db289"]
Sep 11 13:15:24.977388 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:15:24.977353    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0aa0a40d_e26b_44d4_81d2_251c2e6f90d4.slice/crio-310198e14595cb58707fae4d1daa4ca3d60a2a0e215b15668ec8bfcc0291f68e WatchSource:0}: Error finding container 310198e14595cb58707fae4d1daa4ca3d60a2a0e215b15668ec8bfcc0291f68e: Status 404 returned error can't find the container with id 310198e14595cb58707fae4d1daa4ca3d60a2a0e215b15668ec8bfcc0291f68e
Sep 11 13:15:25.274673 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:25.274570    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7778-6db289" event={"ID":"0aa0a40d-e26b-44d4-81d2-251c2e6f90d4","Type":"ContainerStarted","Data":"159ee96be71513a6440a50f55192aa6d8a7cdbaed2372cefaef42ace63653d61"}
Sep 11 13:15:25.274673 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:25.274614    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7778-6db289" event={"ID":"0aa0a40d-e26b-44d4-81d2-251c2e6f90d4","Type":"ContainerStarted","Data":"310198e14595cb58707fae4d1daa4ca3d60a2a0e215b15668ec8bfcc0291f68e"}
Sep 11 13:15:25.294106 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:25.294044    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7778-6db289" podStartSLOduration=1.294022536 podStartE2EDuration="1.294022536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:15:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:15:25.291182735 +0000 UTC m=+1192.152656923" watchObservedRunningTime="2026-09-11 13:15:25.294022536 +0000 UTC m=+1192.155496725"
Sep 11 13:15:25.852938 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:25.852896    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:26.031665 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:26.031566    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7778-6db289"]
Sep 11 13:15:26.034980 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:26.034951    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7778-6db289"]
Sep 11 13:15:26.174055 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:26.174021    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7778-20e852"]
Sep 11 13:15:26.174436 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:26.174424    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0aa0a40d-e26b-44d4-81d2-251c2e6f90d4" containerName="test-curl-7778-6db289"
Sep 11 13:15:26.174502 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:26.174438    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="0aa0a40d-e26b-44d4-81d2-251c2e6f90d4" containerName="test-curl-7778-6db289"
Sep 11 13:15:26.174541 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:26.174512    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="0aa0a40d-e26b-44d4-81d2-251c2e6f90d4" containerName="test-curl-7778-6db289"
Sep 11 13:15:26.177710 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:26.177693    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7778-20e852"
Sep 11 13:15:26.194378 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:26.194344    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7778-20e852"]
Sep 11 13:15:26.280970 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:15:26.280938    2547 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7778-6db289" container="test-curl-7778-6db289"
Sep 11 13:15:26.304194 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:26.304078    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nfxw\" (UniqueName: \"kubernetes.io/projected/c87cfb23-7eea-49f1-ae2a-d7618bffa4a6-kube-api-access-5nfxw\") pod \"test-curl-7778-20e852\" (UID: \"c87cfb23-7eea-49f1-ae2a-d7618bffa4a6\") " pod="opendatahub/test-curl-7778-20e852"
Sep 11 13:15:26.405092 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:26.405053    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nfxw\" (UniqueName: \"kubernetes.io/projected/c87cfb23-7eea-49f1-ae2a-d7618bffa4a6-kube-api-access-5nfxw\") pod \"test-curl-7778-20e852\" (UID: \"c87cfb23-7eea-49f1-ae2a-d7618bffa4a6\") " pod="opendatahub/test-curl-7778-20e852"
Sep 11 13:15:26.416278 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:26.416238    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nfxw\" (UniqueName: \"kubernetes.io/projected/c87cfb23-7eea-49f1-ae2a-d7618bffa4a6-kube-api-access-5nfxw\") pod \"test-curl-7778-20e852\" (UID: \"c87cfb23-7eea-49f1-ae2a-d7618bffa4a6\") " pod="opendatahub/test-curl-7778-20e852"
Sep 11 13:15:26.486871 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:26.486816    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7778-20e852"
Sep 11 13:15:26.730898 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:26.730856    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:26.772085 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:26.771871    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7778-20e852"]
Sep 11 13:15:26.775319 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:15:26.775280    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc87cfb23_7eea_49f1_ae2a_d7618bffa4a6.slice/crio-108f8fa6f0c2aba5c3c1710a0cc7ef8b941169d66b42d5b22aa88f4245a9d92e WatchSource:0}: Error finding container 108f8fa6f0c2aba5c3c1710a0cc7ef8b941169d66b42d5b22aa88f4245a9d92e: Status 404 returned error can't find the container with id 108f8fa6f0c2aba5c3c1710a0cc7ef8b941169d66b42d5b22aa88f4245a9d92e
Sep 11 13:15:27.288044 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:27.287994    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7778-20e852" event={"ID":"c87cfb23-7eea-49f1-ae2a-d7618bffa4a6","Type":"ContainerStarted","Data":"f8271bfac898f157ca99a7796c6808b8de3bc0484c519f88ebe01d19d2743c4d"}
Sep 11 13:15:27.288044 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:27.288048    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7778-20e852" event={"ID":"c87cfb23-7eea-49f1-ae2a-d7618bffa4a6","Type":"ContainerStarted","Data":"108f8fa6f0c2aba5c3c1710a0cc7ef8b941169d66b42d5b22aa88f4245a9d92e"}
Sep 11 13:15:27.288602 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:27.288283    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7778-6db289" podUID="0aa0a40d-e26b-44d4-81d2-251c2e6f90d4" containerName="test-curl-7778-6db289" containerID="cri-o://159ee96be71513a6440a50f55192aa6d8a7cdbaed2372cefaef42ace63653d61" gracePeriod=2
Sep 11 13:15:27.307220 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:15:27.307173    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7778-6db289\" is forbidden: User \"system:node:ip-10-0-133-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-79.ec2.internal' and this object" podUID="0aa0a40d-e26b-44d4-81d2-251c2e6f90d4" pod="opendatahub/test-curl-7778-6db289"
Sep 11 13:15:27.307651 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:27.307607    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7778-20e852" podStartSLOduration=1.307589889 podStartE2EDuration="1.307589889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:15:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:15:27.305059715 +0000 UTC m=+1194.166533903" watchObservedRunningTime="2026-09-11 13:15:27.307589889 +0000 UTC m=+1194.169064073"
Sep 11 13:15:28.046319 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:28.046186    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7778-20e852"]
Sep 11 13:15:28.050661 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:28.050623    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7778-20e852"]
Sep 11 13:15:28.196275 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:28.196237    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7778-1e6f68"]
Sep 11 13:15:28.196662 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:28.196647    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c87cfb23-7eea-49f1-ae2a-d7618bffa4a6" containerName="test-curl-7778-20e852"
Sep 11 13:15:28.196746 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:28.196664    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="c87cfb23-7eea-49f1-ae2a-d7618bffa4a6" containerName="test-curl-7778-20e852"
Sep 11 13:15:28.196794 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:28.196782    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="c87cfb23-7eea-49f1-ae2a-d7618bffa4a6" containerName="test-curl-7778-20e852"
Sep 11 13:15:28.199995 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:28.199975    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7778-1e6f68"
Sep 11 13:15:28.210242 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:28.210212    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7778-1e6f68"]
Sep 11 13:15:28.294440 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:15:28.294407    2547 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7778-20e852" container="test-curl-7778-20e852"
Sep 11 13:15:28.324842 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:28.324794    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msh84\" (UniqueName: \"kubernetes.io/projected/665a85ce-c3ad-4e4a-b565-d1320abd44c6-kube-api-access-msh84\") pod \"test-curl-7778-1e6f68\" (UID: \"665a85ce-c3ad-4e4a-b565-d1320abd44c6\") " pod="opendatahub/test-curl-7778-1e6f68"
Sep 11 13:15:28.425918 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:28.425871    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msh84\" (UniqueName: \"kubernetes.io/projected/665a85ce-c3ad-4e4a-b565-d1320abd44c6-kube-api-access-msh84\") pod \"test-curl-7778-1e6f68\" (UID: \"665a85ce-c3ad-4e4a-b565-d1320abd44c6\") " pod="opendatahub/test-curl-7778-1e6f68"
Sep 11 13:15:28.436100 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:28.436072    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msh84\" (UniqueName: \"kubernetes.io/projected/665a85ce-c3ad-4e4a-b565-d1320abd44c6-kube-api-access-msh84\") pod \"test-curl-7778-1e6f68\" (UID: \"665a85ce-c3ad-4e4a-b565-d1320abd44c6\") " pod="opendatahub/test-curl-7778-1e6f68"
Sep 11 13:15:28.511153 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:28.511118    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7778-1e6f68"
Sep 11 13:15:28.797375 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:28.797344    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7778-1e6f68"]
Sep 11 13:15:28.798190 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:15:28.798156    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod665a85ce_c3ad_4e4a_b565_d1320abd44c6.slice/crio-14e34e26bc64c36e6714067cd8378986b844e449361c7162dac64fc74050a48a WatchSource:0}: Error finding container 14e34e26bc64c36e6714067cd8378986b844e449361c7162dac64fc74050a48a: Status 404 returned error can't find the container with id 14e34e26bc64c36e6714067cd8378986b844e449361c7162dac64fc74050a48a
Sep 11 13:15:29.303169 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:29.303134    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7778-1e6f68" event={"ID":"665a85ce-c3ad-4e4a-b565-d1320abd44c6","Type":"ContainerStarted","Data":"5574e539da3179b558f267ea9aef299e01b8390783101a8c2909f243c3fd37f2"}
Sep 11 13:15:29.303552 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:29.303186    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7778-1e6f68" event={"ID":"665a85ce-c3ad-4e4a-b565-d1320abd44c6","Type":"ContainerStarted","Data":"14e34e26bc64c36e6714067cd8378986b844e449361c7162dac64fc74050a48a"}
Sep 11 13:15:29.303552 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:29.303309    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7778-20e852" podUID="c87cfb23-7eea-49f1-ae2a-d7618bffa4a6" containerName="test-curl-7778-20e852" containerID="cri-o://f8271bfac898f157ca99a7796c6808b8de3bc0484c519f88ebe01d19d2743c4d" gracePeriod=2
Sep 11 13:15:29.325530 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:15:29.325482    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7778-20e852\" is forbidden: User \"system:node:ip-10-0-133-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-79.ec2.internal' and this object" podUID="c87cfb23-7eea-49f1-ae2a-d7618bffa4a6" pod="opendatahub/test-curl-7778-20e852"
Sep 11 13:15:29.470380 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:29.470350    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7778-6db289"
Sep 11 13:15:29.473053 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:15:29.473020    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7778-20e852\" is forbidden: User \"system:node:ip-10-0-133-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-79.ec2.internal' and this object" podUID="c87cfb23-7eea-49f1-ae2a-d7618bffa4a6" pod="opendatahub/test-curl-7778-20e852"
Sep 11 13:15:29.638069 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:29.638032    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcndr\" (UniqueName: \"kubernetes.io/projected/0aa0a40d-e26b-44d4-81d2-251c2e6f90d4-kube-api-access-kcndr\") pod \"0aa0a40d-e26b-44d4-81d2-251c2e6f90d4\" (UID: \"0aa0a40d-e26b-44d4-81d2-251c2e6f90d4\") "
Sep 11 13:15:29.640366 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:29.640335    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0aa0a40d-e26b-44d4-81d2-251c2e6f90d4-kube-api-access-kcndr" (OuterVolumeSpecName: "kube-api-access-kcndr") pod "0aa0a40d-e26b-44d4-81d2-251c2e6f90d4" (UID: "0aa0a40d-e26b-44d4-81d2-251c2e6f90d4"). InnerVolumeSpecName "kube-api-access-kcndr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:15:29.664197 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:29.664161    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0aa0a40d-e26b-44d4-81d2-251c2e6f90d4" path="/var/lib/kubelet/pods/0aa0a40d-e26b-44d4-81d2-251c2e6f90d4/volumes"
Sep 11 13:15:29.739452 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:29.739409    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcndr\" (UniqueName: \"kubernetes.io/projected/0aa0a40d-e26b-44d4-81d2-251c2e6f90d4-kube-api-access-kcndr\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:15:29.992774 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:29.992615    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7778-1e6f68" podStartSLOduration=1.992594272 podStartE2EDuration="1.992594272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:15:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:15:29.323349405 +0000 UTC m=+1196.184823592" watchObservedRunningTime="2026-09-11 13:15:29.992594272 +0000 UTC m=+1196.854068459"
Sep 11 13:15:29.993757 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:29.993702    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7778-1e6f68"]
Sep 11 13:15:29.996994 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:29.996962    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7778-1e6f68"]
Sep 11 13:15:30.154090 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:30.154054    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7778-e20be2"]
Sep 11 13:15:30.154449 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:30.154435    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="665a85ce-c3ad-4e4a-b565-d1320abd44c6" containerName="test-curl-7778-1e6f68"
Sep 11 13:15:30.154495 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:30.154451    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="665a85ce-c3ad-4e4a-b565-d1320abd44c6" containerName="test-curl-7778-1e6f68"
Sep 11 13:15:30.154534 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:30.154524    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="665a85ce-c3ad-4e4a-b565-d1320abd44c6" containerName="test-curl-7778-1e6f68"
Sep 11 13:15:30.157839 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:30.157812    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7778-e20be2"
Sep 11 13:15:30.169924 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:30.169896    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7778-e20be2"]
Sep 11 13:15:30.242676 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:30.242638    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbkv8\" (UniqueName: \"kubernetes.io/projected/aa11fa5b-cafe-407c-86ca-f01174249b9f-kube-api-access-hbkv8\") pod \"test-curl-7778-e20be2\" (UID: \"aa11fa5b-cafe-407c-86ca-f01174249b9f\") " pod="opendatahub/test-curl-7778-e20be2"
Sep 11 13:15:30.315596 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:30.315559    2547 generic.go:356] "Generic (PLEG): container finished" podID="0aa0a40d-e26b-44d4-81d2-251c2e6f90d4" containerID="159ee96be71513a6440a50f55192aa6d8a7cdbaed2372cefaef42ace63653d61" exitCode=137
Sep 11 13:15:30.315596 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:30.315608    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7778-6db289"
Sep 11 13:15:30.316083 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:30.315651    2547 scope.go:117] "RemoveContainer" containerID="159ee96be71513a6440a50f55192aa6d8a7cdbaed2372cefaef42ace63653d61"
Sep 11 13:15:30.316083 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:15:30.315988    2547 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7778-1e6f68" container="test-curl-7778-1e6f68"
Sep 11 13:15:30.325632 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:30.325616    2547 scope.go:117] "RemoveContainer" containerID="159ee96be71513a6440a50f55192aa6d8a7cdbaed2372cefaef42ace63653d61"
Sep 11 13:15:30.325962 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:15:30.325943    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"159ee96be71513a6440a50f55192aa6d8a7cdbaed2372cefaef42ace63653d61\": container with ID starting with 159ee96be71513a6440a50f55192aa6d8a7cdbaed2372cefaef42ace63653d61 not found: ID does not exist" containerID="159ee96be71513a6440a50f55192aa6d8a7cdbaed2372cefaef42ace63653d61"
Sep 11 13:15:30.326021 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:30.325971    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"159ee96be71513a6440a50f55192aa6d8a7cdbaed2372cefaef42ace63653d61"} err="failed to get container status \"159ee96be71513a6440a50f55192aa6d8a7cdbaed2372cefaef42ace63653d61\": rpc error: code = NotFound desc = could not find container \"159ee96be71513a6440a50f55192aa6d8a7cdbaed2372cefaef42ace63653d61\": container with ID starting with 159ee96be71513a6440a50f55192aa6d8a7cdbaed2372cefaef42ace63653d61 not found: ID does not exist"
Sep 11 13:15:30.343507 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:30.343469    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbkv8\" (UniqueName: \"kubernetes.io/projected/aa11fa5b-cafe-407c-86ca-f01174249b9f-kube-api-access-hbkv8\") pod \"test-curl-7778-e20be2\" (UID: \"aa11fa5b-cafe-407c-86ca-f01174249b9f\") " pod="opendatahub/test-curl-7778-e20be2"
Sep 11 13:15:30.355851 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:30.355815    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbkv8\" (UniqueName: \"kubernetes.io/projected/aa11fa5b-cafe-407c-86ca-f01174249b9f-kube-api-access-hbkv8\") pod \"test-curl-7778-e20be2\" (UID: \"aa11fa5b-cafe-407c-86ca-f01174249b9f\") " pod="opendatahub/test-curl-7778-e20be2"
Sep 11 13:15:30.468591 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:30.468547    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7778-e20be2"
Sep 11 13:15:30.764821 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:30.764796    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7778-e20be2"]
Sep 11 13:15:30.766581 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:15:30.766554    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa11fa5b_cafe_407c_86ca_f01174249b9f.slice/crio-c5a62f285682712b9c5e3e4a035a48b48b98cdc55bf3adeff09a9a53a4197ade WatchSource:0}: Error finding container c5a62f285682712b9c5e3e4a035a48b48b98cdc55bf3adeff09a9a53a4197ade: Status 404 returned error can't find the container with id c5a62f285682712b9c5e3e4a035a48b48b98cdc55bf3adeff09a9a53a4197ade
Sep 11 13:15:31.325053 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:31.325017    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7778-e20be2" event={"ID":"aa11fa5b-cafe-407c-86ca-f01174249b9f","Type":"ContainerStarted","Data":"7a22cd6131139edee73ee77bd57f178eda1c18406ba8fbc745944dc1066d78c4"}
Sep 11 13:15:31.325511 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:31.325068    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7778-e20be2" event={"ID":"aa11fa5b-cafe-407c-86ca-f01174249b9f","Type":"ContainerStarted","Data":"c5a62f285682712b9c5e3e4a035a48b48b98cdc55bf3adeff09a9a53a4197ade"}
Sep 11 13:15:31.325511 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:31.325197    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7778-1e6f68" podUID="665a85ce-c3ad-4e4a-b565-d1320abd44c6" containerName="test-curl-7778-1e6f68" containerID="cri-o://5574e539da3179b558f267ea9aef299e01b8390783101a8c2909f243c3fd37f2" gracePeriod=2
Sep 11 13:15:31.342389 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:31.342332    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7778-e20be2" podStartSLOduration=1.342311888 podStartE2EDuration="1.342311888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:15:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:15:31.339828163 +0000 UTC m=+1198.201302353" watchObservedRunningTime="2026-09-11 13:15:31.342311888 +0000 UTC m=+1198.203786076"
Sep 11 13:15:31.345867 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:15:31.345837    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7778-1e6f68\" is forbidden: User \"system:node:ip-10-0-133-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-79.ec2.internal' and this object" podUID="665a85ce-c3ad-4e4a-b565-d1320abd44c6" pod="opendatahub/test-curl-7778-1e6f68"
Sep 11 13:15:31.478639 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:31.478600    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7778-20e852"
Sep 11 13:15:31.481134 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:15:31.481094    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7778-1e6f68\" is forbidden: User \"system:node:ip-10-0-133-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-79.ec2.internal' and this object" podUID="665a85ce-c3ad-4e4a-b565-d1320abd44c6" pod="opendatahub/test-curl-7778-1e6f68"
Sep 11 13:15:31.552604 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:31.552561    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5nfxw\" (UniqueName: \"kubernetes.io/projected/c87cfb23-7eea-49f1-ae2a-d7618bffa4a6-kube-api-access-5nfxw\") pod \"c87cfb23-7eea-49f1-ae2a-d7618bffa4a6\" (UID: \"c87cfb23-7eea-49f1-ae2a-d7618bffa4a6\") "
Sep 11 13:15:31.555203 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:31.555177    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c87cfb23-7eea-49f1-ae2a-d7618bffa4a6-kube-api-access-5nfxw" (OuterVolumeSpecName: "kube-api-access-5nfxw") pod "c87cfb23-7eea-49f1-ae2a-d7618bffa4a6" (UID: "c87cfb23-7eea-49f1-ae2a-d7618bffa4a6"). InnerVolumeSpecName "kube-api-access-5nfxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:15:31.653393 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:31.653347    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5nfxw\" (UniqueName: \"kubernetes.io/projected/c87cfb23-7eea-49f1-ae2a-d7618bffa4a6-kube-api-access-5nfxw\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:15:31.664063 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:31.664029    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c87cfb23-7eea-49f1-ae2a-d7618bffa4a6" path="/var/lib/kubelet/pods/c87cfb23-7eea-49f1-ae2a-d7618bffa4a6/volumes"
Sep 11 13:15:32.012670 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:32.012574    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7778-e20be2"]
Sep 11 13:15:32.022180 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:32.022140    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7778-e20be2"]
Sep 11 13:15:32.333178 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:32.333142    2547 generic.go:356] "Generic (PLEG): container finished" podID="c87cfb23-7eea-49f1-ae2a-d7618bffa4a6" containerID="f8271bfac898f157ca99a7796c6808b8de3bc0484c519f88ebe01d19d2743c4d" exitCode=137
Sep 11 13:15:32.333569 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:32.333184    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7778-20e852"
Sep 11 13:15:32.333569 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:32.333242    2547 scope.go:117] "RemoveContainer" containerID="f8271bfac898f157ca99a7796c6808b8de3bc0484c519f88ebe01d19d2743c4d"
Sep 11 13:15:32.333694 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:15:32.333570    2547 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7778-e20be2" container="test-curl-7778-e20be2"
Sep 11 13:15:32.343925 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:32.343902    2547 scope.go:117] "RemoveContainer" containerID="f8271bfac898f157ca99a7796c6808b8de3bc0484c519f88ebe01d19d2743c4d"
Sep 11 13:15:32.344286 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:15:32.344265    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8271bfac898f157ca99a7796c6808b8de3bc0484c519f88ebe01d19d2743c4d\": container with ID starting with f8271bfac898f157ca99a7796c6808b8de3bc0484c519f88ebe01d19d2743c4d not found: ID does not exist" containerID="f8271bfac898f157ca99a7796c6808b8de3bc0484c519f88ebe01d19d2743c4d"
Sep 11 13:15:32.344368 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:32.344298    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8271bfac898f157ca99a7796c6808b8de3bc0484c519f88ebe01d19d2743c4d"} err="failed to get container status \"f8271bfac898f157ca99a7796c6808b8de3bc0484c519f88ebe01d19d2743c4d\": rpc error: code = NotFound desc = could not find container \"f8271bfac898f157ca99a7796c6808b8de3bc0484c519f88ebe01d19d2743c4d\": container with ID starting with f8271bfac898f157ca99a7796c6808b8de3bc0484c519f88ebe01d19d2743c4d not found: ID does not exist"
Sep 11 13:15:32.705847 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:32.705708    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:33.024471 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.024382    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"]
Sep 11 13:15:33.024828 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.024802    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa11fa5b-cafe-407c-86ca-f01174249b9f" containerName="test-curl-7778-e20be2"
Sep 11 13:15:33.024828 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.024830    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa11fa5b-cafe-407c-86ca-f01174249b9f" containerName="test-curl-7778-e20be2"
Sep 11 13:15:33.024935 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.024901    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa11fa5b-cafe-407c-86ca-f01174249b9f" containerName="test-curl-7778-e20be2"
Sep 11 13:15:33.029231 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.029211    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:33.032228 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.032202    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-13b2e851-openshift-default-dockercfg-k2srg\""
Sep 11 13:15:33.044124 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.044086    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"]
Sep 11 13:15:33.062293 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.062254    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:33.067307 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.067279    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-credential-socket\") pod \"e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") " pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:33.067422 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.067320    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-istiod-ca-cert\") pod \"e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") " pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:33.067422 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.067342    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-istio-data\") pod \"e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") " pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:33.067558 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.067432    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-workload-certs\") pod \"e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") " pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:33.067558 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.067484    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-istio-token\") pod \"e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") " pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:33.067558 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.067538    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw694\" (UniqueName: \"kubernetes.io/projected/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-kube-api-access-gw694\") pod \"e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") " pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:33.067737 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.067586    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-workload-socket\") pod \"e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") " pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:33.067737 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.067650    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-istio-envoy\") pod \"e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") " pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:33.067844 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.067749    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-istio-podinfo\") pod \"e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") " pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:33.169288 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.169242    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw694\" (UniqueName: \"kubernetes.io/projected/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-kube-api-access-gw694\") pod \"e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") " pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:33.169509 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.169298    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-workload-socket\") pod \"e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") " pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:33.169509 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.169366    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-istio-envoy\") pod \"e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") " pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:33.169509 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.169420    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-istio-podinfo\") pod \"e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") " pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:33.169509 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.169478    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-credential-socket\") pod \"e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") " pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:33.169894 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.169511    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-istiod-ca-cert\") pod \"e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") " pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:33.169894 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.169543    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-istio-data\") pod \"e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") " pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:33.169894 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.169598    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-workload-certs\") pod \"e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") " pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:33.169894 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.169806    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-workload-socket\") pod \"e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") " pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:33.170108 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.169981    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-istio-data\") pod \"e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") " pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:33.170108 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.170029    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-workload-certs\") pod \"e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") " pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:33.170108 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.170055    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-istio-token\") pod \"e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") " pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:33.170240 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.170159    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-credential-socket\") pod \"e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") " pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:33.170349 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.170329    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-istiod-ca-cert\") pod \"e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") " pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:33.172027 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.172006    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-istio-envoy\") pod \"e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") " pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:33.172225 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.172207    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-istio-podinfo\") pod \"e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") " pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:33.178636 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.178603    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-istio-token\") pod \"e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") " pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:33.178809 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.178788    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw694\" (UniqueName: \"kubernetes.io/projected/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-kube-api-access-gw694\") pod \"e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") " pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:33.340133 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.339964    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:33.341251 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.341221    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7778-e20be2" podUID="aa11fa5b-cafe-407c-86ca-f01174249b9f" containerName="test-curl-7778-e20be2" containerID="cri-o://7a22cd6131139edee73ee77bd57f178eda1c18406ba8fbc745944dc1066d78c4" gracePeriod=2
Sep 11 13:15:33.343482 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:15:33.343448    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7778-e20be2\" is forbidden: User \"system:node:ip-10-0-133-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-79.ec2.internal' and this object" podUID="aa11fa5b-cafe-407c-86ca-f01174249b9f" pod="opendatahub/test-curl-7778-e20be2"
Sep 11 13:15:33.420276 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.420235    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:33.529888 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.529862    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7778-1e6f68"
Sep 11 13:15:33.532199 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:15:33.532169    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7778-e20be2\" is forbidden: User \"system:node:ip-10-0-133-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-79.ec2.internal' and this object" podUID="aa11fa5b-cafe-407c-86ca-f01174249b9f" pod="opendatahub/test-curl-7778-e20be2"
Sep 11 13:15:33.573540 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.573510    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msh84\" (UniqueName: \"kubernetes.io/projected/665a85ce-c3ad-4e4a-b565-d1320abd44c6-kube-api-access-msh84\") pod \"665a85ce-c3ad-4e4a-b565-d1320abd44c6\" (UID: \"665a85ce-c3ad-4e4a-b565-d1320abd44c6\") "
Sep 11 13:15:33.575871 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.575837    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/665a85ce-c3ad-4e4a-b565-d1320abd44c6-kube-api-access-msh84" (OuterVolumeSpecName: "kube-api-access-msh84") pod "665a85ce-c3ad-4e4a-b565-d1320abd44c6" (UID: "665a85ce-c3ad-4e4a-b565-d1320abd44c6"). InnerVolumeSpecName "kube-api-access-msh84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:15:33.629018 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.626585    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"]
Sep 11 13:15:33.629542 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:15:33.629507    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeed2505b_ef7d_4a16_9a89_e9ea2bb507c7.slice/crio-9fd85960db0891fe036666d4db50e1dc8e28cac362db46f95c2b4784d0f57f8d WatchSource:0}: Error finding container 9fd85960db0891fe036666d4db50e1dc8e28cac362db46f95c2b4784d0f57f8d: Status 404 returned error can't find the container with id 9fd85960db0891fe036666d4db50e1dc8e28cac362db46f95c2b4784d0f57f8d
Sep 11 13:15:33.632702 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.632666    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:15:33.632808 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.632761    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:15:33.632861 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.632819    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:15:33.663461 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:15:33.663232    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7778-e20be2\" is forbidden: User \"system:node:ip-10-0-133-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-79.ec2.internal' and this object" podUID="aa11fa5b-cafe-407c-86ca-f01174249b9f" pod="opendatahub/test-curl-7778-e20be2"
Sep 11 13:15:33.669069 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.669024    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="665a85ce-c3ad-4e4a-b565-d1320abd44c6" path="/var/lib/kubelet/pods/665a85ce-c3ad-4e4a-b565-d1320abd44c6/volumes"
Sep 11 13:15:33.679538 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.679502    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msh84\" (UniqueName: \"kubernetes.io/projected/665a85ce-c3ad-4e4a-b565-d1320abd44c6-kube-api-access-msh84\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:15:33.709201 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.709168    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-b7gsm_b22738d7-e796-4173-8fb4-80f9208b99dd/console-operator/2.log"
Sep 11 13:15:33.710116 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:33.710089    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-b7gsm_b22738d7-e796-4173-8fb4-80f9208b99dd/console-operator/2.log"
Sep 11 13:15:34.349186 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:34.349145    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5" event={"ID":"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7","Type":"ContainerStarted","Data":"52d35267a2e069a8cd6ea57e981c198c41d9cc527e8ce1ec7a2adeb82972363e"}
Sep 11 13:15:34.349665 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:34.349210    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5" event={"ID":"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7","Type":"ContainerStarted","Data":"9fd85960db0891fe036666d4db50e1dc8e28cac362db46f95c2b4784d0f57f8d"}
Sep 11 13:15:34.350636 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:34.350603    2547 generic.go:356] "Generic (PLEG): container finished" podID="665a85ce-c3ad-4e4a-b565-d1320abd44c6" containerID="5574e539da3179b558f267ea9aef299e01b8390783101a8c2909f243c3fd37f2" exitCode=137
Sep 11 13:15:34.350799 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:34.350659    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7778-1e6f68"
Sep 11 13:15:34.350799 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:34.350694    2547 scope.go:117] "RemoveContainer" containerID="5574e539da3179b558f267ea9aef299e01b8390783101a8c2909f243c3fd37f2"
Sep 11 13:15:34.360844 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:34.360814    2547 scope.go:117] "RemoveContainer" containerID="5574e539da3179b558f267ea9aef299e01b8390783101a8c2909f243c3fd37f2"
Sep 11 13:15:34.361184 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:15:34.361165    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5574e539da3179b558f267ea9aef299e01b8390783101a8c2909f243c3fd37f2\": container with ID starting with 5574e539da3179b558f267ea9aef299e01b8390783101a8c2909f243c3fd37f2 not found: ID does not exist" containerID="5574e539da3179b558f267ea9aef299e01b8390783101a8c2909f243c3fd37f2"
Sep 11 13:15:34.361241 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:34.361195    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5574e539da3179b558f267ea9aef299e01b8390783101a8c2909f243c3fd37f2"} err="failed to get container status \"5574e539da3179b558f267ea9aef299e01b8390783101a8c2909f243c3fd37f2\": rpc error: code = NotFound desc = could not find container \"5574e539da3179b558f267ea9aef299e01b8390783101a8c2909f243c3fd37f2\": container with ID starting with 5574e539da3179b558f267ea9aef299e01b8390783101a8c2909f243c3fd37f2 not found: ID does not exist"
Sep 11 13:15:34.379199 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:34.379141    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5" podStartSLOduration=2.379118032 podStartE2EDuration="2.379118032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:15:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:15:34.375510041 +0000 UTC m=+1201.236984229" watchObservedRunningTime="2026-09-11 13:15:34.379118032 +0000 UTC m=+1201.240592219"
Sep 11 13:15:35.340639 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:35.340591    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:35.346448 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:35.346414    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:35.359054 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:35.359027    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:35.360203 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:35.360184    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:35.547857 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:35.547831    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7778-e20be2"
Sep 11 13:15:35.598956 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:35.598851    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbkv8\" (UniqueName: \"kubernetes.io/projected/aa11fa5b-cafe-407c-86ca-f01174249b9f-kube-api-access-hbkv8\") pod \"aa11fa5b-cafe-407c-86ca-f01174249b9f\" (UID: \"aa11fa5b-cafe-407c-86ca-f01174249b9f\") "
Sep 11 13:15:35.601328 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:35.601294    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa11fa5b-cafe-407c-86ca-f01174249b9f-kube-api-access-hbkv8" (OuterVolumeSpecName: "kube-api-access-hbkv8") pod "aa11fa5b-cafe-407c-86ca-f01174249b9f" (UID: "aa11fa5b-cafe-407c-86ca-f01174249b9f"). InnerVolumeSpecName "kube-api-access-hbkv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:15:35.664814 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:35.664781    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa11fa5b-cafe-407c-86ca-f01174249b9f" path="/var/lib/kubelet/pods/aa11fa5b-cafe-407c-86ca-f01174249b9f/volumes"
Sep 11 13:15:35.700177 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:35.700135    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbkv8\" (UniqueName: \"kubernetes.io/projected/aa11fa5b-cafe-407c-86ca-f01174249b9f-kube-api-access-hbkv8\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:15:35.768964 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:35.768928    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:36.367379 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:36.367343    2547 generic.go:356] "Generic (PLEG): container finished" podID="aa11fa5b-cafe-407c-86ca-f01174249b9f" containerID="7a22cd6131139edee73ee77bd57f178eda1c18406ba8fbc745944dc1066d78c4" exitCode=137
Sep 11 13:15:36.367949 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:36.367405    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7778-e20be2"
Sep 11 13:15:36.367949 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:36.367461    2547 scope.go:117] "RemoveContainer" containerID="7a22cd6131139edee73ee77bd57f178eda1c18406ba8fbc745944dc1066d78c4"
Sep 11 13:15:36.377338 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:36.377318    2547 scope.go:117] "RemoveContainer" containerID="7a22cd6131139edee73ee77bd57f178eda1c18406ba8fbc745944dc1066d78c4"
Sep 11 13:15:36.377832 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:15:36.377701    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a22cd6131139edee73ee77bd57f178eda1c18406ba8fbc745944dc1066d78c4\": container with ID starting with 7a22cd6131139edee73ee77bd57f178eda1c18406ba8fbc745944dc1066d78c4 not found: ID does not exist" containerID="7a22cd6131139edee73ee77bd57f178eda1c18406ba8fbc745944dc1066d78c4"
Sep 11 13:15:36.377951 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:36.377844    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a22cd6131139edee73ee77bd57f178eda1c18406ba8fbc745944dc1066d78c4"} err="failed to get container status \"7a22cd6131139edee73ee77bd57f178eda1c18406ba8fbc745944dc1066d78c4\": rpc error: code = NotFound desc = could not find container \"7a22cd6131139edee73ee77bd57f178eda1c18406ba8fbc745944dc1066d78c4\": container with ID starting with 7a22cd6131139edee73ee77bd57f178eda1c18406ba8fbc745944dc1066d78c4 not found: ID does not exist"
Sep 11 13:15:36.496535 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:36.496495    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:36.608774 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:36.608710    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:36.904350 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:36.904311    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:37.141494 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:15:37.141453    2547 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod665a85ce_c3ad_4e4a_b565_d1320abd44c6.slice/crio-14e34e26bc64c36e6714067cd8378986b844e449361c7162dac64fc74050a48a\": RecentStats: unable to find data in memory cache]"
Sep 11 13:15:37.141682 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:15:37.141520    2547 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod665a85ce_c3ad_4e4a_b565_d1320abd44c6.slice/crio-14e34e26bc64c36e6714067cd8378986b844e449361c7162dac64fc74050a48a\": RecentStats: unable to find data in memory cache]"
Sep 11 13:15:38.055117 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:38.055084    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:38.830988 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:38.830951    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:39.702073 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:39.702040    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:40.479543 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:40.479513    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:40.584448 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:40.584413    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:40.885341 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:40.885309    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:41.154957 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:41.154856    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:41.243967 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:41.243938    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:41.285736 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:41.283621    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-13b2e851-678f688bd5-89hxl"]
Sep 11 13:15:41.290618 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:41.290592    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-13b2e851-678f688bd5-89hxl"
Sep 11 13:15:41.293530 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:41.293496    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-13b2e851-dockercfg-xzgdd\""
Sep 11 13:15:41.293672 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:41.293502    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-13b2e851\""
Sep 11 13:15:41.296064 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:41.296042    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-13b2e851-678f688bd5-89hxl"]
Sep 11 13:15:41.359184 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:41.359150    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nqd7\" (UniqueName: \"kubernetes.io/projected/b7646476-26d6-4c9e-a35a-abc376ff39b7-kube-api-access-2nqd7\") pod \"payload-processing-e2e-mt-13b2e851-678f688bd5-89hxl\" (UID: \"b7646476-26d6-4c9e-a35a-abc376ff39b7\") " pod="openshift-ingress/payload-processing-e2e-mt-13b2e851-678f688bd5-89hxl"
Sep 11 13:15:41.359364 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:41.359192    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7646476-26d6-4c9e-a35a-abc376ff39b7-plugins-config-volume\") pod \"payload-processing-e2e-mt-13b2e851-678f688bd5-89hxl\" (UID: \"b7646476-26d6-4c9e-a35a-abc376ff39b7\") " pod="openshift-ingress/payload-processing-e2e-mt-13b2e851-678f688bd5-89hxl"
Sep 11 13:15:41.460301 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:41.460210    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nqd7\" (UniqueName: \"kubernetes.io/projected/b7646476-26d6-4c9e-a35a-abc376ff39b7-kube-api-access-2nqd7\") pod \"payload-processing-e2e-mt-13b2e851-678f688bd5-89hxl\" (UID: \"b7646476-26d6-4c9e-a35a-abc376ff39b7\") " pod="openshift-ingress/payload-processing-e2e-mt-13b2e851-678f688bd5-89hxl"
Sep 11 13:15:41.460301 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:41.460257    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7646476-26d6-4c9e-a35a-abc376ff39b7-plugins-config-volume\") pod \"payload-processing-e2e-mt-13b2e851-678f688bd5-89hxl\" (UID: \"b7646476-26d6-4c9e-a35a-abc376ff39b7\") " pod="openshift-ingress/payload-processing-e2e-mt-13b2e851-678f688bd5-89hxl"
Sep 11 13:15:41.461022 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:41.461001    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7646476-26d6-4c9e-a35a-abc376ff39b7-plugins-config-volume\") pod \"payload-processing-e2e-mt-13b2e851-678f688bd5-89hxl\" (UID: \"b7646476-26d6-4c9e-a35a-abc376ff39b7\") " pod="openshift-ingress/payload-processing-e2e-mt-13b2e851-678f688bd5-89hxl"
Sep 11 13:15:41.468858 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:41.468835    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nqd7\" (UniqueName: \"kubernetes.io/projected/b7646476-26d6-4c9e-a35a-abc376ff39b7-kube-api-access-2nqd7\") pod \"payload-processing-e2e-mt-13b2e851-678f688bd5-89hxl\" (UID: \"b7646476-26d6-4c9e-a35a-abc376ff39b7\") " pod="openshift-ingress/payload-processing-e2e-mt-13b2e851-678f688bd5-89hxl"
Sep 11 13:15:41.603919 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:41.603884    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-13b2e851-678f688bd5-89hxl"
Sep 11 13:15:41.666100 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:41.666063    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:41.887743 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:41.887665    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-13b2e851-678f688bd5-89hxl"]
Sep 11 13:15:41.899201 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:15:41.899175    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7646476_26d6_4c9e_a35a_abc376ff39b7.slice/crio-e1235f6d3c4a433e1d0c5ae4b7c6df9cfed07a87aee963ae60ffbece3bea42eb WatchSource:0}: Error finding container e1235f6d3c4a433e1d0c5ae4b7c6df9cfed07a87aee963ae60ffbece3bea42eb: Status 404 returned error can't find the container with id e1235f6d3c4a433e1d0c5ae4b7c6df9cfed07a87aee963ae60ffbece3bea42eb
Sep 11 13:15:42.411525 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:42.411486    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-13b2e851-678f688bd5-89hxl" event={"ID":"b7646476-26d6-4c9e-a35a-abc376ff39b7","Type":"ContainerStarted","Data":"49b11f3d35320885103482c18a1779354913c8827e6e2da6e3e8317e20f813ac"}
Sep 11 13:15:42.411775 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:42.411543    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-13b2e851-678f688bd5-89hxl" event={"ID":"b7646476-26d6-4c9e-a35a-abc376ff39b7","Type":"ContainerStarted","Data":"e1235f6d3c4a433e1d0c5ae4b7c6df9cfed07a87aee963ae60ffbece3bea42eb"}
Sep 11 13:15:42.411775 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:42.411568    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-13b2e851-678f688bd5-89hxl"
Sep 11 13:15:42.432216 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:42.432163    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-13b2e851-678f688bd5-89hxl" podStartSLOduration=1.432140649 podStartE2EDuration="1.432140649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:15:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:15:42.430378668 +0000 UTC m=+1209.291852854" watchObservedRunningTime="2026-09-11 13:15:42.432140649 +0000 UTC m=+1209.293614836"
Sep 11 13:15:42.571397 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:42.571354    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:47.199989 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:15:47.199953    2547 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod665a85ce_c3ad_4e4a_b565_d1320abd44c6.slice/crio-14e34e26bc64c36e6714067cd8378986b844e449361c7162dac64fc74050a48a\": RecentStats: unable to find data in memory cache]"
Sep 11 13:15:52.115123 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:15:52.115078    2547 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod665a85ce_c3ad_4e4a_b565_d1320abd44c6.slice/crio-14e34e26bc64c36e6714067cd8378986b844e449361c7162dac64fc74050a48a\": RecentStats: unable to find data in memory cache]"
Sep 11 13:15:53.419939 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:53.419904    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-13b2e851-678f688bd5-89hxl"
Sep 11 13:15:55.518056 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:55.518018    2547 generic.go:356] "Generic (PLEG): container finished" podID="eed2505b-ef7d-4a16-9a89-e9ea2bb507c7" containerID="52d35267a2e069a8cd6ea57e981c198c41d9cc527e8ce1ec7a2adeb82972363e" exitCode=0
Sep 11 13:15:55.518478 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:55.518095    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5" event={"ID":"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7","Type":"ContainerDied","Data":"52d35267a2e069a8cd6ea57e981c198c41d9cc527e8ce1ec7a2adeb82972363e"}
Sep 11 13:15:55.518530 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:55.518505    2547 scope.go:117] "RemoveContainer" containerID="52d35267a2e069a8cd6ea57e981c198c41d9cc527e8ce1ec7a2adeb82972363e"
Sep 11 13:15:55.519686 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:55.519659    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:15:55.519806 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:55.519787    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:15:55.519857 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:55.519836    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:15:56.527321 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:56.527287    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5" event={"ID":"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7","Type":"ContainerStarted","Data":"366f829f3a9e01db8a52bd4cb928b0876cf0bc5d27effe06b620a8e35249072d"}
Sep 11 13:15:57.272771 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:15:57.272733    2547 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod665a85ce_c3ad_4e4a_b565_d1320abd44c6.slice/crio-14e34e26bc64c36e6714067cd8378986b844e449361c7162dac64fc74050a48a\": RecentStats: unable to find data in memory cache]"
Sep 11 13:15:57.353170 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:57.353131    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:15:57.353393 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:57.353192    2547 patch_prober.go:28] interesting pod/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 11 13:15:57.353393 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:57.353273    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5" podUID="eed2505b-ef7d-4a16-9a89-e9ea2bb507c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 11 13:15:58.341476 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:58.341437    2547 patch_prober.go:28] interesting pod/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 11 13:15:58.342147 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:58.342105    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5" podUID="eed2505b-ef7d-4a16-9a89-e9ea2bb507c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 11 13:15:59.340782 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:59.340708    2547 patch_prober.go:28] interesting pod/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 11 13:15:59.341127 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:15:59.341086    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5" podUID="eed2505b-ef7d-4a16-9a89-e9ea2bb507c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 11 13:16:00.340805 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:00.340768    2547 patch_prober.go:28] interesting pod/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 11 13:16:00.341422 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:00.341374    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5" podUID="eed2505b-ef7d-4a16-9a89-e9ea2bb507c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 11 13:16:01.340839 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:01.340789    2547 patch_prober.go:28] interesting pod/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 11 13:16:01.341381 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:01.340878    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5" podUID="eed2505b-ef7d-4a16-9a89-e9ea2bb507c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 11 13:16:02.076082 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:16:02.076037    2547 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod665a85ce_c3ad_4e4a_b565_d1320abd44c6.slice/crio-14e34e26bc64c36e6714067cd8378986b844e449361c7162dac64fc74050a48a\": RecentStats: unable to find data in memory cache]"
Sep 11 13:16:02.076470 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:16:02.076443    2547 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod665a85ce_c3ad_4e4a_b565_d1320abd44c6.slice/crio-14e34e26bc64c36e6714067cd8378986b844e449361c7162dac64fc74050a48a\": RecentStats: unable to find data in memory cache]"
Sep 11 13:16:02.345640 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:02.345556    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:16:02.346101 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:02.345983    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:16:02.346581 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:02.346563    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:16:02.844658 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:02.844621    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:04.344158 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:04.344111    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:04.482768 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:04.482733    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:05.141983 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:05.141946    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:05.514186 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:05.514086    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:05.991551 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:05.991502    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:06.638317 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:06.638277    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:06.881323 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:06.881280    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:07.148276 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:16:07.148244    2547 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod665a85ce_c3ad_4e4a_b565_d1320abd44c6.slice/crio-14e34e26bc64c36e6714067cd8378986b844e449361c7162dac64fc74050a48a\": RecentStats: unable to find data in memory cache]"
Sep 11 13:16:07.282784 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:16:07.282752    2547 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod665a85ce_c3ad_4e4a_b565_d1320abd44c6.slice/crio-14e34e26bc64c36e6714067cd8378986b844e449361c7162dac64fc74050a48a\": RecentStats: unable to find data in memory cache]"
Sep 11 13:16:07.388627 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:07.388588    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:11.237795 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:11.237695    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"]
Sep 11 13:16:11.241483 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:11.241466    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"
Sep 11 13:16:11.244539 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:11.244505    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-13b2e851\"/\"kube-root-ca.crt\""
Sep 11 13:16:11.245215 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:11.245194    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-13b2e851\"/\"openshift-service-ca.crt\""
Sep 11 13:16:11.245336 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:11.245212    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-13b2e851\"/\"e2e-lifecycle-model-13b2e851-kserve-self-signed-certs\""
Sep 11 13:16:11.245444 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:11.245424    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-13b2e851\"/\"default-dockercfg-gtpkx\""
Sep 11 13:16:11.260767 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:11.260709    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"]
Sep 11 13:16:11.283237 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:11.283186    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4fc9\" (UniqueName: \"kubernetes.io/projected/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-kube-api-access-f4fc9\") pod \"e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb\" (UID: \"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a\") " pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"
Sep 11 13:16:11.283380 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:11.283302    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-home\") pod \"e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb\" (UID: \"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a\") " pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"
Sep 11 13:16:11.283380 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:11.283337    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-dshm\") pod \"e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb\" (UID: \"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a\") " pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"
Sep 11 13:16:11.283380 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:11.283376    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-model-cache\") pod \"e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb\" (UID: \"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a\") " pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"
Sep 11 13:16:11.283548 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:11.283390    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-tmp-dir\") pod \"e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb\" (UID: \"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a\") " pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"
Sep 11 13:16:11.283548 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:11.283468    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-tls-certs\") pod \"e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb\" (UID: \"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a\") " pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"
Sep 11 13:16:11.339889 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:11.339859    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:11.384362 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:11.384328    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-dshm\") pod \"e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb\" (UID: \"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a\") " pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"
Sep 11 13:16:11.384533 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:11.384379    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-model-cache\") pod \"e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb\" (UID: \"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a\") " pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"
Sep 11 13:16:11.384533 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:11.384397    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-tmp-dir\") pod \"e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb\" (UID: \"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a\") " pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"
Sep 11 13:16:11.384533 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:11.384457    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-tls-certs\") pod \"e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb\" (UID: \"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a\") " pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"
Sep 11 13:16:11.384533 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:11.384497    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4fc9\" (UniqueName: \"kubernetes.io/projected/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-kube-api-access-f4fc9\") pod \"e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb\" (UID: \"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a\") " pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"
Sep 11 13:16:11.384795 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:11.384585    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-home\") pod \"e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb\" (UID: \"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a\") " pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"
Sep 11 13:16:11.384876 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:11.384846    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-tmp-dir\") pod \"e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb\" (UID: \"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a\") " pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"
Sep 11 13:16:11.384912 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:11.384879    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-model-cache\") pod \"e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb\" (UID: \"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a\") " pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"
Sep 11 13:16:11.384912 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:11.384904    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-home\") pod \"e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb\" (UID: \"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a\") " pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"
Sep 11 13:16:11.386805 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:11.386786    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-dshm\") pod \"e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb\" (UID: \"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a\") " pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"
Sep 11 13:16:11.387073 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:11.387055    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-tls-certs\") pod \"e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb\" (UID: \"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a\") " pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"
Sep 11 13:16:11.396589 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:11.396560    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4fc9\" (UniqueName: \"kubernetes.io/projected/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-kube-api-access-f4fc9\") pod \"e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb\" (UID: \"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a\") " pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"
Sep 11 13:16:11.550824 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:11.550735    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"
Sep 11 13:16:11.830909 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:11.830879    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"]
Sep 11 13:16:11.832487 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:16:11.832461    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8e5e8c3_ca3c_4646_86b4_5ac05a51812a.slice/crio-9b1a7040d1c77a952b0fbc331d4af04b73df25d0b02a8208bd425ce3bd0b32b9 WatchSource:0}: Error finding container 9b1a7040d1c77a952b0fbc331d4af04b73df25d0b02a8208bd425ce3bd0b32b9: Status 404 returned error can't find the container with id 9b1a7040d1c77a952b0fbc331d4af04b73df25d0b02a8208bd425ce3bd0b32b9
Sep 11 13:16:12.638427 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:12.638389    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb" event={"ID":"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a","Type":"ContainerStarted","Data":"e14b1590f9ce3a3b915670dc7cf0860c6e7d5455ac1f78a945f6b561d8d83ac9"}
Sep 11 13:16:12.638832 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:12.638436    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb" event={"ID":"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a","Type":"ContainerStarted","Data":"9b1a7040d1c77a952b0fbc331d4af04b73df25d0b02a8208bd425ce3bd0b32b9"}
Sep 11 13:16:12.660093 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:12.660048    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb" podStartSLOduration=1.660033366 podStartE2EDuration="1.660033366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:16:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:16:12.656737289 +0000 UTC m=+1239.518211471" watchObservedRunningTime="2026-09-11 13:16:12.660033366 +0000 UTC m=+1239.521507553"
Sep 11 13:16:17.337453 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:16:17.337414    2547 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod665a85ce_c3ad_4e4a_b565_d1320abd44c6.slice/crio-14e34e26bc64c36e6714067cd8378986b844e449361c7162dac64fc74050a48a\": RecentStats: unable to find data in memory cache]"
Sep 11 13:16:21.551685 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:21.551648    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"
Sep 11 13:16:21.552104 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:21.551704    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"
Sep 11 13:16:21.564129 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:21.564094    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"
Sep 11 13:16:21.706290 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:21.706261    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"
Sep 11 13:16:22.111380 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:16:22.111344    2547 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod665a85ce_c3ad_4e4a_b565_d1320abd44c6.slice/crio-14e34e26bc64c36e6714067cd8378986b844e449361c7162dac64fc74050a48a\": RecentStats: unable to find data in memory cache]"
Sep 11 13:16:27.386960 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:16:27.386884    2547 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod665a85ce_c3ad_4e4a_b565_d1320abd44c6.slice/crio-14e34e26bc64c36e6714067cd8378986b844e449361c7162dac64fc74050a48a\": RecentStats: unable to find data in memory cache]"
Sep 11 13:16:33.834406 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:33.834372    2547 scope.go:117] "RemoveContainer" containerID="80de273d62a3e90149a5d7dad35d2fc73329ce964d83be4a711e5ac1d7d4384a"
Sep 11 13:16:33.844747 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:33.844704    2547 scope.go:117] "RemoveContainer" containerID="e17eac204e091b033edeeda67581c6ba0b44f3d8f289a4b4fd1756d7b4bb0721"
Sep 11 13:16:47.504017 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:47.503978    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:48.820636 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:48.820584    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:50.279705 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:50.279667    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:51.937660 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:51.937623    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:53.865148 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:53.865107    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:55.165300 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:16:55.165270    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:17:02.359632 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:02.359574    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:17:02.488916 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:02.488881    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-13b2e851-678f688bd5-89hxl"]
Sep 11 13:17:02.489120 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:02.489100    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-13b2e851-678f688bd5-89hxl" podUID="b7646476-26d6-4c9e-a35a-abc376ff39b7" containerName="payload-processing" containerID="cri-o://49b11f3d35320885103482c18a1779354913c8827e6e2da6e3e8317e20f813ac" gracePeriod=30
Sep 11 13:17:02.743328 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:02.743307    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-13b2e851-678f688bd5-89hxl"
Sep 11 13:17:02.833131 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:02.833098    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:17:02.921333 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:02.921229    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7646476-26d6-4c9e-a35a-abc376ff39b7-plugins-config-volume\") pod \"b7646476-26d6-4c9e-a35a-abc376ff39b7\" (UID: \"b7646476-26d6-4c9e-a35a-abc376ff39b7\") "
Sep 11 13:17:02.921515 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:02.921353    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nqd7\" (UniqueName: \"kubernetes.io/projected/b7646476-26d6-4c9e-a35a-abc376ff39b7-kube-api-access-2nqd7\") pod \"b7646476-26d6-4c9e-a35a-abc376ff39b7\" (UID: \"b7646476-26d6-4c9e-a35a-abc376ff39b7\") "
Sep 11 13:17:02.921647 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:02.921622    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7646476-26d6-4c9e-a35a-abc376ff39b7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b7646476-26d6-4c9e-a35a-abc376ff39b7" (UID: "b7646476-26d6-4c9e-a35a-abc376ff39b7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:17:02.923860 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:02.923827    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7646476-26d6-4c9e-a35a-abc376ff39b7-kube-api-access-2nqd7" (OuterVolumeSpecName: "kube-api-access-2nqd7") pod "b7646476-26d6-4c9e-a35a-abc376ff39b7" (UID: "b7646476-26d6-4c9e-a35a-abc376ff39b7"). InnerVolumeSpecName "kube-api-access-2nqd7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:17:02.949629 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:02.949596    2547 generic.go:356] "Generic (PLEG): container finished" podID="b7646476-26d6-4c9e-a35a-abc376ff39b7" containerID="49b11f3d35320885103482c18a1779354913c8827e6e2da6e3e8317e20f813ac" exitCode=0
Sep 11 13:17:02.949800 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:02.949639    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-13b2e851-678f688bd5-89hxl"
Sep 11 13:17:02.949800 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:02.949677    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-13b2e851-678f688bd5-89hxl" event={"ID":"b7646476-26d6-4c9e-a35a-abc376ff39b7","Type":"ContainerDied","Data":"49b11f3d35320885103482c18a1779354913c8827e6e2da6e3e8317e20f813ac"}
Sep 11 13:17:02.949800 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:02.949752    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-13b2e851-678f688bd5-89hxl" event={"ID":"b7646476-26d6-4c9e-a35a-abc376ff39b7","Type":"ContainerDied","Data":"e1235f6d3c4a433e1d0c5ae4b7c6df9cfed07a87aee963ae60ffbece3bea42eb"}
Sep 11 13:17:02.949800 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:02.949775    2547 scope.go:117] "RemoveContainer" containerID="49b11f3d35320885103482c18a1779354913c8827e6e2da6e3e8317e20f813ac"
Sep 11 13:17:02.959433 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:02.959416    2547 scope.go:117] "RemoveContainer" containerID="49b11f3d35320885103482c18a1779354913c8827e6e2da6e3e8317e20f813ac"
Sep 11 13:17:02.959698 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:17:02.959681    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49b11f3d35320885103482c18a1779354913c8827e6e2da6e3e8317e20f813ac\": container with ID starting with 49b11f3d35320885103482c18a1779354913c8827e6e2da6e3e8317e20f813ac not found: ID does not exist" containerID="49b11f3d35320885103482c18a1779354913c8827e6e2da6e3e8317e20f813ac"
Sep 11 13:17:02.959770 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:02.959708    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49b11f3d35320885103482c18a1779354913c8827e6e2da6e3e8317e20f813ac"} err="failed to get container status \"49b11f3d35320885103482c18a1779354913c8827e6e2da6e3e8317e20f813ac\": rpc error: code = NotFound desc = could not find container \"49b11f3d35320885103482c18a1779354913c8827e6e2da6e3e8317e20f813ac\": container with ID starting with 49b11f3d35320885103482c18a1779354913c8827e6e2da6e3e8317e20f813ac not found: ID does not exist"
Sep 11 13:17:03.022449 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:03.022416    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nqd7\" (UniqueName: \"kubernetes.io/projected/b7646476-26d6-4c9e-a35a-abc376ff39b7-kube-api-access-2nqd7\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:17:03.022449 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:03.022444    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7646476-26d6-4c9e-a35a-abc376ff39b7-plugins-config-volume\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:17:03.108631 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:03.108596    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-13b2e851-678f688bd5-89hxl"]
Sep 11 13:17:03.120620 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:03.120593    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-13b2e851-678f688bd5-89hxl"]
Sep 11 13:17:03.312827 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:03.312792    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:17:03.665300 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:03.665215    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7646476-26d6-4c9e-a35a-abc376ff39b7" path="/var/lib/kubelet/pods/b7646476-26d6-4c9e-a35a-abc376ff39b7/volumes"
Sep 11 13:17:03.733747 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:03.733697    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:17:04.550179 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:04.550151    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:17:04.573135 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:04.573107    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"]
Sep 11 13:17:04.934547 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:04.934512    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:17:05.969338 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:05.969302    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"]
Sep 11 13:17:06.076344 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:06.076311    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:17:06.807916 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:06.807881    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:17:07.637498 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:07.637457    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:17:08.246884 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:08.246839    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:17:09.939910 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:09.939877    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:17:11.555864 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:11.555822    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:17:12.557666 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:12.557630    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"]
Sep 11 13:17:12.859886 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:12.859800    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:17:18.831643 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:18.831601    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:17:19.592363 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:19.592319    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4" podUID="ed34e897-1452-4d52-80d2-4a7884345b65" containerName="main" containerID="cri-o://81b4f89708138e60ddfea571d11d4f928a3312aabae567c3d692901f21a4476c" gracePeriod=45
Sep 11 13:17:19.842046 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:19.842020    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"
Sep 11 13:17:19.874530 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:19.874457    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed34e897-1452-4d52-80d2-4a7884345b65-tmp-dir\") pod \"ed34e897-1452-4d52-80d2-4a7884345b65\" (UID: \"ed34e897-1452-4d52-80d2-4a7884345b65\") "
Sep 11 13:17:19.874671 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:19.874536    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed34e897-1452-4d52-80d2-4a7884345b65-model-cache\") pod \"ed34e897-1452-4d52-80d2-4a7884345b65\" (UID: \"ed34e897-1452-4d52-80d2-4a7884345b65\") "
Sep 11 13:17:19.874671 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:19.874571    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed34e897-1452-4d52-80d2-4a7884345b65-home\") pod \"ed34e897-1452-4d52-80d2-4a7884345b65\" (UID: \"ed34e897-1452-4d52-80d2-4a7884345b65\") "
Sep 11 13:17:19.874671 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:19.874645    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed34e897-1452-4d52-80d2-4a7884345b65-dshm\") pod \"ed34e897-1452-4d52-80d2-4a7884345b65\" (UID: \"ed34e897-1452-4d52-80d2-4a7884345b65\") "
Sep 11 13:17:19.874857 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:19.874682    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7j4w4\" (UniqueName: \"kubernetes.io/projected/ed34e897-1452-4d52-80d2-4a7884345b65-kube-api-access-7j4w4\") pod \"ed34e897-1452-4d52-80d2-4a7884345b65\" (UID: \"ed34e897-1452-4d52-80d2-4a7884345b65\") "
Sep 11 13:17:19.874857 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:19.874706    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed34e897-1452-4d52-80d2-4a7884345b65-tls-certs\") pod \"ed34e897-1452-4d52-80d2-4a7884345b65\" (UID: \"ed34e897-1452-4d52-80d2-4a7884345b65\") "
Sep 11 13:17:19.874975 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:19.874951    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed34e897-1452-4d52-80d2-4a7884345b65-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ed34e897-1452-4d52-80d2-4a7884345b65" (UID: "ed34e897-1452-4d52-80d2-4a7884345b65"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:17:19.875152 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:19.875131    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed34e897-1452-4d52-80d2-4a7884345b65-tmp-dir\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:17:19.875373 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:19.875345    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed34e897-1452-4d52-80d2-4a7884345b65-model-cache" (OuterVolumeSpecName: "model-cache") pod "ed34e897-1452-4d52-80d2-4a7884345b65" (UID: "ed34e897-1452-4d52-80d2-4a7884345b65"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:17:19.875486 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:19.875367    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed34e897-1452-4d52-80d2-4a7884345b65-home" (OuterVolumeSpecName: "home") pod "ed34e897-1452-4d52-80d2-4a7884345b65" (UID: "ed34e897-1452-4d52-80d2-4a7884345b65"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:17:19.878104 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:19.878075    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed34e897-1452-4d52-80d2-4a7884345b65-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ed34e897-1452-4d52-80d2-4a7884345b65" (UID: "ed34e897-1452-4d52-80d2-4a7884345b65"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:17:19.878336 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:19.878309    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed34e897-1452-4d52-80d2-4a7884345b65-dshm" (OuterVolumeSpecName: "dshm") pod "ed34e897-1452-4d52-80d2-4a7884345b65" (UID: "ed34e897-1452-4d52-80d2-4a7884345b65"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:17:19.878336 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:19.878325    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed34e897-1452-4d52-80d2-4a7884345b65-kube-api-access-7j4w4" (OuterVolumeSpecName: "kube-api-access-7j4w4") pod "ed34e897-1452-4d52-80d2-4a7884345b65" (UID: "ed34e897-1452-4d52-80d2-4a7884345b65"). InnerVolumeSpecName "kube-api-access-7j4w4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:17:19.976270 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:19.976246    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed34e897-1452-4d52-80d2-4a7884345b65-model-cache\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:17:19.976270 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:19.976269    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed34e897-1452-4d52-80d2-4a7884345b65-home\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:17:19.976436 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:19.976278    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed34e897-1452-4d52-80d2-4a7884345b65-dshm\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:17:19.976436 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:19.976286    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7j4w4\" (UniqueName: \"kubernetes.io/projected/ed34e897-1452-4d52-80d2-4a7884345b65-kube-api-access-7j4w4\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:17:19.976436 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:19.976295    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed34e897-1452-4d52-80d2-4a7884345b65-tls-certs\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:17:20.053932 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:20.053899    2547 generic.go:356] "Generic (PLEG): container finished" podID="ed34e897-1452-4d52-80d2-4a7884345b65" containerID="81b4f89708138e60ddfea571d11d4f928a3312aabae567c3d692901f21a4476c" exitCode=0
Sep 11 13:17:20.054075 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:20.053941    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"
Sep 11 13:17:20.054075 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:20.053982    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4" event={"ID":"ed34e897-1452-4d52-80d2-4a7884345b65","Type":"ContainerDied","Data":"81b4f89708138e60ddfea571d11d4f928a3312aabae567c3d692901f21a4476c"}
Sep 11 13:17:20.054075 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:20.054020    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4" event={"ID":"ed34e897-1452-4d52-80d2-4a7884345b65","Type":"ContainerDied","Data":"05d0494300de62e869b113a7eb7ab1e8a9772e472912058d307b38d8576d242b"}
Sep 11 13:17:20.054075 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:20.054038    2547 scope.go:117] "RemoveContainer" containerID="81b4f89708138e60ddfea571d11d4f928a3312aabae567c3d692901f21a4476c"
Sep 11 13:17:20.064430 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:20.064404    2547 scope.go:117] "RemoveContainer" containerID="81b4f89708138e60ddfea571d11d4f928a3312aabae567c3d692901f21a4476c"
Sep 11 13:17:20.064688 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:17:20.064669    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81b4f89708138e60ddfea571d11d4f928a3312aabae567c3d692901f21a4476c\": container with ID starting with 81b4f89708138e60ddfea571d11d4f928a3312aabae567c3d692901f21a4476c not found: ID does not exist" containerID="81b4f89708138e60ddfea571d11d4f928a3312aabae567c3d692901f21a4476c"
Sep 11 13:17:20.064763 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:20.064698    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81b4f89708138e60ddfea571d11d4f928a3312aabae567c3d692901f21a4476c"} err="failed to get container status \"81b4f89708138e60ddfea571d11d4f928a3312aabae567c3d692901f21a4476c\": rpc error: code = NotFound desc = could not find container \"81b4f89708138e60ddfea571d11d4f928a3312aabae567c3d692901f21a4476c\": container with ID starting with 81b4f89708138e60ddfea571d11d4f928a3312aabae567c3d692901f21a4476c not found: ID does not exist"
Sep 11 13:17:20.079045 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:20.079023    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"]
Sep 11 13:17:20.083226 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:20.083207    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1841da/auth-test-model-1841da-kserve-65f996569f-dtmr4"]
Sep 11 13:17:20.988911 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:20.988843    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2" podUID="27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103" containerName="main" containerID="cri-o://9f2575e3fb3effe92956af56b93c438f25d39c77abbf71b522cd95902e1ff738" gracePeriod=45
Sep 11 13:17:21.240791 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:21.240733    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"
Sep 11 13:17:21.291558 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:21.291528    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-tls-certs\") pod \"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103\" (UID: \"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103\") "
Sep 11 13:17:21.291785 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:21.291603    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdgk4\" (UniqueName: \"kubernetes.io/projected/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-kube-api-access-bdgk4\") pod \"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103\" (UID: \"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103\") "
Sep 11 13:17:21.291785 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:21.291630    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-home\") pod \"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103\" (UID: \"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103\") "
Sep 11 13:17:21.291785 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:21.291661    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-model-cache\") pod \"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103\" (UID: \"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103\") "
Sep 11 13:17:21.291785 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:21.291697    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-tmp-dir\") pod \"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103\" (UID: \"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103\") "
Sep 11 13:17:21.291785 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:21.291745    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-dshm\") pod \"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103\" (UID: \"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103\") "
Sep 11 13:17:21.292088 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:21.291947    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-model-cache" (OuterVolumeSpecName: "model-cache") pod "27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103" (UID: "27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:17:21.292088 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:21.291957    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-home" (OuterVolumeSpecName: "home") pod "27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103" (UID: "27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:17:21.292088 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:21.292049    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103" (UID: "27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:17:21.292268 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:21.292168    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-home\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:17:21.292268 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:21.292188    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-model-cache\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:17:21.292268 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:21.292203    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-tmp-dir\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:17:21.294085 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:21.294051    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103" (UID: "27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:17:21.294085 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:21.294070    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-kube-api-access-bdgk4" (OuterVolumeSpecName: "kube-api-access-bdgk4") pod "27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103" (UID: "27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103"). InnerVolumeSpecName "kube-api-access-bdgk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:17:21.294262 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:21.294127    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-dshm" (OuterVolumeSpecName: "dshm") pod "27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103" (UID: "27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:17:21.393517 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:21.393473    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdgk4\" (UniqueName: \"kubernetes.io/projected/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-kube-api-access-bdgk4\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:17:21.393517 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:21.393513    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-dshm\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:17:21.393517 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:21.393523    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103-tls-certs\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:17:21.664667 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:21.664633    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed34e897-1452-4d52-80d2-4a7884345b65" path="/var/lib/kubelet/pods/ed34e897-1452-4d52-80d2-4a7884345b65/volumes"
Sep 11 13:17:22.068204 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:22.068173    2547 generic.go:356] "Generic (PLEG): container finished" podID="27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103" containerID="9f2575e3fb3effe92956af56b93c438f25d39c77abbf71b522cd95902e1ff738" exitCode=0
Sep 11 13:17:22.068677 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:22.068226    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"
Sep 11 13:17:22.068677 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:22.068263    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2" event={"ID":"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103","Type":"ContainerDied","Data":"9f2575e3fb3effe92956af56b93c438f25d39c77abbf71b522cd95902e1ff738"}
Sep 11 13:17:22.068677 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:22.068310    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2" event={"ID":"27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103","Type":"ContainerDied","Data":"2df3930bf31dc225a1cf17a97cf0eb0e2c1b764b9e18c8560183a6421c04f27e"}
Sep 11 13:17:22.068677 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:22.068331    2547 scope.go:117] "RemoveContainer" containerID="9f2575e3fb3effe92956af56b93c438f25d39c77abbf71b522cd95902e1ff738"
Sep 11 13:17:22.078031 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:22.078009    2547 scope.go:117] "RemoveContainer" containerID="9f2575e3fb3effe92956af56b93c438f25d39c77abbf71b522cd95902e1ff738"
Sep 11 13:17:22.078282 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:17:22.078258    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f2575e3fb3effe92956af56b93c438f25d39c77abbf71b522cd95902e1ff738\": container with ID starting with 9f2575e3fb3effe92956af56b93c438f25d39c77abbf71b522cd95902e1ff738 not found: ID does not exist" containerID="9f2575e3fb3effe92956af56b93c438f25d39c77abbf71b522cd95902e1ff738"
Sep 11 13:17:22.078372 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:22.078291    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f2575e3fb3effe92956af56b93c438f25d39c77abbf71b522cd95902e1ff738"} err="failed to get container status \"9f2575e3fb3effe92956af56b93c438f25d39c77abbf71b522cd95902e1ff738\": rpc error: code = NotFound desc = could not find container \"9f2575e3fb3effe92956af56b93c438f25d39c77abbf71b522cd95902e1ff738\": container with ID starting with 9f2575e3fb3effe92956af56b93c438f25d39c77abbf71b522cd95902e1ff738 not found: ID does not exist"
Sep 11 13:17:22.105690 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:22.105656    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"]
Sep 11 13:17:22.119259 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:22.119225    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-82825f/auth-test-model-82825f-kserve-bd5597f79-cwdn2"]
Sep 11 13:17:23.663855 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:23.663824    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103" path="/var/lib/kubelet/pods/27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103/volumes"
Sep 11 13:17:27.577056 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:27.577015    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb" podUID="a8e5e8c3-ca3c-4646-86b4-5ac05a51812a" containerName="main" containerID="cri-o://e14b1590f9ce3a3b915670dc7cf0860c6e7d5455ac1f78a945f6b561d8d83ac9" gracePeriod=45
Sep 11 13:17:27.612449 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:17:27.612422    2547 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8e5e8c3_ca3c_4646_86b4_5ac05a51812a.slice/crio-conmon-e14b1590f9ce3a3b915670dc7cf0860c6e7d5455ac1f78a945f6b561d8d83ac9.scope\": RecentStats: unable to find data in memory cache]"
Sep 11 13:17:27.830154 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:27.830088    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"
Sep 11 13:17:27.960193 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:27.960137    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4fc9\" (UniqueName: \"kubernetes.io/projected/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-kube-api-access-f4fc9\") pod \"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a\" (UID: \"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a\") "
Sep 11 13:17:27.960366 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:27.960212    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-tmp-dir\") pod \"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a\" (UID: \"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a\") "
Sep 11 13:17:27.960366 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:27.960273    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-model-cache\") pod \"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a\" (UID: \"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a\") "
Sep 11 13:17:27.960366 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:27.960307    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-dshm\") pod \"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a\" (UID: \"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a\") "
Sep 11 13:17:27.960366 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:27.960330    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-tls-certs\") pod \"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a\" (UID: \"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a\") "
Sep 11 13:17:27.960366 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:27.960368    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-home\") pod \"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a\" (UID: \"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a\") "
Sep 11 13:17:27.960855 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:27.960491    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a8e5e8c3-ca3c-4646-86b4-5ac05a51812a" (UID: "a8e5e8c3-ca3c-4646-86b4-5ac05a51812a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:17:27.960855 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:27.960590    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-model-cache" (OuterVolumeSpecName: "model-cache") pod "a8e5e8c3-ca3c-4646-86b4-5ac05a51812a" (UID: "a8e5e8c3-ca3c-4646-86b4-5ac05a51812a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:17:27.960855 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:27.960773    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-home" (OuterVolumeSpecName: "home") pod "a8e5e8c3-ca3c-4646-86b4-5ac05a51812a" (UID: "a8e5e8c3-ca3c-4646-86b4-5ac05a51812a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:17:27.960855 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:27.960688    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-model-cache\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:17:27.960855 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:27.960849    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-tmp-dir\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:17:27.962535 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:27.962510    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-dshm" (OuterVolumeSpecName: "dshm") pod "a8e5e8c3-ca3c-4646-86b4-5ac05a51812a" (UID: "a8e5e8c3-ca3c-4646-86b4-5ac05a51812a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:17:27.962535 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:27.962522    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-kube-api-access-f4fc9" (OuterVolumeSpecName: "kube-api-access-f4fc9") pod "a8e5e8c3-ca3c-4646-86b4-5ac05a51812a" (UID: "a8e5e8c3-ca3c-4646-86b4-5ac05a51812a"). InnerVolumeSpecName "kube-api-access-f4fc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:17:27.962677 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:27.962557    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a8e5e8c3-ca3c-4646-86b4-5ac05a51812a" (UID: "a8e5e8c3-ca3c-4646-86b4-5ac05a51812a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:17:28.061974 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:28.061933    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-home\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:17:28.061974 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:28.061969    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4fc9\" (UniqueName: \"kubernetes.io/projected/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-kube-api-access-f4fc9\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:17:28.061974 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:28.061980    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-dshm\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:17:28.061974 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:28.061988    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a-tls-certs\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:17:28.114217 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:28.114130    2547 generic.go:356] "Generic (PLEG): container finished" podID="a8e5e8c3-ca3c-4646-86b4-5ac05a51812a" containerID="e14b1590f9ce3a3b915670dc7cf0860c6e7d5455ac1f78a945f6b561d8d83ac9" exitCode=0
Sep 11 13:17:28.114217 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:28.114172    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb" event={"ID":"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a","Type":"ContainerDied","Data":"e14b1590f9ce3a3b915670dc7cf0860c6e7d5455ac1f78a945f6b561d8d83ac9"}
Sep 11 13:17:28.114217 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:28.114192    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"
Sep 11 13:17:28.114217 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:28.114216    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb" event={"ID":"a8e5e8c3-ca3c-4646-86b4-5ac05a51812a","Type":"ContainerDied","Data":"9b1a7040d1c77a952b0fbc331d4af04b73df25d0b02a8208bd425ce3bd0b32b9"}
Sep 11 13:17:28.114542 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:28.114237    2547 scope.go:117] "RemoveContainer" containerID="e14b1590f9ce3a3b915670dc7cf0860c6e7d5455ac1f78a945f6b561d8d83ac9"
Sep 11 13:17:28.124626 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:28.124597    2547 scope.go:117] "RemoveContainer" containerID="e14b1590f9ce3a3b915670dc7cf0860c6e7d5455ac1f78a945f6b561d8d83ac9"
Sep 11 13:17:28.124891 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:17:28.124872    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e14b1590f9ce3a3b915670dc7cf0860c6e7d5455ac1f78a945f6b561d8d83ac9\": container with ID starting with e14b1590f9ce3a3b915670dc7cf0860c6e7d5455ac1f78a945f6b561d8d83ac9 not found: ID does not exist" containerID="e14b1590f9ce3a3b915670dc7cf0860c6e7d5455ac1f78a945f6b561d8d83ac9"
Sep 11 13:17:28.124947 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:28.124900    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e14b1590f9ce3a3b915670dc7cf0860c6e7d5455ac1f78a945f6b561d8d83ac9"} err="failed to get container status \"e14b1590f9ce3a3b915670dc7cf0860c6e7d5455ac1f78a945f6b561d8d83ac9\": rpc error: code = NotFound desc = could not find container \"e14b1590f9ce3a3b915670dc7cf0860c6e7d5455ac1f78a945f6b561d8d83ac9\": container with ID starting with e14b1590f9ce3a3b915670dc7cf0860c6e7d5455ac1f78a945f6b561d8d83ac9 not found: ID does not exist"
Sep 11 13:17:28.138671 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:28.138644    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"]
Sep 11 13:17:28.142061 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:28.142040    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-13b2e851/e2e-lifecycle-model-13b2e851-kserve-5bd8bb8fb7-prbzb"]
Sep 11 13:17:29.664218 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:29.664187    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8e5e8c3-ca3c-4646-86b4-5ac05a51812a" path="/var/lib/kubelet/pods/a8e5e8c3-ca3c-4646-86b4-5ac05a51812a/volumes"
Sep 11 13:17:33.884916 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:33.884882    2547 scope.go:117] "RemoveContainer" containerID="e6c9f4b6a074600d98f27ffe87e98468063ceff5ae4085457b241688619130d3"
Sep 11 13:17:34.585270 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:34.585232    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:17:34.686213 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:34.686176    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:17:43.555571 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.555532    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"]
Sep 11 13:17:43.556167 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.556088    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103" containerName="main"
Sep 11 13:17:43.556167 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.556109    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103" containerName="main"
Sep 11 13:17:43.556167 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.556135    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8e5e8c3-ca3c-4646-86b4-5ac05a51812a" containerName="main"
Sep 11 13:17:43.556167 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.556144    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8e5e8c3-ca3c-4646-86b4-5ac05a51812a" containerName="main"
Sep 11 13:17:43.556394 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.556187    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed34e897-1452-4d52-80d2-4a7884345b65" containerName="main"
Sep 11 13:17:43.556394 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.556196    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed34e897-1452-4d52-80d2-4a7884345b65" containerName="main"
Sep 11 13:17:43.556394 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.556208    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7646476-26d6-4c9e-a35a-abc376ff39b7" containerName="payload-processing"
Sep 11 13:17:43.556394 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.556217    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7646476-26d6-4c9e-a35a-abc376ff39b7" containerName="payload-processing"
Sep 11 13:17:43.556394 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.556303    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7646476-26d6-4c9e-a35a-abc376ff39b7" containerName="payload-processing"
Sep 11 13:17:43.556394 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.556318    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8e5e8c3-ca3c-4646-86b4-5ac05a51812a" containerName="main"
Sep 11 13:17:43.556394 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.556326    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="27ca2fa7-97f4-4d2d-8e1d-a039ec7a6103" containerName="main"
Sep 11 13:17:43.556394 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.556339    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed34e897-1452-4d52-80d2-4a7884345b65" containerName="main"
Sep 11 13:17:43.560865 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.560844    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"
Sep 11 13:17:43.564194 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.564172    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-82825f\"/\"default-dockercfg-c46j9\""
Sep 11 13:17:43.564335 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.564213    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-82825f\"/\"kube-root-ca.crt\""
Sep 11 13:17:43.564518 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.564503    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-82825f\"/\"openshift-service-ca.crt\""
Sep 11 13:17:43.564681 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.564663    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-82825f\"/\"sub-test-model-82825f-kserve-self-signed-certs\""
Sep 11 13:17:43.582635 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.582612    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"]
Sep 11 13:17:43.661569 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.661535    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:17:43.716445 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.716394    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c0e32ad-27a7-4704-aea9-cd946f2ff538-tls-certs\") pod \"sub-test-model-82825f-kserve-768b7f5f85-mgtjr\" (UID: \"8c0e32ad-27a7-4704-aea9-cd946f2ff538\") " pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"
Sep 11 13:17:43.716616 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.716472    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c0e32ad-27a7-4704-aea9-cd946f2ff538-home\") pod \"sub-test-model-82825f-kserve-768b7f5f85-mgtjr\" (UID: \"8c0e32ad-27a7-4704-aea9-cd946f2ff538\") " pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"
Sep 11 13:17:43.716616 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.716523    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c0e32ad-27a7-4704-aea9-cd946f2ff538-model-cache\") pod \"sub-test-model-82825f-kserve-768b7f5f85-mgtjr\" (UID: \"8c0e32ad-27a7-4704-aea9-cd946f2ff538\") " pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"
Sep 11 13:17:43.716616 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.716587    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c0e32ad-27a7-4704-aea9-cd946f2ff538-tmp-dir\") pod \"sub-test-model-82825f-kserve-768b7f5f85-mgtjr\" (UID: \"8c0e32ad-27a7-4704-aea9-cd946f2ff538\") " pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"
Sep 11 13:17:43.716790 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.716655    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c0e32ad-27a7-4704-aea9-cd946f2ff538-dshm\") pod \"sub-test-model-82825f-kserve-768b7f5f85-mgtjr\" (UID: \"8c0e32ad-27a7-4704-aea9-cd946f2ff538\") " pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"
Sep 11 13:17:43.716790 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.716678    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq9k6\" (UniqueName: \"kubernetes.io/projected/8c0e32ad-27a7-4704-aea9-cd946f2ff538-kube-api-access-kq9k6\") pod \"sub-test-model-82825f-kserve-768b7f5f85-mgtjr\" (UID: \"8c0e32ad-27a7-4704-aea9-cd946f2ff538\") " pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"
Sep 11 13:17:43.817906 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.817819    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c0e32ad-27a7-4704-aea9-cd946f2ff538-tls-certs\") pod \"sub-test-model-82825f-kserve-768b7f5f85-mgtjr\" (UID: \"8c0e32ad-27a7-4704-aea9-cd946f2ff538\") " pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"
Sep 11 13:17:43.817906 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.817860    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c0e32ad-27a7-4704-aea9-cd946f2ff538-home\") pod \"sub-test-model-82825f-kserve-768b7f5f85-mgtjr\" (UID: \"8c0e32ad-27a7-4704-aea9-cd946f2ff538\") " pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"
Sep 11 13:17:43.818141 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.818003    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c0e32ad-27a7-4704-aea9-cd946f2ff538-model-cache\") pod \"sub-test-model-82825f-kserve-768b7f5f85-mgtjr\" (UID: \"8c0e32ad-27a7-4704-aea9-cd946f2ff538\") " pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"
Sep 11 13:17:43.818141 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.818060    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c0e32ad-27a7-4704-aea9-cd946f2ff538-tmp-dir\") pod \"sub-test-model-82825f-kserve-768b7f5f85-mgtjr\" (UID: \"8c0e32ad-27a7-4704-aea9-cd946f2ff538\") " pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"
Sep 11 13:17:43.818270 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.818157    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c0e32ad-27a7-4704-aea9-cd946f2ff538-dshm\") pod \"sub-test-model-82825f-kserve-768b7f5f85-mgtjr\" (UID: \"8c0e32ad-27a7-4704-aea9-cd946f2ff538\") " pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"
Sep 11 13:17:43.818270 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.818182    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq9k6\" (UniqueName: \"kubernetes.io/projected/8c0e32ad-27a7-4704-aea9-cd946f2ff538-kube-api-access-kq9k6\") pod \"sub-test-model-82825f-kserve-768b7f5f85-mgtjr\" (UID: \"8c0e32ad-27a7-4704-aea9-cd946f2ff538\") " pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"
Sep 11 13:17:43.818270 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.818197    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c0e32ad-27a7-4704-aea9-cd946f2ff538-home\") pod \"sub-test-model-82825f-kserve-768b7f5f85-mgtjr\" (UID: \"8c0e32ad-27a7-4704-aea9-cd946f2ff538\") " pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"
Sep 11 13:17:43.818452 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.818391    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c0e32ad-27a7-4704-aea9-cd946f2ff538-model-cache\") pod \"sub-test-model-82825f-kserve-768b7f5f85-mgtjr\" (UID: \"8c0e32ad-27a7-4704-aea9-cd946f2ff538\") " pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"
Sep 11 13:17:43.818452 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.818412    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c0e32ad-27a7-4704-aea9-cd946f2ff538-tmp-dir\") pod \"sub-test-model-82825f-kserve-768b7f5f85-mgtjr\" (UID: \"8c0e32ad-27a7-4704-aea9-cd946f2ff538\") " pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"
Sep 11 13:17:43.820477 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.820457    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c0e32ad-27a7-4704-aea9-cd946f2ff538-dshm\") pod \"sub-test-model-82825f-kserve-768b7f5f85-mgtjr\" (UID: \"8c0e32ad-27a7-4704-aea9-cd946f2ff538\") " pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"
Sep 11 13:17:43.820589 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.820577    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c0e32ad-27a7-4704-aea9-cd946f2ff538-tls-certs\") pod \"sub-test-model-82825f-kserve-768b7f5f85-mgtjr\" (UID: \"8c0e32ad-27a7-4704-aea9-cd946f2ff538\") " pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"
Sep 11 13:17:43.831904 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.831874    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq9k6\" (UniqueName: \"kubernetes.io/projected/8c0e32ad-27a7-4704-aea9-cd946f2ff538-kube-api-access-kq9k6\") pod \"sub-test-model-82825f-kserve-768b7f5f85-mgtjr\" (UID: \"8c0e32ad-27a7-4704-aea9-cd946f2ff538\") " pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"
Sep 11 13:17:43.870062 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:43.870038    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"
Sep 11 13:17:44.152362 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:44.152335    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"]
Sep 11 13:17:44.154313 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:17:44.154283    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c0e32ad_27a7_4704_aea9_cd946f2ff538.slice/crio-6b5f8fe157ca79b0c7258276756d73392c5d8d12a875cad1a914d9f3edc7265d WatchSource:0}: Error finding container 6b5f8fe157ca79b0c7258276756d73392c5d8d12a875cad1a914d9f3edc7265d: Status 404 returned error can't find the container with id 6b5f8fe157ca79b0c7258276756d73392c5d8d12a875cad1a914d9f3edc7265d
Sep 11 13:17:44.209019 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:44.208993    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr" event={"ID":"8c0e32ad-27a7-4704-aea9-cd946f2ff538","Type":"ContainerStarted","Data":"6b5f8fe157ca79b0c7258276756d73392c5d8d12a875cad1a914d9f3edc7265d"}
Sep 11 13:17:45.216588 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:45.216551    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr" event={"ID":"8c0e32ad-27a7-4704-aea9-cd946f2ff538","Type":"ContainerStarted","Data":"32aacb6b4fded011ae8bb8d20695fe274cf89551ad4f38b99ec360b0303b3863"}
Sep 11 13:17:45.238565 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:45.238510    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr" podStartSLOduration=2.238491532 podStartE2EDuration="2.238491532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:17:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:17:45.237483519 +0000 UTC m=+1332.098957706" watchObservedRunningTime="2026-09-11 13:17:45.238491532 +0000 UTC m=+1332.099965720"
Sep 11 13:17:49.862254 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:49.862217    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:17:50.689951 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:50.689910    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:17:53.870691 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:53.870658    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"
Sep 11 13:17:53.871208 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:53.870725    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"
Sep 11 13:17:53.882657 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:53.882625    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"
Sep 11 13:17:54.280780 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:54.280673    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"
Sep 11 13:17:56.955409 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:56.955320    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:17:57.073568 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:57.073535    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:17:57.350008 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:57.349973    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"]
Sep 11 13:17:57.350199 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:57.350176    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5" podUID="eed2505b-ef7d-4a16-9a89-e9ea2bb507c7" containerName="istio-proxy" containerID="cri-o://366f829f3a9e01db8a52bd4cb928b0876cf0bc5d27effe06b620a8e35249072d" gracePeriod=30
Sep 11 13:17:57.427598 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:57.427565    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:17:58.726191 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:58.726150    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:17:58.847947 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:58.847913    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:17:59.665242 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:59.665211    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:17:59.797342 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:17:59.797308    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:01.251038 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:01.251004    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:02.348587 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:02.348547    2547 patch_prober.go:28] interesting pod/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 13:18:02.348982 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:02.348605    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5" podUID="eed2505b-ef7d-4a16-9a89-e9ea2bb507c7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 13:18:02.596550 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:02.596526    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:18:02.702641 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:02.702550    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-istio-token\") pod \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") "
Sep 11 13:18:02.702641 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:02.702595    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-workload-certs\") pod \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") "
Sep 11 13:18:02.702641 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:02.702631    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-credential-socket\") pod \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") "
Sep 11 13:18:02.702948 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:02.702654    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-istio-envoy\") pod \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") "
Sep 11 13:18:02.702948 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:02.702706    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-istiod-ca-cert\") pod \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") "
Sep 11 13:18:02.702948 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:02.702766    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-workload-socket\") pod \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") "
Sep 11 13:18:02.702948 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:02.702813    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gw694\" (UniqueName: \"kubernetes.io/projected/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-kube-api-access-gw694\") pod \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") "
Sep 11 13:18:02.702948 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:02.702865    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eed2505b-ef7d-4a16-9a89-e9ea2bb507c7" (UID: "eed2505b-ef7d-4a16-9a89-e9ea2bb507c7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:18:02.702948 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:02.702881    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-istio-data\") pod \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") "
Sep 11 13:18:02.703361 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:02.702966    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-istio-podinfo\") pod \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\" (UID: \"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7\") "
Sep 11 13:18:02.703361 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:02.703062    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eed2505b-ef7d-4a16-9a89-e9ea2bb507c7" (UID: "eed2505b-ef7d-4a16-9a89-e9ea2bb507c7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:18:02.703361 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:02.703116    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-istio-data" (OuterVolumeSpecName: "istio-data") pod "eed2505b-ef7d-4a16-9a89-e9ea2bb507c7" (UID: "eed2505b-ef7d-4a16-9a89-e9ea2bb507c7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:18:02.703361 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:02.703140    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eed2505b-ef7d-4a16-9a89-e9ea2bb507c7" (UID: "eed2505b-ef7d-4a16-9a89-e9ea2bb507c7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:18:02.703361 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:02.703290    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eed2505b-ef7d-4a16-9a89-e9ea2bb507c7" (UID: "eed2505b-ef7d-4a16-9a89-e9ea2bb507c7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:18:02.703968 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:02.703945    2547 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-istio-data\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:18:02.704039 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:02.703975    2547 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-workload-certs\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:18:02.704039 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:02.703988    2547 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-credential-socket\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:18:02.704039 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:02.704002    2547 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-istiod-ca-cert\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:18:02.704039 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:02.704015    2547 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-workload-socket\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:18:02.705230 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:02.705204    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-kube-api-access-gw694" (OuterVolumeSpecName: "kube-api-access-gw694") pod "eed2505b-ef7d-4a16-9a89-e9ea2bb507c7" (UID: "eed2505b-ef7d-4a16-9a89-e9ea2bb507c7"). InnerVolumeSpecName "kube-api-access-gw694". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:18:02.705335 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:02.705255    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eed2505b-ef7d-4a16-9a89-e9ea2bb507c7" (UID: "eed2505b-ef7d-4a16-9a89-e9ea2bb507c7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:18:02.705419 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:02.705402    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eed2505b-ef7d-4a16-9a89-e9ea2bb507c7" (UID: "eed2505b-ef7d-4a16-9a89-e9ea2bb507c7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:18:02.705477 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:02.705462    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-istio-token" (OuterVolumeSpecName: "istio-token") pod "eed2505b-ef7d-4a16-9a89-e9ea2bb507c7" (UID: "eed2505b-ef7d-4a16-9a89-e9ea2bb507c7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:18:02.805187 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:02.805154    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gw694\" (UniqueName: \"kubernetes.io/projected/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-kube-api-access-gw694\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:18:02.805187 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:02.805182    2547 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-istio-podinfo\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:18:02.805187 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:02.805192    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-istio-token\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:18:02.805395 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:02.805199    2547 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7-istio-envoy\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:18:03.322488 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:03.322454    2547 generic.go:356] "Generic (PLEG): container finished" podID="eed2505b-ef7d-4a16-9a89-e9ea2bb507c7" containerID="366f829f3a9e01db8a52bd4cb928b0876cf0bc5d27effe06b620a8e35249072d" exitCode=0
Sep 11 13:18:03.322678 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:03.322505    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5" event={"ID":"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7","Type":"ContainerDied","Data":"366f829f3a9e01db8a52bd4cb928b0876cf0bc5d27effe06b620a8e35249072d"}
Sep 11 13:18:03.322678 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:03.322510    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"
Sep 11 13:18:03.322678 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:03.322575    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5" event={"ID":"eed2505b-ef7d-4a16-9a89-e9ea2bb507c7","Type":"ContainerDied","Data":"9fd85960db0891fe036666d4db50e1dc8e28cac362db46f95c2b4784d0f57f8d"}
Sep 11 13:18:03.322678 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:03.322600    2547 scope.go:117] "RemoveContainer" containerID="366f829f3a9e01db8a52bd4cb928b0876cf0bc5d27effe06b620a8e35249072d"
Sep 11 13:18:03.333451 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:03.333430    2547 scope.go:117] "RemoveContainer" containerID="52d35267a2e069a8cd6ea57e981c198c41d9cc527e8ce1ec7a2adeb82972363e"
Sep 11 13:18:03.342667 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:03.342648    2547 scope.go:117] "RemoveContainer" containerID="366f829f3a9e01db8a52bd4cb928b0876cf0bc5d27effe06b620a8e35249072d"
Sep 11 13:18:03.342946 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:18:03.342925    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"366f829f3a9e01db8a52bd4cb928b0876cf0bc5d27effe06b620a8e35249072d\": container with ID starting with 366f829f3a9e01db8a52bd4cb928b0876cf0bc5d27effe06b620a8e35249072d not found: ID does not exist" containerID="366f829f3a9e01db8a52bd4cb928b0876cf0bc5d27effe06b620a8e35249072d"
Sep 11 13:18:03.342996 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:03.342956    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"366f829f3a9e01db8a52bd4cb928b0876cf0bc5d27effe06b620a8e35249072d"} err="failed to get container status \"366f829f3a9e01db8a52bd4cb928b0876cf0bc5d27effe06b620a8e35249072d\": rpc error: code = NotFound desc = could not find container \"366f829f3a9e01db8a52bd4cb928b0876cf0bc5d27effe06b620a8e35249072d\": container with ID starting with 366f829f3a9e01db8a52bd4cb928b0876cf0bc5d27effe06b620a8e35249072d not found: ID does not exist"
Sep 11 13:18:03.342996 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:03.342973    2547 scope.go:117] "RemoveContainer" containerID="52d35267a2e069a8cd6ea57e981c198c41d9cc527e8ce1ec7a2adeb82972363e"
Sep 11 13:18:03.343196 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:18:03.343181    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52d35267a2e069a8cd6ea57e981c198c41d9cc527e8ce1ec7a2adeb82972363e\": container with ID starting with 52d35267a2e069a8cd6ea57e981c198c41d9cc527e8ce1ec7a2adeb82972363e not found: ID does not exist" containerID="52d35267a2e069a8cd6ea57e981c198c41d9cc527e8ce1ec7a2adeb82972363e"
Sep 11 13:18:03.343235 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:03.343198    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52d35267a2e069a8cd6ea57e981c198c41d9cc527e8ce1ec7a2adeb82972363e"} err="failed to get container status \"52d35267a2e069a8cd6ea57e981c198c41d9cc527e8ce1ec7a2adeb82972363e\": rpc error: code = NotFound desc = could not find container \"52d35267a2e069a8cd6ea57e981c198c41d9cc527e8ce1ec7a2adeb82972363e\": container with ID starting with 52d35267a2e069a8cd6ea57e981c198c41d9cc527e8ce1ec7a2adeb82972363e not found: ID does not exist"
Sep 11 13:18:03.365331 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:03.365308    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"]
Sep 11 13:18:03.367949 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:03.367930    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-13b2e851-openshift-default-7b69dd468-nt2z5"]
Sep 11 13:18:03.664660 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:03.664586    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eed2505b-ef7d-4a16-9a89-e9ea2bb507c7" path="/var/lib/kubelet/pods/eed2505b-ef7d-4a16-9a89-e9ea2bb507c7/volumes"
Sep 11 13:18:07.646851 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:07.646806    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:07.745339 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:07.745288    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:08.127464 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:08.127435    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:08.227358 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:08.227321    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:08.329765 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:08.329708    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:16.691243 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:16.691204    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:16.866075 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:16.866034    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:16.980581 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:16.980491    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:22.265861 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:22.265822    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:25.248486 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:25.248442    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7781-b5641f"]
Sep 11 13:18:25.248895 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:25.248854    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eed2505b-ef7d-4a16-9a89-e9ea2bb507c7" containerName="istio-proxy"
Sep 11 13:18:25.248895 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:25.248867    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="eed2505b-ef7d-4a16-9a89-e9ea2bb507c7" containerName="istio-proxy"
Sep 11 13:18:25.248895 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:25.248883    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eed2505b-ef7d-4a16-9a89-e9ea2bb507c7" containerName="istio-proxy"
Sep 11 13:18:25.248895 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:25.248889    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="eed2505b-ef7d-4a16-9a89-e9ea2bb507c7" containerName="istio-proxy"
Sep 11 13:18:25.249037 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:25.248964    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="eed2505b-ef7d-4a16-9a89-e9ea2bb507c7" containerName="istio-proxy"
Sep 11 13:18:25.249037 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:25.248972    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="eed2505b-ef7d-4a16-9a89-e9ea2bb507c7" containerName="istio-proxy"
Sep 11 13:18:25.253339 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:25.253322    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-b5641f"
Sep 11 13:18:25.256598 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:25.256573    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-46lmf\""
Sep 11 13:18:25.259809 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:25.259781    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7781-b5641f"]
Sep 11 13:18:25.328009 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:25.327975    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f6jr\" (UniqueName: \"kubernetes.io/projected/3cc13257-da6d-420a-bf4f-580c50ddf943-kube-api-access-2f6jr\") pod \"test-curl-7781-b5641f\" (UID: \"3cc13257-da6d-420a-bf4f-580c50ddf943\") " pod="opendatahub/test-curl-7781-b5641f"
Sep 11 13:18:25.429122 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:25.429081    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f6jr\" (UniqueName: \"kubernetes.io/projected/3cc13257-da6d-420a-bf4f-580c50ddf943-kube-api-access-2f6jr\") pod \"test-curl-7781-b5641f\" (UID: \"3cc13257-da6d-420a-bf4f-580c50ddf943\") " pod="opendatahub/test-curl-7781-b5641f"
Sep 11 13:18:25.439693 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:25.439665    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f6jr\" (UniqueName: \"kubernetes.io/projected/3cc13257-da6d-420a-bf4f-580c50ddf943-kube-api-access-2f6jr\") pod \"test-curl-7781-b5641f\" (UID: \"3cc13257-da6d-420a-bf4f-580c50ddf943\") " pod="opendatahub/test-curl-7781-b5641f"
Sep 11 13:18:25.564235 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:25.564204    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-b5641f"
Sep 11 13:18:25.839791 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:25.839680    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7781-b5641f"]
Sep 11 13:18:25.847441 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:18:25.847409    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3cc13257_da6d_420a_bf4f_580c50ddf943.slice/crio-213cc4523631e76ce68ec1de2d61c0d36ba4d2df95a5cee64d8c3b735ab195f7 WatchSource:0}: Error finding container 213cc4523631e76ce68ec1de2d61c0d36ba4d2df95a5cee64d8c3b735ab195f7: Status 404 returned error can't find the container with id 213cc4523631e76ce68ec1de2d61c0d36ba4d2df95a5cee64d8c3b735ab195f7
Sep 11 13:18:26.459649 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:26.459612    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7781-b5641f" event={"ID":"3cc13257-da6d-420a-bf4f-580c50ddf943","Type":"ContainerStarted","Data":"a36b1b6a0875691ec44ca203ca4a8a08169e956d579268986c984b92349c926f"}
Sep 11 13:18:26.459649 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:26.459658    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7781-b5641f" event={"ID":"3cc13257-da6d-420a-bf4f-580c50ddf943","Type":"ContainerStarted","Data":"213cc4523631e76ce68ec1de2d61c0d36ba4d2df95a5cee64d8c3b735ab195f7"}
Sep 11 13:18:26.478662 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:26.478607    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7781-b5641f" podStartSLOduration=1.478590002 podStartE2EDuration="1.478590002s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:18:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:18:26.475971982 +0000 UTC m=+1373.337446164" watchObservedRunningTime="2026-09-11 13:18:26.478590002 +0000 UTC m=+1373.340064189"
Sep 11 13:18:27.114969 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:27.114927    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7781-b5641f"]
Sep 11 13:18:27.120563 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:27.120534    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7781-b5641f"]
Sep 11 13:18:27.251343 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:27.251264    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7781-3d4856"]
Sep 11 13:18:27.251678 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:27.251665    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cc13257-da6d-420a-bf4f-580c50ddf943" containerName="test-curl-7781-b5641f"
Sep 11 13:18:27.251738 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:27.251680    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cc13257-da6d-420a-bf4f-580c50ddf943" containerName="test-curl-7781-b5641f"
Sep 11 13:18:27.251778 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:27.251771    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cc13257-da6d-420a-bf4f-580c50ddf943" containerName="test-curl-7781-b5641f"
Sep 11 13:18:27.254821 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:27.254805    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-3d4856"
Sep 11 13:18:27.263178 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:27.263150    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7781-3d4856"]
Sep 11 13:18:27.344036 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:27.343997    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-489p4\" (UniqueName: \"kubernetes.io/projected/c1244f4a-5aa1-4ea1-9bc6-ae6a20312204-kube-api-access-489p4\") pod \"test-curl-7781-3d4856\" (UID: \"c1244f4a-5aa1-4ea1-9bc6-ae6a20312204\") " pod="opendatahub/test-curl-7781-3d4856"
Sep 11 13:18:27.445155 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:27.445121    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-489p4\" (UniqueName: \"kubernetes.io/projected/c1244f4a-5aa1-4ea1-9bc6-ae6a20312204-kube-api-access-489p4\") pod \"test-curl-7781-3d4856\" (UID: \"c1244f4a-5aa1-4ea1-9bc6-ae6a20312204\") " pod="opendatahub/test-curl-7781-3d4856"
Sep 11 13:18:27.453911 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:27.453885    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-489p4\" (UniqueName: \"kubernetes.io/projected/c1244f4a-5aa1-4ea1-9bc6-ae6a20312204-kube-api-access-489p4\") pod \"test-curl-7781-3d4856\" (UID: \"c1244f4a-5aa1-4ea1-9bc6-ae6a20312204\") " pod="opendatahub/test-curl-7781-3d4856"
Sep 11 13:18:27.466247 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:18:27.466224    2547 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7781-b5641f" container="test-curl-7781-b5641f"
Sep 11 13:18:27.529182 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:27.529096    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:27.565847 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:27.565821    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-3d4856"
Sep 11 13:18:27.781197 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:27.781107    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:27.841357 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:27.841333    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7781-3d4856"]
Sep 11 13:18:27.843386 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:18:27.843360    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1244f4a_5aa1_4ea1_9bc6_ae6a20312204.slice/crio-0d214e576b29425e61a452d7743d27f43b96a28ef37b4b034586bc3d80a95846 WatchSource:0}: Error finding container 0d214e576b29425e61a452d7743d27f43b96a28ef37b4b034586bc3d80a95846: Status 404 returned error can't find the container with id 0d214e576b29425e61a452d7743d27f43b96a28ef37b4b034586bc3d80a95846
Sep 11 13:18:28.473671 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:28.473632    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7781-3d4856" event={"ID":"c1244f4a-5aa1-4ea1-9bc6-ae6a20312204","Type":"ContainerStarted","Data":"af9629947750db9cbfcf8da9cd223ae0ade7bef34ae3dda319acfc6f66c6f94e"}
Sep 11 13:18:28.474142 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:28.473686    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7781-3d4856" event={"ID":"c1244f4a-5aa1-4ea1-9bc6-ae6a20312204","Type":"ContainerStarted","Data":"0d214e576b29425e61a452d7743d27f43b96a28ef37b4b034586bc3d80a95846"}
Sep 11 13:18:28.474142 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:28.473679    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7781-b5641f" podUID="3cc13257-da6d-420a-bf4f-580c50ddf943" containerName="test-curl-7781-b5641f" containerID="cri-o://a36b1b6a0875691ec44ca203ca4a8a08169e956d579268986c984b92349c926f" gracePeriod=2
Sep 11 13:18:28.497203 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:28.497153    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7781-3d4856" podStartSLOduration=1.497136399 podStartE2EDuration="1.497136399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:18:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:18:28.494946527 +0000 UTC m=+1375.356420714" watchObservedRunningTime="2026-09-11 13:18:28.497136399 +0000 UTC m=+1375.358610589"
Sep 11 13:18:29.347516 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:29.347414    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7781-3d4856"]
Sep 11 13:18:29.354973 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:29.354945    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7781-3d4856"]
Sep 11 13:18:29.479654 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:18:29.479622    2547 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7781-3d4856" container="test-curl-7781-3d4856"
Sep 11 13:18:30.485505 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:30.485450    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7781-3d4856" podUID="c1244f4a-5aa1-4ea1-9bc6-ae6a20312204" containerName="test-curl-7781-3d4856" containerID="cri-o://af9629947750db9cbfcf8da9cd223ae0ade7bef34ae3dda319acfc6f66c6f94e" gracePeriod=2
Sep 11 13:18:30.659636 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:30.659605    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-b5641f"
Sep 11 13:18:30.676903 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:30.676875    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2f6jr\" (UniqueName: \"kubernetes.io/projected/3cc13257-da6d-420a-bf4f-580c50ddf943-kube-api-access-2f6jr\") pod \"3cc13257-da6d-420a-bf4f-580c50ddf943\" (UID: \"3cc13257-da6d-420a-bf4f-580c50ddf943\") "
Sep 11 13:18:30.679044 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:30.679019    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cc13257-da6d-420a-bf4f-580c50ddf943-kube-api-access-2f6jr" (OuterVolumeSpecName: "kube-api-access-2f6jr") pod "3cc13257-da6d-420a-bf4f-580c50ddf943" (UID: "3cc13257-da6d-420a-bf4f-580c50ddf943"). InnerVolumeSpecName "kube-api-access-2f6jr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:18:30.777830 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:30.777748    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2f6jr\" (UniqueName: \"kubernetes.io/projected/3cc13257-da6d-420a-bf4f-580c50ddf943-kube-api-access-2f6jr\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:18:31.492240 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:31.492203    2547 generic.go:356] "Generic (PLEG): container finished" podID="3cc13257-da6d-420a-bf4f-580c50ddf943" containerID="a36b1b6a0875691ec44ca203ca4a8a08169e956d579268986c984b92349c926f" exitCode=137
Sep 11 13:18:31.492687 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:31.492250    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-b5641f"
Sep 11 13:18:31.492687 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:31.492301    2547 scope.go:117] "RemoveContainer" containerID="a36b1b6a0875691ec44ca203ca4a8a08169e956d579268986c984b92349c926f"
Sep 11 13:18:31.502035 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:31.502014    2547 scope.go:117] "RemoveContainer" containerID="a36b1b6a0875691ec44ca203ca4a8a08169e956d579268986c984b92349c926f"
Sep 11 13:18:31.502325 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:18:31.502305    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a36b1b6a0875691ec44ca203ca4a8a08169e956d579268986c984b92349c926f\": container with ID starting with a36b1b6a0875691ec44ca203ca4a8a08169e956d579268986c984b92349c926f not found: ID does not exist" containerID="a36b1b6a0875691ec44ca203ca4a8a08169e956d579268986c984b92349c926f"
Sep 11 13:18:31.502386 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:31.502338    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a36b1b6a0875691ec44ca203ca4a8a08169e956d579268986c984b92349c926f"} err="failed to get container status \"a36b1b6a0875691ec44ca203ca4a8a08169e956d579268986c984b92349c926f\": rpc error: code = NotFound desc = could not find container \"a36b1b6a0875691ec44ca203ca4a8a08169e956d579268986c984b92349c926f\": container with ID starting with a36b1b6a0875691ec44ca203ca4a8a08169e956d579268986c984b92349c926f not found: ID does not exist"
Sep 11 13:18:31.502562 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:18:31.502541    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7781-b5641f\" is forbidden: User \"system:node:ip-10-0-133-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-79.ec2.internal' and this object" podUID="3cc13257-da6d-420a-bf4f-580c50ddf943" pod="opendatahub/test-curl-7781-b5641f"
Sep 11 13:18:31.664144 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:31.664109    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cc13257-da6d-420a-bf4f-580c50ddf943" path="/var/lib/kubelet/pods/3cc13257-da6d-420a-bf4f-580c50ddf943/volumes"
Sep 11 13:18:31.806820 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:31.806787    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:32.568015 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:32.567983    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"]
Sep 11 13:18:32.605445 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:32.605409    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:32.685889 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:32.685867    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-3d4856"
Sep 11 13:18:32.797081 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:32.796999    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-489p4\" (UniqueName: \"kubernetes.io/projected/c1244f4a-5aa1-4ea1-9bc6-ae6a20312204-kube-api-access-489p4\") pod \"c1244f4a-5aa1-4ea1-9bc6-ae6a20312204\" (UID: \"c1244f4a-5aa1-4ea1-9bc6-ae6a20312204\") "
Sep 11 13:18:32.799182 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:32.799159    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1244f4a-5aa1-4ea1-9bc6-ae6a20312204-kube-api-access-489p4" (OuterVolumeSpecName: "kube-api-access-489p4") pod "c1244f4a-5aa1-4ea1-9bc6-ae6a20312204" (UID: "c1244f4a-5aa1-4ea1-9bc6-ae6a20312204"). InnerVolumeSpecName "kube-api-access-489p4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:18:32.898647 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:32.898613    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-489p4\" (UniqueName: \"kubernetes.io/projected/c1244f4a-5aa1-4ea1-9bc6-ae6a20312204-kube-api-access-489p4\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:18:33.506651 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:33.506618    2547 generic.go:356] "Generic (PLEG): container finished" podID="c1244f4a-5aa1-4ea1-9bc6-ae6a20312204" containerID="af9629947750db9cbfcf8da9cd223ae0ade7bef34ae3dda319acfc6f66c6f94e" exitCode=137
Sep 11 13:18:33.506881 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:33.506658    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-3d4856"
Sep 11 13:18:33.506881 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:33.506746    2547 scope.go:117] "RemoveContainer" containerID="af9629947750db9cbfcf8da9cd223ae0ade7bef34ae3dda319acfc6f66c6f94e"
Sep 11 13:18:33.517135 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:33.517117    2547 scope.go:117] "RemoveContainer" containerID="af9629947750db9cbfcf8da9cd223ae0ade7bef34ae3dda319acfc6f66c6f94e"
Sep 11 13:18:33.517402 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:18:33.517384    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af9629947750db9cbfcf8da9cd223ae0ade7bef34ae3dda319acfc6f66c6f94e\": container with ID starting with af9629947750db9cbfcf8da9cd223ae0ade7bef34ae3dda319acfc6f66c6f94e not found: ID does not exist" containerID="af9629947750db9cbfcf8da9cd223ae0ade7bef34ae3dda319acfc6f66c6f94e"
Sep 11 13:18:33.517449 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:33.517411    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af9629947750db9cbfcf8da9cd223ae0ade7bef34ae3dda319acfc6f66c6f94e"} err="failed to get container status \"af9629947750db9cbfcf8da9cd223ae0ade7bef34ae3dda319acfc6f66c6f94e\": rpc error: code = NotFound desc = could not find container \"af9629947750db9cbfcf8da9cd223ae0ade7bef34ae3dda319acfc6f66c6f94e\": container with ID starting with af9629947750db9cbfcf8da9cd223ae0ade7bef34ae3dda319acfc6f66c6f94e not found: ID does not exist"
Sep 11 13:18:33.517449 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:18:33.517415    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7781-3d4856\" is forbidden: User \"system:node:ip-10-0-133-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-79.ec2.internal' and this object" podUID="c1244f4a-5aa1-4ea1-9bc6-ae6a20312204" pod="opendatahub/test-curl-7781-3d4856"
Sep 11 13:18:33.663557 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:18:33.663517    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7781-3d4856\" is forbidden: User \"system:node:ip-10-0-133-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-79.ec2.internal' and this object" podUID="c1244f4a-5aa1-4ea1-9bc6-ae6a20312204" pod="opendatahub/test-curl-7781-3d4856"
Sep 11 13:18:33.664275 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:33.664255    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1244f4a-5aa1-4ea1-9bc6-ae6a20312204" path="/var/lib/kubelet/pods/c1244f4a-5aa1-4ea1-9bc6-ae6a20312204/volumes"
Sep 11 13:18:33.936490 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:33.936460    2547 scope.go:117] "RemoveContainer" containerID="431b9f0468efab3e8ddfeb285b46c00fac0281ba8b478284a7cfd9cfbca664f9"
Sep 11 13:18:45.454207 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:45.454173    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"]
Sep 11 13:18:45.454614 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:45.454600    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1244f4a-5aa1-4ea1-9bc6-ae6a20312204" containerName="test-curl-7781-3d4856"
Sep 11 13:18:45.454661 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:45.454614    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1244f4a-5aa1-4ea1-9bc6-ae6a20312204" containerName="test-curl-7781-3d4856"
Sep 11 13:18:45.454696 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:45.454675    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1244f4a-5aa1-4ea1-9bc6-ae6a20312204" containerName="test-curl-7781-3d4856"
Sep 11 13:18:45.458811 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:45.458793    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"
Sep 11 13:18:45.462193 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:45.462169    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-1841da\"/\"default-dockercfg-9nsw8\""
Sep 11 13:18:45.462328 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:45.462258    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-1841da\"/\"kube-root-ca.crt\""
Sep 11 13:18:45.462328 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:45.462274    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-1841da\"/\"rate-test-model-1841da-kserve-self-signed-certs\""
Sep 11 13:18:45.462485 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:45.462469    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-1841da\"/\"openshift-service-ca.crt\""
Sep 11 13:18:45.487691 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:45.487663    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"]
Sep 11 13:18:45.522470 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:45.522436    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f289c8d0-f957-4ace-ae6e-4fb9447311af-model-cache\") pod \"rate-test-model-1841da-kserve-556847847-hsgl6\" (UID: \"f289c8d0-f957-4ace-ae6e-4fb9447311af\") " pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"
Sep 11 13:18:45.522638 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:45.522495    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7nnp\" (UniqueName: \"kubernetes.io/projected/f289c8d0-f957-4ace-ae6e-4fb9447311af-kube-api-access-c7nnp\") pod \"rate-test-model-1841da-kserve-556847847-hsgl6\" (UID: \"f289c8d0-f957-4ace-ae6e-4fb9447311af\") " pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"
Sep 11 13:18:45.522638 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:45.522602    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f289c8d0-f957-4ace-ae6e-4fb9447311af-tmp-dir\") pod \"rate-test-model-1841da-kserve-556847847-hsgl6\" (UID: \"f289c8d0-f957-4ace-ae6e-4fb9447311af\") " pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"
Sep 11 13:18:45.522731 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:45.522640    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f289c8d0-f957-4ace-ae6e-4fb9447311af-tls-certs\") pod \"rate-test-model-1841da-kserve-556847847-hsgl6\" (UID: \"f289c8d0-f957-4ace-ae6e-4fb9447311af\") " pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"
Sep 11 13:18:45.522731 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:45.522667    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f289c8d0-f957-4ace-ae6e-4fb9447311af-dshm\") pod \"rate-test-model-1841da-kserve-556847847-hsgl6\" (UID: \"f289c8d0-f957-4ace-ae6e-4fb9447311af\") " pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"
Sep 11 13:18:45.522731 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:45.522698    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f289c8d0-f957-4ace-ae6e-4fb9447311af-home\") pod \"rate-test-model-1841da-kserve-556847847-hsgl6\" (UID: \"f289c8d0-f957-4ace-ae6e-4fb9447311af\") " pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"
Sep 11 13:18:45.530710 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:45.530685    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:45.624215 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:45.624173    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f289c8d0-f957-4ace-ae6e-4fb9447311af-tls-certs\") pod \"rate-test-model-1841da-kserve-556847847-hsgl6\" (UID: \"f289c8d0-f957-4ace-ae6e-4fb9447311af\") " pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"
Sep 11 13:18:45.624215 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:45.624219    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f289c8d0-f957-4ace-ae6e-4fb9447311af-dshm\") pod \"rate-test-model-1841da-kserve-556847847-hsgl6\" (UID: \"f289c8d0-f957-4ace-ae6e-4fb9447311af\") " pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"
Sep 11 13:18:45.624432 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:45.624237    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f289c8d0-f957-4ace-ae6e-4fb9447311af-home\") pod \"rate-test-model-1841da-kserve-556847847-hsgl6\" (UID: \"f289c8d0-f957-4ace-ae6e-4fb9447311af\") " pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"
Sep 11 13:18:45.624432 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:45.624265    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f289c8d0-f957-4ace-ae6e-4fb9447311af-model-cache\") pod \"rate-test-model-1841da-kserve-556847847-hsgl6\" (UID: \"f289c8d0-f957-4ace-ae6e-4fb9447311af\") " pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"
Sep 11 13:18:45.624432 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:45.624302    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7nnp\" (UniqueName: \"kubernetes.io/projected/f289c8d0-f957-4ace-ae6e-4fb9447311af-kube-api-access-c7nnp\") pod \"rate-test-model-1841da-kserve-556847847-hsgl6\" (UID: \"f289c8d0-f957-4ace-ae6e-4fb9447311af\") " pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"
Sep 11 13:18:45.624432 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:45.624384    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f289c8d0-f957-4ace-ae6e-4fb9447311af-tmp-dir\") pod \"rate-test-model-1841da-kserve-556847847-hsgl6\" (UID: \"f289c8d0-f957-4ace-ae6e-4fb9447311af\") " pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"
Sep 11 13:18:45.624772 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:45.624704    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f289c8d0-f957-4ace-ae6e-4fb9447311af-home\") pod \"rate-test-model-1841da-kserve-556847847-hsgl6\" (UID: \"f289c8d0-f957-4ace-ae6e-4fb9447311af\") " pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"
Sep 11 13:18:45.624856 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:45.624770    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f289c8d0-f957-4ace-ae6e-4fb9447311af-model-cache\") pod \"rate-test-model-1841da-kserve-556847847-hsgl6\" (UID: \"f289c8d0-f957-4ace-ae6e-4fb9447311af\") " pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"
Sep 11 13:18:45.624856 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:45.624792    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f289c8d0-f957-4ace-ae6e-4fb9447311af-tmp-dir\") pod \"rate-test-model-1841da-kserve-556847847-hsgl6\" (UID: \"f289c8d0-f957-4ace-ae6e-4fb9447311af\") " pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"
Sep 11 13:18:45.626697 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:45.626668    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f289c8d0-f957-4ace-ae6e-4fb9447311af-dshm\") pod \"rate-test-model-1841da-kserve-556847847-hsgl6\" (UID: \"f289c8d0-f957-4ace-ae6e-4fb9447311af\") " pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"
Sep 11 13:18:45.626989 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:45.626971    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f289c8d0-f957-4ace-ae6e-4fb9447311af-tls-certs\") pod \"rate-test-model-1841da-kserve-556847847-hsgl6\" (UID: \"f289c8d0-f957-4ace-ae6e-4fb9447311af\") " pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"
Sep 11 13:18:45.634272 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:45.634243    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7nnp\" (UniqueName: \"kubernetes.io/projected/f289c8d0-f957-4ace-ae6e-4fb9447311af-kube-api-access-c7nnp\") pod \"rate-test-model-1841da-kserve-556847847-hsgl6\" (UID: \"f289c8d0-f957-4ace-ae6e-4fb9447311af\") " pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"
Sep 11 13:18:45.768709 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:45.768607    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"
Sep 11 13:18:46.050672 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:46.050642    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"]
Sep 11 13:18:46.051267 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:18:46.051242    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf289c8d0_f957_4ace_ae6e_4fb9447311af.slice/crio-4b7630d8f158027c47b2f661902106e163f76d15c4acd28f9ddc4721eba816bc WatchSource:0}: Error finding container 4b7630d8f158027c47b2f661902106e163f76d15c4acd28f9ddc4721eba816bc: Status 404 returned error can't find the container with id 4b7630d8f158027c47b2f661902106e163f76d15c4acd28f9ddc4721eba816bc
Sep 11 13:18:46.583025 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:46.582986    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6" event={"ID":"f289c8d0-f957-4ace-ae6e-4fb9447311af","Type":"ContainerStarted","Data":"bc814b50c925ab97a784f8d1df779951450efa5a13c1ab979f5579b891f7323c"}
Sep 11 13:18:46.583025 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:46.583026    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6" event={"ID":"f289c8d0-f957-4ace-ae6e-4fb9447311af","Type":"ContainerStarted","Data":"4b7630d8f158027c47b2f661902106e163f76d15c4acd28f9ddc4721eba816bc"}
Sep 11 13:18:46.621080 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:46.621026    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6" podStartSLOduration=1.621009972 podStartE2EDuration="1.621009972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:18:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:18:46.619129339 +0000 UTC m=+1393.480603529" watchObservedRunningTime="2026-09-11 13:18:46.621009972 +0000 UTC m=+1393.482484159"
Sep 11 13:18:47.588294 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:47.588259    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr" podUID="8c0e32ad-27a7-4704-aea9-cd946f2ff538" containerName="main" containerID="cri-o://32aacb6b4fded011ae8bb8d20695fe274cf89551ad4f38b99ec360b0303b3863" gracePeriod=45
Sep 11 13:18:47.849400 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:47.849329    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"
Sep 11 13:18:47.948066 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:47.948027    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c0e32ad-27a7-4704-aea9-cd946f2ff538-home\") pod \"8c0e32ad-27a7-4704-aea9-cd946f2ff538\" (UID: \"8c0e32ad-27a7-4704-aea9-cd946f2ff538\") "
Sep 11 13:18:47.948245 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:47.948086    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c0e32ad-27a7-4704-aea9-cd946f2ff538-model-cache\") pod \"8c0e32ad-27a7-4704-aea9-cd946f2ff538\" (UID: \"8c0e32ad-27a7-4704-aea9-cd946f2ff538\") "
Sep 11 13:18:47.948245 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:47.948129    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c0e32ad-27a7-4704-aea9-cd946f2ff538-dshm\") pod \"8c0e32ad-27a7-4704-aea9-cd946f2ff538\" (UID: \"8c0e32ad-27a7-4704-aea9-cd946f2ff538\") "
Sep 11 13:18:47.948245 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:47.948196    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kq9k6\" (UniqueName: \"kubernetes.io/projected/8c0e32ad-27a7-4704-aea9-cd946f2ff538-kube-api-access-kq9k6\") pod \"8c0e32ad-27a7-4704-aea9-cd946f2ff538\" (UID: \"8c0e32ad-27a7-4704-aea9-cd946f2ff538\") "
Sep 11 13:18:47.948245 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:47.948216    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c0e32ad-27a7-4704-aea9-cd946f2ff538-tmp-dir\") pod \"8c0e32ad-27a7-4704-aea9-cd946f2ff538\" (UID: \"8c0e32ad-27a7-4704-aea9-cd946f2ff538\") "
Sep 11 13:18:47.948418 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:47.948257    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c0e32ad-27a7-4704-aea9-cd946f2ff538-tls-certs\") pod \"8c0e32ad-27a7-4704-aea9-cd946f2ff538\" (UID: \"8c0e32ad-27a7-4704-aea9-cd946f2ff538\") "
Sep 11 13:18:47.948418 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:47.948379    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c0e32ad-27a7-4704-aea9-cd946f2ff538-model-cache" (OuterVolumeSpecName: "model-cache") pod "8c0e32ad-27a7-4704-aea9-cd946f2ff538" (UID: "8c0e32ad-27a7-4704-aea9-cd946f2ff538"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:18:47.948529 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:47.948375    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c0e32ad-27a7-4704-aea9-cd946f2ff538-home" (OuterVolumeSpecName: "home") pod "8c0e32ad-27a7-4704-aea9-cd946f2ff538" (UID: "8c0e32ad-27a7-4704-aea9-cd946f2ff538"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:18:47.948529 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:47.948506    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c0e32ad-27a7-4704-aea9-cd946f2ff538-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8c0e32ad-27a7-4704-aea9-cd946f2ff538" (UID: "8c0e32ad-27a7-4704-aea9-cd946f2ff538"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:18:47.948650 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:47.948592    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c0e32ad-27a7-4704-aea9-cd946f2ff538-home\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:18:47.948650 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:47.948608    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c0e32ad-27a7-4704-aea9-cd946f2ff538-model-cache\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:18:47.948650 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:47.948630    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c0e32ad-27a7-4704-aea9-cd946f2ff538-tmp-dir\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:18:47.950616 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:47.950592    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c0e32ad-27a7-4704-aea9-cd946f2ff538-dshm" (OuterVolumeSpecName: "dshm") pod "8c0e32ad-27a7-4704-aea9-cd946f2ff538" (UID: "8c0e32ad-27a7-4704-aea9-cd946f2ff538"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:18:47.950616 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:47.950606    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c0e32ad-27a7-4704-aea9-cd946f2ff538-kube-api-access-kq9k6" (OuterVolumeSpecName: "kube-api-access-kq9k6") pod "8c0e32ad-27a7-4704-aea9-cd946f2ff538" (UID: "8c0e32ad-27a7-4704-aea9-cd946f2ff538"). InnerVolumeSpecName "kube-api-access-kq9k6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:18:47.950766 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:47.950638    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c0e32ad-27a7-4704-aea9-cd946f2ff538-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8c0e32ad-27a7-4704-aea9-cd946f2ff538" (UID: "8c0e32ad-27a7-4704-aea9-cd946f2ff538"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:18:48.049188 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:48.049149    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c0e32ad-27a7-4704-aea9-cd946f2ff538-tls-certs\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:18:48.049188 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:48.049180    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c0e32ad-27a7-4704-aea9-cd946f2ff538-dshm\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:18:48.049188 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:48.049190    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kq9k6\" (UniqueName: \"kubernetes.io/projected/8c0e32ad-27a7-4704-aea9-cd946f2ff538-kube-api-access-kq9k6\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:18:48.595771 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:48.595735    2547 generic.go:356] "Generic (PLEG): container finished" podID="8c0e32ad-27a7-4704-aea9-cd946f2ff538" containerID="32aacb6b4fded011ae8bb8d20695fe274cf89551ad4f38b99ec360b0303b3863" exitCode=0
Sep 11 13:18:48.596282 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:48.595801    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"
Sep 11 13:18:48.596282 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:48.595811    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr" event={"ID":"8c0e32ad-27a7-4704-aea9-cd946f2ff538","Type":"ContainerDied","Data":"32aacb6b4fded011ae8bb8d20695fe274cf89551ad4f38b99ec360b0303b3863"}
Sep 11 13:18:48.596282 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:48.595857    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr" event={"ID":"8c0e32ad-27a7-4704-aea9-cd946f2ff538","Type":"ContainerDied","Data":"6b5f8fe157ca79b0c7258276756d73392c5d8d12a875cad1a914d9f3edc7265d"}
Sep 11 13:18:48.596282 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:48.595875    2547 scope.go:117] "RemoveContainer" containerID="32aacb6b4fded011ae8bb8d20695fe274cf89551ad4f38b99ec360b0303b3863"
Sep 11 13:18:48.608698 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:48.608679    2547 scope.go:117] "RemoveContainer" containerID="32aacb6b4fded011ae8bb8d20695fe274cf89551ad4f38b99ec360b0303b3863"
Sep 11 13:18:48.609188 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:18:48.609166    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32aacb6b4fded011ae8bb8d20695fe274cf89551ad4f38b99ec360b0303b3863\": container with ID starting with 32aacb6b4fded011ae8bb8d20695fe274cf89551ad4f38b99ec360b0303b3863 not found: ID does not exist" containerID="32aacb6b4fded011ae8bb8d20695fe274cf89551ad4f38b99ec360b0303b3863"
Sep 11 13:18:48.609259 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:48.609196    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32aacb6b4fded011ae8bb8d20695fe274cf89551ad4f38b99ec360b0303b3863"} err="failed to get container status \"32aacb6b4fded011ae8bb8d20695fe274cf89551ad4f38b99ec360b0303b3863\": rpc error: code = NotFound desc = could not find container \"32aacb6b4fded011ae8bb8d20695fe274cf89551ad4f38b99ec360b0303b3863\": container with ID starting with 32aacb6b4fded011ae8bb8d20695fe274cf89551ad4f38b99ec360b0303b3863 not found: ID does not exist"
Sep 11 13:18:48.622854 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:48.622824    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"]
Sep 11 13:18:48.625939 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:48.625914    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-82825f/sub-test-model-82825f-kserve-768b7f5f85-mgtjr"]
Sep 11 13:18:48.822770 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:48.822733    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:49.667068 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:49.667031    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c0e32ad-27a7-4704-aea9-cd946f2ff538" path="/var/lib/kubelet/pods/8c0e32ad-27a7-4704-aea9-cd946f2ff538/volumes"
Sep 11 13:18:50.975690 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:50.975644    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:55.711304 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:55.711258    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:55.769223 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:55.769195    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"
Sep 11 13:18:55.769405 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:55.769272    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"
Sep 11 13:18:55.782087 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:55.782056    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"
Sep 11 13:18:55.840595 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:55.840558    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:56.043471 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.043387    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:56.380953 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.380918    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"]
Sep 11 13:18:56.381333 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.381319    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c0e32ad-27a7-4704-aea9-cd946f2ff538" containerName="main"
Sep 11 13:18:56.381381 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.381336    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c0e32ad-27a7-4704-aea9-cd946f2ff538" containerName="main"
Sep 11 13:18:56.381425 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.381412    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c0e32ad-27a7-4704-aea9-cd946f2ff538" containerName="main"
Sep 11 13:18:56.385829 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.385807    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:56.390003 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.389982    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-cd3c29-openshift-default-dockercfg-8kwjh\""
Sep 11 13:18:56.404003 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.403975    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"]
Sep 11 13:18:56.470949 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.470911    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:56.532619 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.532584    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7425b3e8-f859-4850-994e-96b18d488cd5-credential-socket\") pod \"e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") " pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:56.532829 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.532632    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7425b3e8-f859-4850-994e-96b18d488cd5-istio-envoy\") pod \"e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") " pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:56.532829 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.532691    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7425b3e8-f859-4850-994e-96b18d488cd5-workload-certs\") pod \"e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") " pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:56.532829 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.532707    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7425b3e8-f859-4850-994e-96b18d488cd5-workload-socket\") pod \"e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") " pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:56.532829 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.532784    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7425b3e8-f859-4850-994e-96b18d488cd5-istio-token\") pod \"e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") " pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:56.532829 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.532799    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7425b3e8-f859-4850-994e-96b18d488cd5-istiod-ca-cert\") pod \"e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") " pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:56.532829 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.532828    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnhpw\" (UniqueName: \"kubernetes.io/projected/7425b3e8-f859-4850-994e-96b18d488cd5-kube-api-access-qnhpw\") pod \"e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") " pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:56.533075 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.532915    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7425b3e8-f859-4850-994e-96b18d488cd5-istio-data\") pod \"e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") " pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:56.533075 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.532953    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7425b3e8-f859-4850-994e-96b18d488cd5-istio-podinfo\") pod \"e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") " pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:56.634005 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.633919    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7425b3e8-f859-4850-994e-96b18d488cd5-workload-certs\") pod \"e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") " pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:56.634005 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.633950    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7425b3e8-f859-4850-994e-96b18d488cd5-workload-socket\") pod \"e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") " pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:56.634005 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.633979    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7425b3e8-f859-4850-994e-96b18d488cd5-istio-token\") pod \"e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") " pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:56.634285 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.634096    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7425b3e8-f859-4850-994e-96b18d488cd5-istiod-ca-cert\") pod \"e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") " pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:56.634285 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.634148    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnhpw\" (UniqueName: \"kubernetes.io/projected/7425b3e8-f859-4850-994e-96b18d488cd5-kube-api-access-qnhpw\") pod \"e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") " pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:56.634285 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.634229    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7425b3e8-f859-4850-994e-96b18d488cd5-istio-data\") pod \"e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") " pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:56.634285 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.634275    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7425b3e8-f859-4850-994e-96b18d488cd5-istio-podinfo\") pod \"e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") " pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:56.634505 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.634303    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7425b3e8-f859-4850-994e-96b18d488cd5-workload-socket\") pod \"e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") " pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:56.634505 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.634324    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7425b3e8-f859-4850-994e-96b18d488cd5-credential-socket\") pod \"e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") " pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:56.634505 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.634377    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7425b3e8-f859-4850-994e-96b18d488cd5-istio-envoy\") pod \"e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") " pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:56.634505 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.634375    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7425b3e8-f859-4850-994e-96b18d488cd5-workload-certs\") pod \"e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") " pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:56.634752 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.634633    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7425b3e8-f859-4850-994e-96b18d488cd5-istio-data\") pod \"e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") " pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:56.634752 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.634665    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7425b3e8-f859-4850-994e-96b18d488cd5-credential-socket\") pod \"e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") " pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:56.634876 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.634782    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7425b3e8-f859-4850-994e-96b18d488cd5-istiod-ca-cert\") pod \"e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") " pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:56.636920 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.636895    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7425b3e8-f859-4850-994e-96b18d488cd5-istio-envoy\") pod \"e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") " pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:56.637440 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.637415    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7425b3e8-f859-4850-994e-96b18d488cd5-istio-podinfo\") pod \"e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") " pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:56.657453 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.657430    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7425b3e8-f859-4850-994e-96b18d488cd5-istio-token\") pod \"e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") " pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:56.657775 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.657758    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnhpw\" (UniqueName: \"kubernetes.io/projected/7425b3e8-f859-4850-994e-96b18d488cd5-kube-api-access-qnhpw\") pod \"e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") " pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:56.659054 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.659034    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"
Sep 11 13:18:56.696467 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.696438    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:56.723023 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.722955    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:56.989507 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.989474    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"]
Sep 11 13:18:56.991947 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:18:56.991920    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7425b3e8_f859_4850_994e_96b18d488cd5.slice/crio-66e2e1764027fa3efb53cd7aff319bbe1c75c51f532c3a9fb51300a1251e015c WatchSource:0}: Error finding container 66e2e1764027fa3efb53cd7aff319bbe1c75c51f532c3a9fb51300a1251e015c: Status 404 returned error can't find the container with id 66e2e1764027fa3efb53cd7aff319bbe1c75c51f532c3a9fb51300a1251e015c
Sep 11 13:18:56.994365 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.994334    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:18:56.994430 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.994418    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:18:56.994471 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:56.994448    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:18:57.655349 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:57.655318    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk" event={"ID":"7425b3e8-f859-4850-994e-96b18d488cd5","Type":"ContainerStarted","Data":"e72bd184b63b0c27c4f974a7133f1e3d5b54050bcacea58214080ad1fab1ed3d"}
Sep 11 13:18:57.655543 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:57.655378    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk" event={"ID":"7425b3e8-f859-4850-994e-96b18d488cd5","Type":"ContainerStarted","Data":"66e2e1764027fa3efb53cd7aff319bbe1c75c51f532c3a9fb51300a1251e015c"}
Sep 11 13:18:57.697051 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:57.697005    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:57.746340 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:57.746289    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk" podStartSLOduration=1.7462723439999999 podStartE2EDuration="1.746272344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:18:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:18:57.743278859 +0000 UTC m=+1404.604753048" watchObservedRunningTime="2026-09-11 13:18:57.746272344 +0000 UTC m=+1404.607746532"
Sep 11 13:18:58.702208 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:58.702171    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:59.168469 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:59.168425    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:59.668010 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:59.667980    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:59.669353 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:59.669333    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:18:59.862152 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:18:59.862115    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:00.259128 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:00.259092    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:01.183781 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:01.183748    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:03.145096 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:03.145063    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:04.542370 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:04.542330    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:05.549235 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:05.549203    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:06.878800 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:06.878770    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:06.982649 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:06.982611    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:07.243128 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:07.242993    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:07.527653 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:07.527562    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:07.642878 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:07.642842    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:07.697811 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:07.697779    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-cd3c29-6746997c98-jzqcc"]
Sep 11 13:19:07.701417 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:07.701391    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cd3c29-6746997c98-jzqcc"
Sep 11 13:19:07.704611 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:07.704592    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-cd3c29-dockercfg-zl2tf\""
Sep 11 13:19:07.705732 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:07.705698    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-cd3c29\""
Sep 11 13:19:07.721280 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:07.721255    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-cd3c29-6746997c98-jzqcc"]
Sep 11 13:19:07.735530 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:07.735500    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl9cr\" (UniqueName: \"kubernetes.io/projected/2061448c-49d0-46d3-b08e-ffc05451310a-kube-api-access-vl9cr\") pod \"payload-pre-processing-e2e-api-a-cd3c29-6746997c98-jzqcc\" (UID: \"2061448c-49d0-46d3-b08e-ffc05451310a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-cd3c29-6746997c98-jzqcc"
Sep 11 13:19:07.735741 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:07.735698    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2061448c-49d0-46d3-b08e-ffc05451310a-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-cd3c29-6746997c98-jzqcc\" (UID: \"2061448c-49d0-46d3-b08e-ffc05451310a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-cd3c29-6746997c98-jzqcc"
Sep 11 13:19:07.771144 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:07.771115    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-cd3c29-865f6bb567-c9kbp"]
Sep 11 13:19:07.774557 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:07.774542    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-cd3c29-865f6bb567-c9kbp"
Sep 11 13:19:07.788312 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:07.788285    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-cd3c29-865f6bb567-c9kbp"]
Sep 11 13:19:07.836650 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:07.836614    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2061448c-49d0-46d3-b08e-ffc05451310a-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-cd3c29-6746997c98-jzqcc\" (UID: \"2061448c-49d0-46d3-b08e-ffc05451310a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-cd3c29-6746997c98-jzqcc"
Sep 11 13:19:07.836851 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:07.836679    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hxtt\" (UniqueName: \"kubernetes.io/projected/3f9328d4-1e1e-462b-9ff8-bc939e615daa-kube-api-access-4hxtt\") pod \"payload-processing-e2e-api-a-cd3c29-865f6bb567-c9kbp\" (UID: \"3f9328d4-1e1e-462b-9ff8-bc939e615daa\") " pod="openshift-ingress/payload-processing-e2e-api-a-cd3c29-865f6bb567-c9kbp"
Sep 11 13:19:07.836851 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:07.836746    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl9cr\" (UniqueName: \"kubernetes.io/projected/2061448c-49d0-46d3-b08e-ffc05451310a-kube-api-access-vl9cr\") pod \"payload-pre-processing-e2e-api-a-cd3c29-6746997c98-jzqcc\" (UID: \"2061448c-49d0-46d3-b08e-ffc05451310a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-cd3c29-6746997c98-jzqcc"
Sep 11 13:19:07.836851 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:07.836822    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f9328d4-1e1e-462b-9ff8-bc939e615daa-plugins-config-volume\") pod \"payload-processing-e2e-api-a-cd3c29-865f6bb567-c9kbp\" (UID: \"3f9328d4-1e1e-462b-9ff8-bc939e615daa\") " pod="openshift-ingress/payload-processing-e2e-api-a-cd3c29-865f6bb567-c9kbp"
Sep 11 13:19:07.837391 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:07.837370    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2061448c-49d0-46d3-b08e-ffc05451310a-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-cd3c29-6746997c98-jzqcc\" (UID: \"2061448c-49d0-46d3-b08e-ffc05451310a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-cd3c29-6746997c98-jzqcc"
Sep 11 13:19:07.845823 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:07.845801    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl9cr\" (UniqueName: \"kubernetes.io/projected/2061448c-49d0-46d3-b08e-ffc05451310a-kube-api-access-vl9cr\") pod \"payload-pre-processing-e2e-api-a-cd3c29-6746997c98-jzqcc\" (UID: \"2061448c-49d0-46d3-b08e-ffc05451310a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-cd3c29-6746997c98-jzqcc"
Sep 11 13:19:07.938091 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:07.938062    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hxtt\" (UniqueName: \"kubernetes.io/projected/3f9328d4-1e1e-462b-9ff8-bc939e615daa-kube-api-access-4hxtt\") pod \"payload-processing-e2e-api-a-cd3c29-865f6bb567-c9kbp\" (UID: \"3f9328d4-1e1e-462b-9ff8-bc939e615daa\") " pod="openshift-ingress/payload-processing-e2e-api-a-cd3c29-865f6bb567-c9kbp"
Sep 11 13:19:07.938420 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:07.938157    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f9328d4-1e1e-462b-9ff8-bc939e615daa-plugins-config-volume\") pod \"payload-processing-e2e-api-a-cd3c29-865f6bb567-c9kbp\" (UID: \"3f9328d4-1e1e-462b-9ff8-bc939e615daa\") " pod="openshift-ingress/payload-processing-e2e-api-a-cd3c29-865f6bb567-c9kbp"
Sep 11 13:19:07.938851 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:07.938830    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f9328d4-1e1e-462b-9ff8-bc939e615daa-plugins-config-volume\") pod \"payload-processing-e2e-api-a-cd3c29-865f6bb567-c9kbp\" (UID: \"3f9328d4-1e1e-462b-9ff8-bc939e615daa\") " pod="openshift-ingress/payload-processing-e2e-api-a-cd3c29-865f6bb567-c9kbp"
Sep 11 13:19:07.946965 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:07.946949    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hxtt\" (UniqueName: \"kubernetes.io/projected/3f9328d4-1e1e-462b-9ff8-bc939e615daa-kube-api-access-4hxtt\") pod \"payload-processing-e2e-api-a-cd3c29-865f6bb567-c9kbp\" (UID: \"3f9328d4-1e1e-462b-9ff8-bc939e615daa\") " pod="openshift-ingress/payload-processing-e2e-api-a-cd3c29-865f6bb567-c9kbp"
Sep 11 13:19:08.014663 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:08.014636    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cd3c29-6746997c98-jzqcc"
Sep 11 13:19:08.086089 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:08.085875    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-cd3c29-865f6bb567-c9kbp"
Sep 11 13:19:08.294814 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:08.294788    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-cd3c29-6746997c98-jzqcc"]
Sep 11 13:19:08.295620 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:19:08.295598    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2061448c_49d0_46d3_b08e_ffc05451310a.slice/crio-d0bfd7e275e4d09654c1c2c454a81c4ae9ed10db0ac53e10070af8f13ac0302d WatchSource:0}: Error finding container d0bfd7e275e4d09654c1c2c454a81c4ae9ed10db0ac53e10070af8f13ac0302d: Status 404 returned error can't find the container with id d0bfd7e275e4d09654c1c2c454a81c4ae9ed10db0ac53e10070af8f13ac0302d
Sep 11 13:19:08.368556 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:08.368527    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-cd3c29-865f6bb567-c9kbp"]
Sep 11 13:19:08.369705 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:19:08.369680    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f9328d4_1e1e_462b_9ff8_bc939e615daa.slice/crio-a6bfbf391630e34054282e7c826bb9559ddc62469ee6c7a0ba63159e67b44233 WatchSource:0}: Error finding container a6bfbf391630e34054282e7c826bb9559ddc62469ee6c7a0ba63159e67b44233: Status 404 returned error can't find the container with id a6bfbf391630e34054282e7c826bb9559ddc62469ee6c7a0ba63159e67b44233
Sep 11 13:19:08.729621 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:08.729500    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cd3c29-6746997c98-jzqcc" event={"ID":"2061448c-49d0-46d3-b08e-ffc05451310a","Type":"ContainerStarted","Data":"88132a82ce4bab8ad643e816510588cbb3b082c78d144b7e449ff68b2bfc9ca1"}
Sep 11 13:19:08.729825 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:08.729731    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cd3c29-6746997c98-jzqcc"
Sep 11 13:19:08.729825 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:08.729765    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cd3c29-6746997c98-jzqcc" event={"ID":"2061448c-49d0-46d3-b08e-ffc05451310a","Type":"ContainerStarted","Data":"d0bfd7e275e4d09654c1c2c454a81c4ae9ed10db0ac53e10070af8f13ac0302d"}
Sep 11 13:19:08.731679 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:08.731654    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-cd3c29-865f6bb567-c9kbp" event={"ID":"3f9328d4-1e1e-462b-9ff8-bc939e615daa","Type":"ContainerStarted","Data":"0feba002ba9725c0325c8da5a6e5676308dea34e9c92a49f1d83e5cffe8f7be3"}
Sep 11 13:19:08.731816 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:08.731694    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-cd3c29-865f6bb567-c9kbp" event={"ID":"3f9328d4-1e1e-462b-9ff8-bc939e615daa","Type":"ContainerStarted","Data":"a6bfbf391630e34054282e7c826bb9559ddc62469ee6c7a0ba63159e67b44233"}
Sep 11 13:19:08.731816 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:08.731756    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-cd3c29-865f6bb567-c9kbp"
Sep 11 13:19:08.748784 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:08.748737    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cd3c29-6746997c98-jzqcc" podStartSLOduration=1.748697452 podStartE2EDuration="1.748697452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:19:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:19:08.747836267 +0000 UTC m=+1415.609310468" watchObservedRunningTime="2026-09-11 13:19:08.748697452 +0000 UTC m=+1415.610171640"
Sep 11 13:19:08.771843 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:08.771795    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-cd3c29-865f6bb567-c9kbp" podStartSLOduration=1.771780867 podStartE2EDuration="1.771780867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:19:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:19:08.769438001 +0000 UTC m=+1415.630912194" watchObservedRunningTime="2026-09-11 13:19:08.771780867 +0000 UTC m=+1415.633255056"
Sep 11 13:19:13.632429 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:13.632394    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:14.450646 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:14.450599    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:19.739838 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:19.739797    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cd3c29-6746997c98-jzqcc"
Sep 11 13:19:19.740445 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:19.739892    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-cd3c29-865f6bb567-c9kbp"
Sep 11 13:19:23.831044 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:23.831013    2547 generic.go:356] "Generic (PLEG): container finished" podID="7425b3e8-f859-4850-994e-96b18d488cd5" containerID="e72bd184b63b0c27c4f974a7133f1e3d5b54050bcacea58214080ad1fab1ed3d" exitCode=0
Sep 11 13:19:23.831483 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:23.831087    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk" event={"ID":"7425b3e8-f859-4850-994e-96b18d488cd5","Type":"ContainerDied","Data":"e72bd184b63b0c27c4f974a7133f1e3d5b54050bcacea58214080ad1fab1ed3d"}
Sep 11 13:19:23.831590 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:23.831573    2547 scope.go:117] "RemoveContainer" containerID="e72bd184b63b0c27c4f974a7133f1e3d5b54050bcacea58214080ad1fab1ed3d"
Sep 11 13:19:23.832813 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:23.832783    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:19:23.832983 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:23.832866    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:19:23.832983 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:23.832915    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:19:24.839213 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:24.839133    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk" event={"ID":"7425b3e8-f859-4850-994e-96b18d488cd5","Type":"ContainerStarted","Data":"6fea987b41c570048642ba3a60adf018c3e22145a2bcc27a31fa278d8d7f699b"}
Sep 11 13:19:25.697237 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:25.697205    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:19:25.698249 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:25.698224    2547 patch_prober.go:28] interesting pod/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 11 13:19:25.698358 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:25.698274    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk" podUID="7425b3e8-f859-4850-994e-96b18d488cd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 11 13:19:26.697783 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:26.697746    2547 patch_prober.go:28] interesting pod/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 11 13:19:26.698207 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:26.697802    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk" podUID="7425b3e8-f859-4850-994e-96b18d488cd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 11 13:19:27.697134 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:27.697105    2547 patch_prober.go:28] interesting pod/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 11 13:19:27.697319 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:27.697154    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk" podUID="7425b3e8-f859-4850-994e-96b18d488cd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 11 13:19:28.039456 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:28.039368    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:28.697559 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:28.697521    2547 patch_prober.go:28] interesting pod/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 11 13:19:28.697759 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:28.697590    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk" podUID="7425b3e8-f859-4850-994e-96b18d488cd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 11 13:19:29.458728 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:29.458670    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:29.668266 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:29.668236    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:19:29.696988 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:29.696955    2547 patch_prober.go:28] interesting pod/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 11 13:19:29.697151 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:29.697020    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk" podUID="7425b3e8-f859-4850-994e-96b18d488cd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 11 13:19:30.010646 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:30.010605    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:30.504928 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:30.504891    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:30.668365 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:30.668330    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:30.702055 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:30.702027    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:19:30.702979 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:30.702955    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:19:31.022888 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:31.022857    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:31.755385 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:31.755333    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:32.709759 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:32.709727    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:33.506451 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:33.506410    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:33.977282 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:33.977250    2547 scope.go:117] "RemoveContainer" containerID="bb8d00d52d90f029f4a144ccc63f696336edf08c66ed1ee08faf9ac810ad1507"
Sep 11 13:19:34.487137 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:34.487099    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:34.738333 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:34.738241    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:34.830389 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:34.830349    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:35.609233 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:35.609200    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:36.762373 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:36.762333    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:36.845992 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:36.845962    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:36.945272 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:36.945235    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:37.345659 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:37.345629    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:37.505373 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:37.505340    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:37.647859 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:37.647775    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a3785d-848cf55b58-xg8j9"]
Sep 11 13:19:37.652732 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:37.652700    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a3785d-848cf55b58-xg8j9"
Sep 11 13:19:37.656945 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:37.656923    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-a3785d\""
Sep 11 13:19:37.657782 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:37.657761    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-a3785d-dockercfg-7hp2j\""
Sep 11 13:19:37.691008 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:37.690976    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a3785d-6d89677749-96lgq"]
Sep 11 13:19:37.696496 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:37.696466    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-a3785d-6d89677749-96lgq"
Sep 11 13:19:37.754826 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:37.754797    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a3785d-6d89677749-96lgq"]
Sep 11 13:19:37.851413 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:37.851372    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2f25\" (UniqueName: \"kubernetes.io/projected/1f1ab812-6c05-4c5d-a165-64fca39d5585-kube-api-access-z2f25\") pod \"payload-pre-processing-e2e-api-b-a3785d-848cf55b58-xg8j9\" (UID: \"1f1ab812-6c05-4c5d-a165-64fca39d5585\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a3785d-848cf55b58-xg8j9"
Sep 11 13:19:37.851885 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:37.851457    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f1ab812-6c05-4c5d-a165-64fca39d5585-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-a3785d-848cf55b58-xg8j9\" (UID: \"1f1ab812-6c05-4c5d-a165-64fca39d5585\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a3785d-848cf55b58-xg8j9"
Sep 11 13:19:37.851885 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:37.851491    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnsnk\" (UniqueName: \"kubernetes.io/projected/bf1e7b21-62ec-4e72-9afc-5d59a098092f-kube-api-access-rnsnk\") pod \"payload-processing-e2e-api-b-a3785d-6d89677749-96lgq\" (UID: \"bf1e7b21-62ec-4e72-9afc-5d59a098092f\") " pod="openshift-ingress/payload-processing-e2e-api-b-a3785d-6d89677749-96lgq"
Sep 11 13:19:37.851885 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:37.851554    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf1e7b21-62ec-4e72-9afc-5d59a098092f-plugins-config-volume\") pod \"payload-processing-e2e-api-b-a3785d-6d89677749-96lgq\" (UID: \"bf1e7b21-62ec-4e72-9afc-5d59a098092f\") " pod="openshift-ingress/payload-processing-e2e-api-b-a3785d-6d89677749-96lgq"
Sep 11 13:19:37.867141 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:37.867108    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a3785d-848cf55b58-xg8j9"]
Sep 11 13:19:37.952739 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:37.952628    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f1ab812-6c05-4c5d-a165-64fca39d5585-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-a3785d-848cf55b58-xg8j9\" (UID: \"1f1ab812-6c05-4c5d-a165-64fca39d5585\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a3785d-848cf55b58-xg8j9"
Sep 11 13:19:37.952739 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:37.952677    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnsnk\" (UniqueName: \"kubernetes.io/projected/bf1e7b21-62ec-4e72-9afc-5d59a098092f-kube-api-access-rnsnk\") pod \"payload-processing-e2e-api-b-a3785d-6d89677749-96lgq\" (UID: \"bf1e7b21-62ec-4e72-9afc-5d59a098092f\") " pod="openshift-ingress/payload-processing-e2e-api-b-a3785d-6d89677749-96lgq"
Sep 11 13:19:37.952988 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:37.952745    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf1e7b21-62ec-4e72-9afc-5d59a098092f-plugins-config-volume\") pod \"payload-processing-e2e-api-b-a3785d-6d89677749-96lgq\" (UID: \"bf1e7b21-62ec-4e72-9afc-5d59a098092f\") " pod="openshift-ingress/payload-processing-e2e-api-b-a3785d-6d89677749-96lgq"
Sep 11 13:19:37.952988 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:37.952804    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2f25\" (UniqueName: \"kubernetes.io/projected/1f1ab812-6c05-4c5d-a165-64fca39d5585-kube-api-access-z2f25\") pod \"payload-pre-processing-e2e-api-b-a3785d-848cf55b58-xg8j9\" (UID: \"1f1ab812-6c05-4c5d-a165-64fca39d5585\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a3785d-848cf55b58-xg8j9"
Sep 11 13:19:37.953425 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:37.953402    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f1ab812-6c05-4c5d-a165-64fca39d5585-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-a3785d-848cf55b58-xg8j9\" (UID: \"1f1ab812-6c05-4c5d-a165-64fca39d5585\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a3785d-848cf55b58-xg8j9"
Sep 11 13:19:37.953535 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:37.953516    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf1e7b21-62ec-4e72-9afc-5d59a098092f-plugins-config-volume\") pod \"payload-processing-e2e-api-b-a3785d-6d89677749-96lgq\" (UID: \"bf1e7b21-62ec-4e72-9afc-5d59a098092f\") " pod="openshift-ingress/payload-processing-e2e-api-b-a3785d-6d89677749-96lgq"
Sep 11 13:19:37.972690 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:37.972657    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2f25\" (UniqueName: \"kubernetes.io/projected/1f1ab812-6c05-4c5d-a165-64fca39d5585-kube-api-access-z2f25\") pod \"payload-pre-processing-e2e-api-b-a3785d-848cf55b58-xg8j9\" (UID: \"1f1ab812-6c05-4c5d-a165-64fca39d5585\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a3785d-848cf55b58-xg8j9"
Sep 11 13:19:37.973771 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:37.973748    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnsnk\" (UniqueName: \"kubernetes.io/projected/bf1e7b21-62ec-4e72-9afc-5d59a098092f-kube-api-access-rnsnk\") pod \"payload-processing-e2e-api-b-a3785d-6d89677749-96lgq\" (UID: \"bf1e7b21-62ec-4e72-9afc-5d59a098092f\") " pod="openshift-ingress/payload-processing-e2e-api-b-a3785d-6d89677749-96lgq"
Sep 11 13:19:38.010759 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:38.010707    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-a3785d-6d89677749-96lgq"
Sep 11 13:19:38.195009 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:38.194968    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:38.264923 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:38.264834    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a3785d-848cf55b58-xg8j9"
Sep 11 13:19:38.334553 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:38.334523    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a3785d-6d89677749-96lgq"]
Sep 11 13:19:38.335867 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:19:38.335839    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf1e7b21_62ec_4e72_9afc_5d59a098092f.slice/crio-5b323deb19021482d4aed524b782b938b01d046d73c60a949a7f857c1909cf58 WatchSource:0}: Error finding container 5b323deb19021482d4aed524b782b938b01d046d73c60a949a7f857c1909cf58: Status 404 returned error can't find the container with id 5b323deb19021482d4aed524b782b938b01d046d73c60a949a7f857c1909cf58
Sep 11 13:19:38.548570 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:38.548541    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a3785d-848cf55b58-xg8j9"]
Sep 11 13:19:38.549062 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:19:38.549036    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f1ab812_6c05_4c5d_a165_64fca39d5585.slice/crio-5d9da75fa8379ed583ec11cef9b5750e44ec9fc3d117bf268a85444529d0a4db WatchSource:0}: Error finding container 5d9da75fa8379ed583ec11cef9b5750e44ec9fc3d117bf268a85444529d0a4db: Status 404 returned error can't find the container with id 5d9da75fa8379ed583ec11cef9b5750e44ec9fc3d117bf268a85444529d0a4db
Sep 11 13:19:38.937075 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:38.937035    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-a3785d-6d89677749-96lgq" event={"ID":"bf1e7b21-62ec-4e72-9afc-5d59a098092f","Type":"ContainerStarted","Data":"983bfc5f3a0a7f080648e5a7b1d9eafe4122ae77771f0deccc26984a3158ccfe"}
Sep 11 13:19:38.937572 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:38.937089    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-a3785d-6d89677749-96lgq" event={"ID":"bf1e7b21-62ec-4e72-9afc-5d59a098092f","Type":"ContainerStarted","Data":"5b323deb19021482d4aed524b782b938b01d046d73c60a949a7f857c1909cf58"}
Sep 11 13:19:38.937572 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:38.937132    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-a3785d-6d89677749-96lgq"
Sep 11 13:19:38.938959 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:38.938939    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a3785d-848cf55b58-xg8j9" event={"ID":"1f1ab812-6c05-4c5d-a165-64fca39d5585","Type":"ContainerStarted","Data":"e45709576e1fa84371848d9fa318d412052c75c4c19846974fa13c7b055bddc0"}
Sep 11 13:19:38.939069 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:38.938973    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a3785d-848cf55b58-xg8j9" event={"ID":"1f1ab812-6c05-4c5d-a165-64fca39d5585","Type":"ContainerStarted","Data":"5d9da75fa8379ed583ec11cef9b5750e44ec9fc3d117bf268a85444529d0a4db"}
Sep 11 13:19:38.939114 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:38.939074    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a3785d-848cf55b58-xg8j9"
Sep 11 13:19:38.957584 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:38.957533    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-a3785d-6d89677749-96lgq" podStartSLOduration=1.957517027 podStartE2EDuration="1.957517027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:19:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:19:38.95650072 +0000 UTC m=+1445.817974899" watchObservedRunningTime="2026-09-11 13:19:38.957517027 +0000 UTC m=+1445.818991216"
Sep 11 13:19:38.981130 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:38.981079    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a3785d-848cf55b58-xg8j9" podStartSLOduration=1.981064869 podStartE2EDuration="1.981064869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:19:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:19:38.978857941 +0000 UTC m=+1445.840332131" watchObservedRunningTime="2026-09-11 13:19:38.981064869 +0000 UTC m=+1445.842539056"
Sep 11 13:19:39.171386 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:39.171342    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:40.127516 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:40.127479    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:41.133763 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:41.133700    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:42.546833 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:42.546790    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:46.378243 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:46.378201    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:49.948250 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:49.948216    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-a3785d-6d89677749-96lgq"
Sep 11 13:19:49.948745 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:49.948296    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a3785d-848cf55b58-xg8j9"
Sep 11 13:19:58.174998 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:58.174959    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:59.770417 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:59.770374    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:59.875674 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:19:59.875644    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:00.833203 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:00.833166    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:01.901183 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:01.901145    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:02.910994 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:02.910956    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:02.945330 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:02.945297    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cd3c29-6crvx"]
Sep 11 13:20:02.949043 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:02.949023    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cd3c29-6crvx"
Sep 11 13:20:02.954878 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:02.954857    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kt2vz\""
Sep 11 13:20:02.959651 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:02.959629    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:20:02.985675 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:02.985644    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cd3c29-6crvx"]
Sep 11 13:20:03.093048 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:03.093019    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e4365ed-1955-4f82-9065-887eed8cc423-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-cd3c29-6crvx\" (UID: \"3e4365ed-1955-4f82-9065-887eed8cc423\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cd3c29-6crvx"
Sep 11 13:20:03.193924 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:03.193840    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e4365ed-1955-4f82-9065-887eed8cc423-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-cd3c29-6crvx\" (UID: \"3e4365ed-1955-4f82-9065-887eed8cc423\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cd3c29-6crvx"
Sep 11 13:20:03.194458 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:03.194436    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e4365ed-1955-4f82-9065-887eed8cc423-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-cd3c29-6crvx\" (UID: \"3e4365ed-1955-4f82-9065-887eed8cc423\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cd3c29-6crvx"
Sep 11 13:20:03.260329 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:03.260298    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cd3c29-6crvx"
Sep 11 13:20:03.538683 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:03.538652    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cd3c29-6crvx"]
Sep 11 13:20:03.540119 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:20:03.540092    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e4365ed_1955_4f82_9065_887eed8cc423.slice/crio-7806e3a6b936c435d0b58ca94b35ce7dbb3fe28ea451535e3b4ee660788989bf WatchSource:0}: Error finding container 7806e3a6b936c435d0b58ca94b35ce7dbb3fe28ea451535e3b4ee660788989bf: Status 404 returned error can't find the container with id 7806e3a6b936c435d0b58ca94b35ce7dbb3fe28ea451535e3b4ee660788989bf
Sep 11 13:20:03.920936 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:03.920881    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:04.095453 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:04.095411    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cd3c29-6crvx" event={"ID":"3e4365ed-1955-4f82-9065-887eed8cc423","Type":"ContainerStarted","Data":"bda79a041db4ea5bb499055a7e19f6067c8540599f132b0e61ac99411e7cbf0f"}
Sep 11 13:20:04.095652 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:04.095473    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cd3c29-6crvx" event={"ID":"3e4365ed-1955-4f82-9065-887eed8cc423","Type":"ContainerStarted","Data":"7806e3a6b936c435d0b58ca94b35ce7dbb3fe28ea451535e3b4ee660788989bf"}
Sep 11 13:20:04.115132 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:04.115012    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cd3c29-6crvx" podStartSLOduration=2.114992937 podStartE2EDuration="2.114992937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:20:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:04.113990211 +0000 UTC m=+1470.975464400" watchObservedRunningTime="2026-09-11 13:20:04.114992937 +0000 UTC m=+1470.976467126"
Sep 11 13:20:04.775632 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:04.775595    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:05.102794 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:05.102759    2547 generic.go:356] "Generic (PLEG): container finished" podID="3e4365ed-1955-4f82-9065-887eed8cc423" containerID="bda79a041db4ea5bb499055a7e19f6067c8540599f132b0e61ac99411e7cbf0f" exitCode=0
Sep 11 13:20:05.103176 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:05.102846    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cd3c29-6crvx" event={"ID":"3e4365ed-1955-4f82-9065-887eed8cc423","Type":"ContainerDied","Data":"bda79a041db4ea5bb499055a7e19f6067c8540599f132b0e61ac99411e7cbf0f"}
Sep 11 13:20:05.718135 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:05.718093    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:06.217337 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:06.217301    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"]
Sep 11 13:20:06.237028 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:06.237000    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:06.266175 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:06.266156    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cd3c29-6crvx"
Sep 11 13:20:06.427108 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:06.427019    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e4365ed-1955-4f82-9065-887eed8cc423-maas-api-service-ca\") pod \"3e4365ed-1955-4f82-9065-887eed8cc423\" (UID: \"3e4365ed-1955-4f82-9065-887eed8cc423\") "
Sep 11 13:20:06.427395 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:06.427374    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e4365ed-1955-4f82-9065-887eed8cc423-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3e4365ed-1955-4f82-9065-887eed8cc423" (UID: "3e4365ed-1955-4f82-9065-887eed8cc423"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:20:06.507256 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:06.507221    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:06.528638 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:06.528611    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e4365ed-1955-4f82-9065-887eed8cc423-maas-api-service-ca\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:20:07.116955 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:07.116921    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cd3c29-6crvx"
Sep 11 13:20:07.116955 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:07.116944    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cd3c29-6crvx" event={"ID":"3e4365ed-1955-4f82-9065-887eed8cc423","Type":"ContainerDied","Data":"7806e3a6b936c435d0b58ca94b35ce7dbb3fe28ea451535e3b4ee660788989bf"}
Sep 11 13:20:07.117176 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:07.116995    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7806e3a6b936c435d0b58ca94b35ce7dbb3fe28ea451535e3b4ee660788989bf"
Sep 11 13:20:07.158728 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:20:07.158686    2547 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e4365ed_1955_4f82_9065_887eed8cc423.slice\": RecentStats: unable to find data in memory cache]"
Sep 11 13:20:07.273702 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:07.273665    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:07.403657 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:07.403567    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:07.771066 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:07.770982    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:08.095604 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:08.095566    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:08.464429 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:08.464322    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:08.633996 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:08.633964    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:09.561511 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:09.561464    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:10.760857 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:10.760815    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:11.164607 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:11.164572    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:11.394415 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:11.394365    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:12.985734 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:12.985677    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:14.457695 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:14.457655    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:15.443826 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:15.443776    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:16.242818 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:16.242771    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:17.399149 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:17.399096    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:18.201424 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:18.201383    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:18.313134 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:18.313097    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:18.500255 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:18.500151    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:18.753096 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:18.753014    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:18.853759 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:18.853702    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:18.883234 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:18.883204    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-cc857f-5bfb7c8658-jkh9g"]
Sep 11 13:20:18.883656 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:18.883643    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e4365ed-1955-4f82-9065-887eed8cc423" containerName="revoke-keys"
Sep 11 13:20:18.883743 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:18.883659    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e4365ed-1955-4f82-9065-887eed8cc423" containerName="revoke-keys"
Sep 11 13:20:18.883785 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:18.883776    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e4365ed-1955-4f82-9065-887eed8cc423" containerName="revoke-keys"
Sep 11 13:20:18.888335 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:18.888314    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cc857f-5bfb7c8658-jkh9g"
Sep 11 13:20:18.891728 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:18.891690    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-cc857f-6657889b5-bnnsm"]
Sep 11 13:20:18.892242 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:18.892222    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-cc857f-dockercfg-2qnbs\""
Sep 11 13:20:18.892339 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:18.892225    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-cc857f\""
Sep 11 13:20:18.895482 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:18.895470    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-cc857f-6657889b5-bnnsm"
Sep 11 13:20:18.908334 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:18.908307    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-cc857f-5bfb7c8658-jkh9g"]
Sep 11 13:20:18.912670 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:18.912644    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-cc857f-6657889b5-bnnsm"]
Sep 11 13:20:18.950528 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:18.950490    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62bcn\" (UniqueName: \"kubernetes.io/projected/a6b690de-8359-4cd7-8ffc-f8d2944b7aea-kube-api-access-62bcn\") pod \"payload-processing-e2e-ipp-a-cc857f-6657889b5-bnnsm\" (UID: \"a6b690de-8359-4cd7-8ffc-f8d2944b7aea\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-cc857f-6657889b5-bnnsm"
Sep 11 13:20:18.950690 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:18.950589    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/124d1df7-8f83-4667-9767-c51be163539f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-cc857f-5bfb7c8658-jkh9g\" (UID: \"124d1df7-8f83-4667-9767-c51be163539f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cc857f-5bfb7c8658-jkh9g"
Sep 11 13:20:18.950690 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:18.950639    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghmhv\" (UniqueName: \"kubernetes.io/projected/124d1df7-8f83-4667-9767-c51be163539f-kube-api-access-ghmhv\") pod \"payload-pre-processing-e2e-ipp-a-cc857f-5bfb7c8658-jkh9g\" (UID: \"124d1df7-8f83-4667-9767-c51be163539f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cc857f-5bfb7c8658-jkh9g"
Sep 11 13:20:18.950834 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:18.950792    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6b690de-8359-4cd7-8ffc-f8d2944b7aea-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-cc857f-6657889b5-bnnsm\" (UID: \"a6b690de-8359-4cd7-8ffc-f8d2944b7aea\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-cc857f-6657889b5-bnnsm"
Sep 11 13:20:19.052318 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:19.052223    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6b690de-8359-4cd7-8ffc-f8d2944b7aea-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-cc857f-6657889b5-bnnsm\" (UID: \"a6b690de-8359-4cd7-8ffc-f8d2944b7aea\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-cc857f-6657889b5-bnnsm"
Sep 11 13:20:19.052478 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:19.052341    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62bcn\" (UniqueName: \"kubernetes.io/projected/a6b690de-8359-4cd7-8ffc-f8d2944b7aea-kube-api-access-62bcn\") pod \"payload-processing-e2e-ipp-a-cc857f-6657889b5-bnnsm\" (UID: \"a6b690de-8359-4cd7-8ffc-f8d2944b7aea\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-cc857f-6657889b5-bnnsm"
Sep 11 13:20:19.052478 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:19.052391    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/124d1df7-8f83-4667-9767-c51be163539f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-cc857f-5bfb7c8658-jkh9g\" (UID: \"124d1df7-8f83-4667-9767-c51be163539f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cc857f-5bfb7c8658-jkh9g"
Sep 11 13:20:19.052478 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:19.052434    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghmhv\" (UniqueName: \"kubernetes.io/projected/124d1df7-8f83-4667-9767-c51be163539f-kube-api-access-ghmhv\") pod \"payload-pre-processing-e2e-ipp-a-cc857f-5bfb7c8658-jkh9g\" (UID: \"124d1df7-8f83-4667-9767-c51be163539f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cc857f-5bfb7c8658-jkh9g"
Sep 11 13:20:19.052978 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:19.052952    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6b690de-8359-4cd7-8ffc-f8d2944b7aea-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-cc857f-6657889b5-bnnsm\" (UID: \"a6b690de-8359-4cd7-8ffc-f8d2944b7aea\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-cc857f-6657889b5-bnnsm"
Sep 11 13:20:19.053376 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:19.053354    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/124d1df7-8f83-4667-9767-c51be163539f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-cc857f-5bfb7c8658-jkh9g\" (UID: \"124d1df7-8f83-4667-9767-c51be163539f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cc857f-5bfb7c8658-jkh9g"
Sep 11 13:20:19.065788 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:19.065764    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62bcn\" (UniqueName: \"kubernetes.io/projected/a6b690de-8359-4cd7-8ffc-f8d2944b7aea-kube-api-access-62bcn\") pod \"payload-processing-e2e-ipp-a-cc857f-6657889b5-bnnsm\" (UID: \"a6b690de-8359-4cd7-8ffc-f8d2944b7aea\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-cc857f-6657889b5-bnnsm"
Sep 11 13:20:19.066402 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:19.066380    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghmhv\" (UniqueName: \"kubernetes.io/projected/124d1df7-8f83-4667-9767-c51be163539f-kube-api-access-ghmhv\") pod \"payload-pre-processing-e2e-ipp-a-cc857f-5bfb7c8658-jkh9g\" (UID: \"124d1df7-8f83-4667-9767-c51be163539f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cc857f-5bfb7c8658-jkh9g"
Sep 11 13:20:19.200177 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:19.200142    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cc857f-5bfb7c8658-jkh9g"
Sep 11 13:20:19.210077 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:19.210048    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-cc857f-6657889b5-bnnsm"
Sep 11 13:20:19.491751 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:19.491725    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-cc857f-5bfb7c8658-jkh9g"]
Sep 11 13:20:19.493314 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:20:19.493291    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod124d1df7_8f83_4667_9767_c51be163539f.slice/crio-2ee8d18e6c14bfbc6e99a2816e32f3ae05da739874bdba80645b1d26e3fb0818 WatchSource:0}: Error finding container 2ee8d18e6c14bfbc6e99a2816e32f3ae05da739874bdba80645b1d26e3fb0818: Status 404 returned error can't find the container with id 2ee8d18e6c14bfbc6e99a2816e32f3ae05da739874bdba80645b1d26e3fb0818
Sep 11 13:20:19.511890 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:19.511866    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-cc857f-6657889b5-bnnsm"]
Sep 11 13:20:19.512612 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:20:19.512587    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6b690de_8359_4cd7_8ffc_f8d2944b7aea.slice/crio-3d6f9710b0ae93baac248986223a97dcd68e1d73781bb9abd91f4879a0bacbb2 WatchSource:0}: Error finding container 3d6f9710b0ae93baac248986223a97dcd68e1d73781bb9abd91f4879a0bacbb2: Status 404 returned error can't find the container with id 3d6f9710b0ae93baac248986223a97dcd68e1d73781bb9abd91f4879a0bacbb2
Sep 11 13:20:20.200421 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:20.200382    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-cc857f-6657889b5-bnnsm" event={"ID":"a6b690de-8359-4cd7-8ffc-f8d2944b7aea","Type":"ContainerStarted","Data":"68257e58c99fa7f89348dcc6729a05abcafecc3393b4b594218dc2a427f7cd49"}
Sep 11 13:20:20.200639 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:20.200492    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-cc857f-6657889b5-bnnsm" event={"ID":"a6b690de-8359-4cd7-8ffc-f8d2944b7aea","Type":"ContainerStarted","Data":"3d6f9710b0ae93baac248986223a97dcd68e1d73781bb9abd91f4879a0bacbb2"}
Sep 11 13:20:20.200639 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:20.200524    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-cc857f-6657889b5-bnnsm"
Sep 11 13:20:20.202388 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:20.202358    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cc857f-5bfb7c8658-jkh9g" event={"ID":"124d1df7-8f83-4667-9767-c51be163539f","Type":"ContainerStarted","Data":"f62cea29cecf5223d6ba80191671f9a59e40648ef3e4a8ac0e74f8e54d4fa4f7"}
Sep 11 13:20:20.202509 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:20.202410    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cc857f-5bfb7c8658-jkh9g" event={"ID":"124d1df7-8f83-4667-9767-c51be163539f","Type":"ContainerStarted","Data":"2ee8d18e6c14bfbc6e99a2816e32f3ae05da739874bdba80645b1d26e3fb0818"}
Sep 11 13:20:20.202509 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:20.202438    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cc857f-5bfb7c8658-jkh9g"
Sep 11 13:20:20.242930 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:20.242865    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-cc857f-6657889b5-bnnsm" podStartSLOduration=2.242846387 podStartE2EDuration="2.242846387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:20:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:20.241298965 +0000 UTC m=+1487.102773151" watchObservedRunningTime="2026-09-11 13:20:20.242846387 +0000 UTC m=+1487.104320578"
Sep 11 13:20:20.303860 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:20.303805    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cc857f-5bfb7c8658-jkh9g" podStartSLOduration=2.30378702 podStartE2EDuration="2.30378702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:20:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:20.295645801 +0000 UTC m=+1487.157119988" watchObservedRunningTime="2026-09-11 13:20:20.30378702 +0000 UTC m=+1487.165261208"
Sep 11 13:20:21.154248 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.154198    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:21.210117 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.210086    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-cd3c29-865f6bb567-c9kbp"]
Sep 11 13:20:21.210352 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.210327    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-cd3c29-865f6bb567-c9kbp" podUID="3f9328d4-1e1e-462b-9ff8-bc939e615daa" containerName="payload-processing" containerID="cri-o://0feba002ba9725c0325c8da5a6e5676308dea34e9c92a49f1d83e5cffe8f7be3" gracePeriod=30
Sep 11 13:20:21.222587 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.222556    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-cd3c29-6746997c98-jzqcc"]
Sep 11 13:20:21.222823 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.222798    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cd3c29-6746997c98-jzqcc" podUID="2061448c-49d0-46d3-b08e-ffc05451310a" containerName="payload-pre-processing" containerID="cri-o://88132a82ce4bab8ad643e816510588cbb3b082c78d144b7e449ff68b2bfc9ca1" gracePeriod=30
Sep 11 13:20:21.240289 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.240217    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6" podUID="f289c8d0-f957-4ace-ae6e-4fb9447311af" containerName="main" containerID="cri-o://bc814b50c925ab97a784f8d1df779951450efa5a13c1ab979f5579b891f7323c" gracePeriod=45
Sep 11 13:20:21.272102 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.272074    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:21.402294 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.402223    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:21.526330 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.526301    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cd3c29-6crvx"]
Sep 11 13:20:21.527665 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.527635    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:21.536938 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.536914    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cd3c29-6crvx"]
Sep 11 13:20:21.551821 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.551801    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cd3c29-6746997c98-jzqcc"
Sep 11 13:20:21.558845 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.558827    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-cd3c29-865f6bb567-c9kbp"
Sep 11 13:20:21.563730 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.563693    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"
Sep 11 13:20:21.581651 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.581626    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2061448c-49d0-46d3-b08e-ffc05451310a-plugins-config-volume\") pod \"2061448c-49d0-46d3-b08e-ffc05451310a\" (UID: \"2061448c-49d0-46d3-b08e-ffc05451310a\") "
Sep 11 13:20:21.581802 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.581789    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vl9cr\" (UniqueName: \"kubernetes.io/projected/2061448c-49d0-46d3-b08e-ffc05451310a-kube-api-access-vl9cr\") pod \"2061448c-49d0-46d3-b08e-ffc05451310a\" (UID: \"2061448c-49d0-46d3-b08e-ffc05451310a\") "
Sep 11 13:20:21.582102 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.582075    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2061448c-49d0-46d3-b08e-ffc05451310a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2061448c-49d0-46d3-b08e-ffc05451310a" (UID: "2061448c-49d0-46d3-b08e-ffc05451310a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:20:21.582211 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.582177    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2061448c-49d0-46d3-b08e-ffc05451310a-plugins-config-volume\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:20:21.584171 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.584144    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2061448c-49d0-46d3-b08e-ffc05451310a-kube-api-access-vl9cr" (OuterVolumeSpecName: "kube-api-access-vl9cr") pod "2061448c-49d0-46d3-b08e-ffc05451310a" (UID: "2061448c-49d0-46d3-b08e-ffc05451310a"). InnerVolumeSpecName "kube-api-access-vl9cr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:20:21.666590 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.666503    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e4365ed-1955-4f82-9065-887eed8cc423" path="/var/lib/kubelet/pods/3e4365ed-1955-4f82-9065-887eed8cc423/volumes"
Sep 11 13:20:21.683305 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.683260    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f289c8d0-f957-4ace-ae6e-4fb9447311af-tls-certs\") pod \"f289c8d0-f957-4ace-ae6e-4fb9447311af\" (UID: \"f289c8d0-f957-4ace-ae6e-4fb9447311af\") "
Sep 11 13:20:21.683438 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.683346    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f289c8d0-f957-4ace-ae6e-4fb9447311af-home\") pod \"f289c8d0-f957-4ace-ae6e-4fb9447311af\" (UID: \"f289c8d0-f957-4ace-ae6e-4fb9447311af\") "
Sep 11 13:20:21.683438 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.683424    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f289c8d0-f957-4ace-ae6e-4fb9447311af-model-cache\") pod \"f289c8d0-f957-4ace-ae6e-4fb9447311af\" (UID: \"f289c8d0-f957-4ace-ae6e-4fb9447311af\") "
Sep 11 13:20:21.683564 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.683463    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f289c8d0-f957-4ace-ae6e-4fb9447311af-dshm\") pod \"f289c8d0-f957-4ace-ae6e-4fb9447311af\" (UID: \"f289c8d0-f957-4ace-ae6e-4fb9447311af\") "
Sep 11 13:20:21.683564 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.683497    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7nnp\" (UniqueName: \"kubernetes.io/projected/f289c8d0-f957-4ace-ae6e-4fb9447311af-kube-api-access-c7nnp\") pod \"f289c8d0-f957-4ace-ae6e-4fb9447311af\" (UID: \"f289c8d0-f957-4ace-ae6e-4fb9447311af\") "
Sep 11 13:20:21.683564 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.683527    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f289c8d0-f957-4ace-ae6e-4fb9447311af-tmp-dir\") pod \"f289c8d0-f957-4ace-ae6e-4fb9447311af\" (UID: \"f289c8d0-f957-4ace-ae6e-4fb9447311af\") "
Sep 11 13:20:21.683743 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.683564    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hxtt\" (UniqueName: \"kubernetes.io/projected/3f9328d4-1e1e-462b-9ff8-bc939e615daa-kube-api-access-4hxtt\") pod \"3f9328d4-1e1e-462b-9ff8-bc939e615daa\" (UID: \"3f9328d4-1e1e-462b-9ff8-bc939e615daa\") "
Sep 11 13:20:21.683743 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.683597    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f9328d4-1e1e-462b-9ff8-bc939e615daa-plugins-config-volume\") pod \"3f9328d4-1e1e-462b-9ff8-bc939e615daa\" (UID: \"3f9328d4-1e1e-462b-9ff8-bc939e615daa\") "
Sep 11 13:20:21.683743 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.683668    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f289c8d0-f957-4ace-ae6e-4fb9447311af-home" (OuterVolumeSpecName: "home") pod "f289c8d0-f957-4ace-ae6e-4fb9447311af" (UID: "f289c8d0-f957-4ace-ae6e-4fb9447311af"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:20:21.684171 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.684142    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vl9cr\" (UniqueName: \"kubernetes.io/projected/2061448c-49d0-46d3-b08e-ffc05451310a-kube-api-access-vl9cr\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:20:21.684314 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.684301    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f289c8d0-f957-4ace-ae6e-4fb9447311af-home\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:20:21.684399 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.684225    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f289c8d0-f957-4ace-ae6e-4fb9447311af-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f289c8d0-f957-4ace-ae6e-4fb9447311af" (UID: "f289c8d0-f957-4ace-ae6e-4fb9447311af"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:20:21.686084 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.685200    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f9328d4-1e1e-462b-9ff8-bc939e615daa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3f9328d4-1e1e-462b-9ff8-bc939e615daa" (UID: "3f9328d4-1e1e-462b-9ff8-bc939e615daa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:20:21.686180 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.686145    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f289c8d0-f957-4ace-ae6e-4fb9447311af-model-cache" (OuterVolumeSpecName: "model-cache") pod "f289c8d0-f957-4ace-ae6e-4fb9447311af" (UID: "f289c8d0-f957-4ace-ae6e-4fb9447311af"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:20:21.686292 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.686267    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f289c8d0-f957-4ace-ae6e-4fb9447311af-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f289c8d0-f957-4ace-ae6e-4fb9447311af" (UID: "f289c8d0-f957-4ace-ae6e-4fb9447311af"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:20:21.686507 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.686485    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f289c8d0-f957-4ace-ae6e-4fb9447311af-dshm" (OuterVolumeSpecName: "dshm") pod "f289c8d0-f957-4ace-ae6e-4fb9447311af" (UID: "f289c8d0-f957-4ace-ae6e-4fb9447311af"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:20:21.686903 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.686876    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f9328d4-1e1e-462b-9ff8-bc939e615daa-kube-api-access-4hxtt" (OuterVolumeSpecName: "kube-api-access-4hxtt") pod "3f9328d4-1e1e-462b-9ff8-bc939e615daa" (UID: "3f9328d4-1e1e-462b-9ff8-bc939e615daa"). InnerVolumeSpecName "kube-api-access-4hxtt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:20:21.688131 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.688102    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f289c8d0-f957-4ace-ae6e-4fb9447311af-kube-api-access-c7nnp" (OuterVolumeSpecName: "kube-api-access-c7nnp") pod "f289c8d0-f957-4ace-ae6e-4fb9447311af" (UID: "f289c8d0-f957-4ace-ae6e-4fb9447311af"). InnerVolumeSpecName "kube-api-access-c7nnp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:20:21.785836 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.785805    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f289c8d0-f957-4ace-ae6e-4fb9447311af-model-cache\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:20:21.785836 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.785829    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f289c8d0-f957-4ace-ae6e-4fb9447311af-dshm\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:20:21.785836 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.785838    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7nnp\" (UniqueName: \"kubernetes.io/projected/f289c8d0-f957-4ace-ae6e-4fb9447311af-kube-api-access-c7nnp\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:20:21.786069 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.785847    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f289c8d0-f957-4ace-ae6e-4fb9447311af-tmp-dir\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:20:21.786069 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.785857    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hxtt\" (UniqueName: \"kubernetes.io/projected/3f9328d4-1e1e-462b-9ff8-bc939e615daa-kube-api-access-4hxtt\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:20:21.786069 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.785866    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f9328d4-1e1e-462b-9ff8-bc939e615daa-plugins-config-volume\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:20:21.786069 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:21.785874    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f289c8d0-f957-4ace-ae6e-4fb9447311af-tls-certs\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:20:22.052914 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:22.052820    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:22.218565 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:22.218536    2547 generic.go:356] "Generic (PLEG): container finished" podID="f289c8d0-f957-4ace-ae6e-4fb9447311af" containerID="bc814b50c925ab97a784f8d1df779951450efa5a13c1ab979f5579b891f7323c" exitCode=0
Sep 11 13:20:22.219066 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:22.218591    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"
Sep 11 13:20:22.219066 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:22.218618    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6" event={"ID":"f289c8d0-f957-4ace-ae6e-4fb9447311af","Type":"ContainerDied","Data":"bc814b50c925ab97a784f8d1df779951450efa5a13c1ab979f5579b891f7323c"}
Sep 11 13:20:22.219066 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:22.218661    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6" event={"ID":"f289c8d0-f957-4ace-ae6e-4fb9447311af","Type":"ContainerDied","Data":"4b7630d8f158027c47b2f661902106e163f76d15c4acd28f9ddc4721eba816bc"}
Sep 11 13:20:22.219066 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:22.218689    2547 scope.go:117] "RemoveContainer" containerID="bc814b50c925ab97a784f8d1df779951450efa5a13c1ab979f5579b891f7323c"
Sep 11 13:20:22.220178 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:22.220150    2547 generic.go:356] "Generic (PLEG): container finished" podID="3f9328d4-1e1e-462b-9ff8-bc939e615daa" containerID="0feba002ba9725c0325c8da5a6e5676308dea34e9c92a49f1d83e5cffe8f7be3" exitCode=0
Sep 11 13:20:22.220283 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:22.220198    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-cd3c29-865f6bb567-c9kbp"
Sep 11 13:20:22.220345 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:22.220266    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-cd3c29-865f6bb567-c9kbp" event={"ID":"3f9328d4-1e1e-462b-9ff8-bc939e615daa","Type":"ContainerDied","Data":"0feba002ba9725c0325c8da5a6e5676308dea34e9c92a49f1d83e5cffe8f7be3"}
Sep 11 13:20:22.220463 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:22.220369    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-cd3c29-865f6bb567-c9kbp" event={"ID":"3f9328d4-1e1e-462b-9ff8-bc939e615daa","Type":"ContainerDied","Data":"a6bfbf391630e34054282e7c826bb9559ddc62469ee6c7a0ba63159e67b44233"}
Sep 11 13:20:22.221971 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:22.221949    2547 generic.go:356] "Generic (PLEG): container finished" podID="2061448c-49d0-46d3-b08e-ffc05451310a" containerID="88132a82ce4bab8ad643e816510588cbb3b082c78d144b7e449ff68b2bfc9ca1" exitCode=0
Sep 11 13:20:22.222095 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:22.222016    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cd3c29-6746997c98-jzqcc" event={"ID":"2061448c-49d0-46d3-b08e-ffc05451310a","Type":"ContainerDied","Data":"88132a82ce4bab8ad643e816510588cbb3b082c78d144b7e449ff68b2bfc9ca1"}
Sep 11 13:20:22.222095 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:22.222056    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cd3c29-6746997c98-jzqcc" event={"ID":"2061448c-49d0-46d3-b08e-ffc05451310a","Type":"ContainerDied","Data":"d0bfd7e275e4d09654c1c2c454a81c4ae9ed10db0ac53e10070af8f13ac0302d"}
Sep 11 13:20:22.222095 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:22.222065    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cd3c29-6746997c98-jzqcc"
Sep 11 13:20:22.243118 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:22.243101    2547 scope.go:117] "RemoveContainer" containerID="bc814b50c925ab97a784f8d1df779951450efa5a13c1ab979f5579b891f7323c"
Sep 11 13:20:22.243385 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:20:22.243369    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc814b50c925ab97a784f8d1df779951450efa5a13c1ab979f5579b891f7323c\": container with ID starting with bc814b50c925ab97a784f8d1df779951450efa5a13c1ab979f5579b891f7323c not found: ID does not exist" containerID="bc814b50c925ab97a784f8d1df779951450efa5a13c1ab979f5579b891f7323c"
Sep 11 13:20:22.243430 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:22.243392    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc814b50c925ab97a784f8d1df779951450efa5a13c1ab979f5579b891f7323c"} err="failed to get container status \"bc814b50c925ab97a784f8d1df779951450efa5a13c1ab979f5579b891f7323c\": rpc error: code = NotFound desc = could not find container \"bc814b50c925ab97a784f8d1df779951450efa5a13c1ab979f5579b891f7323c\": container with ID starting with bc814b50c925ab97a784f8d1df779951450efa5a13c1ab979f5579b891f7323c not found: ID does not exist"
Sep 11 13:20:22.243430 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:22.243407    2547 scope.go:117] "RemoveContainer" containerID="0feba002ba9725c0325c8da5a6e5676308dea34e9c92a49f1d83e5cffe8f7be3"
Sep 11 13:20:22.253472 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:22.253447    2547 scope.go:117] "RemoveContainer" containerID="0feba002ba9725c0325c8da5a6e5676308dea34e9c92a49f1d83e5cffe8f7be3"
Sep 11 13:20:22.253785 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:20:22.253766    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0feba002ba9725c0325c8da5a6e5676308dea34e9c92a49f1d83e5cffe8f7be3\": container with ID starting with 0feba002ba9725c0325c8da5a6e5676308dea34e9c92a49f1d83e5cffe8f7be3 not found: ID does not exist" containerID="0feba002ba9725c0325c8da5a6e5676308dea34e9c92a49f1d83e5cffe8f7be3"
Sep 11 13:20:22.253875 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:22.253795    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0feba002ba9725c0325c8da5a6e5676308dea34e9c92a49f1d83e5cffe8f7be3"} err="failed to get container status \"0feba002ba9725c0325c8da5a6e5676308dea34e9c92a49f1d83e5cffe8f7be3\": rpc error: code = NotFound desc = could not find container \"0feba002ba9725c0325c8da5a6e5676308dea34e9c92a49f1d83e5cffe8f7be3\": container with ID starting with 0feba002ba9725c0325c8da5a6e5676308dea34e9c92a49f1d83e5cffe8f7be3 not found: ID does not exist"
Sep 11 13:20:22.253875 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:22.253816    2547 scope.go:117] "RemoveContainer" containerID="88132a82ce4bab8ad643e816510588cbb3b082c78d144b7e449ff68b2bfc9ca1"
Sep 11 13:20:22.263909 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:22.263892    2547 scope.go:117] "RemoveContainer" containerID="88132a82ce4bab8ad643e816510588cbb3b082c78d144b7e449ff68b2bfc9ca1"
Sep 11 13:20:22.264203 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:20:22.264182    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88132a82ce4bab8ad643e816510588cbb3b082c78d144b7e449ff68b2bfc9ca1\": container with ID starting with 88132a82ce4bab8ad643e816510588cbb3b082c78d144b7e449ff68b2bfc9ca1 not found: ID does not exist" containerID="88132a82ce4bab8ad643e816510588cbb3b082c78d144b7e449ff68b2bfc9ca1"
Sep 11 13:20:22.264273 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:22.264211    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88132a82ce4bab8ad643e816510588cbb3b082c78d144b7e449ff68b2bfc9ca1"} err="failed to get container status \"88132a82ce4bab8ad643e816510588cbb3b082c78d144b7e449ff68b2bfc9ca1\": rpc error: code = NotFound desc = could not find container \"88132a82ce4bab8ad643e816510588cbb3b082c78d144b7e449ff68b2bfc9ca1\": container with ID starting with 88132a82ce4bab8ad643e816510588cbb3b082c78d144b7e449ff68b2bfc9ca1 not found: ID does not exist"
Sep 11 13:20:22.277274 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:22.277246    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-cd3c29-865f6bb567-c9kbp"]
Sep 11 13:20:22.303250 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:22.303186    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:22.304341 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:22.304323    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-cd3c29-865f6bb567-c9kbp"]
Sep 11 13:20:22.344154 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:22.344129    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"]
Sep 11 13:20:22.357920 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:22.357895    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1841da/rate-test-model-1841da-kserve-556847847-hsgl6"]
Sep 11 13:20:22.388503 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:22.388479    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-cd3c29-6746997c98-jzqcc"]
Sep 11 13:20:22.391103 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:22.391083    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-cd3c29-6746997c98-jzqcc"]
Sep 11 13:20:23.477943 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:23.477903    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:23.665495 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:23.665463    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2061448c-49d0-46d3-b08e-ffc05451310a" path="/var/lib/kubelet/pods/2061448c-49d0-46d3-b08e-ffc05451310a/volumes"
Sep 11 13:20:23.665924 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:23.665908    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f9328d4-1e1e-462b-9ff8-bc939e615daa" path="/var/lib/kubelet/pods/3f9328d4-1e1e-462b-9ff8-bc939e615daa/volumes"
Sep 11 13:20:23.666306 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:23.666291    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f289c8d0-f957-4ace-ae6e-4fb9447311af" path="/var/lib/kubelet/pods/f289c8d0-f957-4ace-ae6e-4fb9447311af/volumes"
Sep 11 13:20:24.681253 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:24.681214    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:25.481552 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:25.481515    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:26.325624 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:26.325586    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:27.259177 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:27.259143    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:27.992739 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:27.992689    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:29.035487 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:29.035449    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"]
Sep 11 13:20:29.036119 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:29.035790    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk" podUID="7425b3e8-f859-4850-994e-96b18d488cd5" containerName="istio-proxy" containerID="cri-o://6fea987b41c570048642ba3a60adf018c3e22145a2bcc27a31fa278d8d7f699b" gracePeriod=30
Sep 11 13:20:29.397262 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:29.397224    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3785d-qn5bt"]
Sep 11 13:20:29.397630 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:29.397616    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f9328d4-1e1e-462b-9ff8-bc939e615daa" containerName="payload-processing"
Sep 11 13:20:29.397630 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:29.397631    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f9328d4-1e1e-462b-9ff8-bc939e615daa" containerName="payload-processing"
Sep 11 13:20:29.397763 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:29.397644    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2061448c-49d0-46d3-b08e-ffc05451310a" containerName="payload-pre-processing"
Sep 11 13:20:29.397763 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:29.397650    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2061448c-49d0-46d3-b08e-ffc05451310a" containerName="payload-pre-processing"
Sep 11 13:20:29.397763 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:29.397658    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f289c8d0-f957-4ace-ae6e-4fb9447311af" containerName="main"
Sep 11 13:20:29.397763 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:29.397664    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="f289c8d0-f957-4ace-ae6e-4fb9447311af" containerName="main"
Sep 11 13:20:29.397763 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:29.397762    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="f289c8d0-f957-4ace-ae6e-4fb9447311af" containerName="main"
Sep 11 13:20:29.397966 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:29.397769    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f9328d4-1e1e-462b-9ff8-bc939e615daa" containerName="payload-processing"
Sep 11 13:20:29.397966 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:29.397778    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="2061448c-49d0-46d3-b08e-ffc05451310a" containerName="payload-pre-processing"
Sep 11 13:20:29.402176 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:29.402157    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3785d-qn5bt"
Sep 11 13:20:29.404508 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:29.404487    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kt2vz\""
Sep 11 13:20:29.404770 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:29.404755    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:20:29.411354 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:29.411331    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3785d-qn5bt"]
Sep 11 13:20:29.460012 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:29.459979    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78ae2e13-1a4b-4454-b2d1-f915de45220e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a3785d-qn5bt\" (UID: \"78ae2e13-1a4b-4454-b2d1-f915de45220e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3785d-qn5bt"
Sep 11 13:20:29.561307 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:29.561263    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78ae2e13-1a4b-4454-b2d1-f915de45220e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a3785d-qn5bt\" (UID: \"78ae2e13-1a4b-4454-b2d1-f915de45220e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3785d-qn5bt"
Sep 11 13:20:29.561938 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:29.561917    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78ae2e13-1a4b-4454-b2d1-f915de45220e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a3785d-qn5bt\" (UID: \"78ae2e13-1a4b-4454-b2d1-f915de45220e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3785d-qn5bt"
Sep 11 13:20:29.714478 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:29.714391    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3785d-qn5bt"
Sep 11 13:20:29.754521 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:29.754486    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:29.855145 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:29.855113    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:29.957014 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:29.956978    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:29.992872 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:29.992840    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3785d-qn5bt"]
Sep 11 13:20:29.994414 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:20:29.994391    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78ae2e13_1a4b_4454_b2d1_f915de45220e.slice/crio-50a84df9e5a0b988dd8b81427debfdbaf949c7bb7bd059a7db8444e367f1c365 WatchSource:0}: Error finding container 50a84df9e5a0b988dd8b81427debfdbaf949c7bb7bd059a7db8444e367f1c365: Status 404 returned error can't find the container with id 50a84df9e5a0b988dd8b81427debfdbaf949c7bb7bd059a7db8444e367f1c365
Sep 11 13:20:30.276775 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:30.276734    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3785d-qn5bt" event={"ID":"78ae2e13-1a4b-4454-b2d1-f915de45220e","Type":"ContainerStarted","Data":"48b96e53c8f49b52dbb31fdd906ddf53590a6ee7e3255742f058915bcc9ba075"}
Sep 11 13:20:30.277103 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:30.276797    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3785d-qn5bt" event={"ID":"78ae2e13-1a4b-4454-b2d1-f915de45220e","Type":"ContainerStarted","Data":"50a84df9e5a0b988dd8b81427debfdbaf949c7bb7bd059a7db8444e367f1c365"}
Sep 11 13:20:30.295380 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:30.295335    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3785d-qn5bt" podStartSLOduration=1.295318819 podStartE2EDuration="1.295318819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:20:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:30.292264229 +0000 UTC m=+1497.153738418" watchObservedRunningTime="2026-09-11 13:20:30.295318819 +0000 UTC m=+1497.156793007"
Sep 11 13:20:30.678656 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:30.678619    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:30.704687 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:30.704658    2547 patch_prober.go:28] interesting pod/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 13:20:30.704841 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:30.704725    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk" podUID="7425b3e8-f859-4850-994e-96b18d488cd5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 13:20:31.213477 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:31.213448    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cc857f-5bfb7c8658-jkh9g"
Sep 11 13:20:31.213658 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:31.213516    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-cc857f-6657889b5-bnnsm"
Sep 11 13:20:31.285964 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:31.285922    2547 generic.go:356] "Generic (PLEG): container finished" podID="78ae2e13-1a4b-4454-b2d1-f915de45220e" containerID="48b96e53c8f49b52dbb31fdd906ddf53590a6ee7e3255742f058915bcc9ba075" exitCode=0
Sep 11 13:20:31.286340 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:31.286020    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3785d-qn5bt" event={"ID":"78ae2e13-1a4b-4454-b2d1-f915de45220e","Type":"ContainerDied","Data":"48b96e53c8f49b52dbb31fdd906ddf53590a6ee7e3255742f058915bcc9ba075"}
Sep 11 13:20:31.664980 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:31.664939    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:32.431695 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:32.431670    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3785d-qn5bt"
Sep 11 13:20:32.489277 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:32.489250    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78ae2e13-1a4b-4454-b2d1-f915de45220e-maas-api-service-ca\") pod \"78ae2e13-1a4b-4454-b2d1-f915de45220e\" (UID: \"78ae2e13-1a4b-4454-b2d1-f915de45220e\") "
Sep 11 13:20:32.489652 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:32.489629    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78ae2e13-1a4b-4454-b2d1-f915de45220e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "78ae2e13-1a4b-4454-b2d1-f915de45220e" (UID: "78ae2e13-1a4b-4454-b2d1-f915de45220e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:20:32.590120 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:32.590090    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78ae2e13-1a4b-4454-b2d1-f915de45220e-maas-api-service-ca\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:20:32.707247 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:32.707209    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:33.298902 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:33.298868    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3785d-qn5bt" event={"ID":"78ae2e13-1a4b-4454-b2d1-f915de45220e","Type":"ContainerDied","Data":"50a84df9e5a0b988dd8b81427debfdbaf949c7bb7bd059a7db8444e367f1c365"}
Sep 11 13:20:33.298902 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:33.298907    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3785d-qn5bt"
Sep 11 13:20:33.299196 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:33.298915    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="50a84df9e5a0b988dd8b81427debfdbaf949c7bb7bd059a7db8444e367f1c365"
Sep 11 13:20:33.649234 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:33.649200    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:33.756079 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:33.756048    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-b7gsm_b22738d7-e796-4173-8fb4-80f9208b99dd/console-operator/2.log"
Sep 11 13:20:33.758324 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:33.758304    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-b7gsm_b22738d7-e796-4173-8fb4-80f9208b99dd/console-operator/2.log"
Sep 11 13:20:34.285846 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.285818    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:20:34.306932 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.306895    2547 generic.go:356] "Generic (PLEG): container finished" podID="7425b3e8-f859-4850-994e-96b18d488cd5" containerID="6fea987b41c570048642ba3a60adf018c3e22145a2bcc27a31fa278d8d7f699b" exitCode=0
Sep 11 13:20:34.307110 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.306945    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"
Sep 11 13:20:34.307110 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.306985    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk" event={"ID":"7425b3e8-f859-4850-994e-96b18d488cd5","Type":"ContainerDied","Data":"6fea987b41c570048642ba3a60adf018c3e22145a2bcc27a31fa278d8d7f699b"}
Sep 11 13:20:34.307110 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.307052    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk" event={"ID":"7425b3e8-f859-4850-994e-96b18d488cd5","Type":"ContainerDied","Data":"66e2e1764027fa3efb53cd7aff319bbe1c75c51f532c3a9fb51300a1251e015c"}
Sep 11 13:20:34.307110 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.307086    2547 scope.go:117] "RemoveContainer" containerID="6fea987b41c570048642ba3a60adf018c3e22145a2bcc27a31fa278d8d7f699b"
Sep 11 13:20:34.318380 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.318360    2547 scope.go:117] "RemoveContainer" containerID="e72bd184b63b0c27c4f974a7133f1e3d5b54050bcacea58214080ad1fab1ed3d"
Sep 11 13:20:34.329765 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.329736    2547 scope.go:117] "RemoveContainer" containerID="6fea987b41c570048642ba3a60adf018c3e22145a2bcc27a31fa278d8d7f699b"
Sep 11 13:20:34.330029 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:20:34.330012    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fea987b41c570048642ba3a60adf018c3e22145a2bcc27a31fa278d8d7f699b\": container with ID starting with 6fea987b41c570048642ba3a60adf018c3e22145a2bcc27a31fa278d8d7f699b not found: ID does not exist" containerID="6fea987b41c570048642ba3a60adf018c3e22145a2bcc27a31fa278d8d7f699b"
Sep 11 13:20:34.330079 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.330040    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fea987b41c570048642ba3a60adf018c3e22145a2bcc27a31fa278d8d7f699b"} err="failed to get container status \"6fea987b41c570048642ba3a60adf018c3e22145a2bcc27a31fa278d8d7f699b\": rpc error: code = NotFound desc = could not find container \"6fea987b41c570048642ba3a60adf018c3e22145a2bcc27a31fa278d8d7f699b\": container with ID starting with 6fea987b41c570048642ba3a60adf018c3e22145a2bcc27a31fa278d8d7f699b not found: ID does not exist"
Sep 11 13:20:34.330079 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.330057    2547 scope.go:117] "RemoveContainer" containerID="e72bd184b63b0c27c4f974a7133f1e3d5b54050bcacea58214080ad1fab1ed3d"
Sep 11 13:20:34.330340 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:20:34.330324    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e72bd184b63b0c27c4f974a7133f1e3d5b54050bcacea58214080ad1fab1ed3d\": container with ID starting with e72bd184b63b0c27c4f974a7133f1e3d5b54050bcacea58214080ad1fab1ed3d not found: ID does not exist" containerID="e72bd184b63b0c27c4f974a7133f1e3d5b54050bcacea58214080ad1fab1ed3d"
Sep 11 13:20:34.330418 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.330344    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e72bd184b63b0c27c4f974a7133f1e3d5b54050bcacea58214080ad1fab1ed3d"} err="failed to get container status \"e72bd184b63b0c27c4f974a7133f1e3d5b54050bcacea58214080ad1fab1ed3d\": rpc error: code = NotFound desc = could not find container \"e72bd184b63b0c27c4f974a7133f1e3d5b54050bcacea58214080ad1fab1ed3d\": container with ID starting with e72bd184b63b0c27c4f974a7133f1e3d5b54050bcacea58214080ad1fab1ed3d not found: ID does not exist"
Sep 11 13:20:34.405384 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.405351    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7425b3e8-f859-4850-994e-96b18d488cd5-workload-socket\") pod \"7425b3e8-f859-4850-994e-96b18d488cd5\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") "
Sep 11 13:20:34.405384 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.405391    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7425b3e8-f859-4850-994e-96b18d488cd5-credential-socket\") pod \"7425b3e8-f859-4850-994e-96b18d488cd5\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") "
Sep 11 13:20:34.405613 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.405444    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7425b3e8-f859-4850-994e-96b18d488cd5-istiod-ca-cert\") pod \"7425b3e8-f859-4850-994e-96b18d488cd5\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") "
Sep 11 13:20:34.405613 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.405473    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnhpw\" (UniqueName: \"kubernetes.io/projected/7425b3e8-f859-4850-994e-96b18d488cd5-kube-api-access-qnhpw\") pod \"7425b3e8-f859-4850-994e-96b18d488cd5\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") "
Sep 11 13:20:34.405613 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.405495    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7425b3e8-f859-4850-994e-96b18d488cd5-istio-data\") pod \"7425b3e8-f859-4850-994e-96b18d488cd5\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") "
Sep 11 13:20:34.405613 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.405514    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7425b3e8-f859-4850-994e-96b18d488cd5-istio-token\") pod \"7425b3e8-f859-4850-994e-96b18d488cd5\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") "
Sep 11 13:20:34.405613 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.405532    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7425b3e8-f859-4850-994e-96b18d488cd5-workload-certs\") pod \"7425b3e8-f859-4850-994e-96b18d488cd5\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") "
Sep 11 13:20:34.405613 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.405567    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7425b3e8-f859-4850-994e-96b18d488cd5-istio-envoy\") pod \"7425b3e8-f859-4850-994e-96b18d488cd5\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") "
Sep 11 13:20:34.405613 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.405599    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7425b3e8-f859-4850-994e-96b18d488cd5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7425b3e8-f859-4850-994e-96b18d488cd5" (UID: "7425b3e8-f859-4850-994e-96b18d488cd5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:20:34.406038 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.405652    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7425b3e8-f859-4850-994e-96b18d488cd5-istio-podinfo\") pod \"7425b3e8-f859-4850-994e-96b18d488cd5\" (UID: \"7425b3e8-f859-4850-994e-96b18d488cd5\") "
Sep 11 13:20:34.406038 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.405679    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7425b3e8-f859-4850-994e-96b18d488cd5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7425b3e8-f859-4850-994e-96b18d488cd5" (UID: "7425b3e8-f859-4850-994e-96b18d488cd5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:20:34.406038 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.405820    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7425b3e8-f859-4850-994e-96b18d488cd5-istio-data" (OuterVolumeSpecName: "istio-data") pod "7425b3e8-f859-4850-994e-96b18d488cd5" (UID: "7425b3e8-f859-4850-994e-96b18d488cd5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:20:34.406038 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.405866    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7425b3e8-f859-4850-994e-96b18d488cd5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7425b3e8-f859-4850-994e-96b18d488cd5" (UID: "7425b3e8-f859-4850-994e-96b18d488cd5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:20:34.406038 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.405984    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7425b3e8-f859-4850-994e-96b18d488cd5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7425b3e8-f859-4850-994e-96b18d488cd5" (UID: "7425b3e8-f859-4850-994e-96b18d488cd5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:20:34.406515 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.406123    2547 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7425b3e8-f859-4850-994e-96b18d488cd5-workload-socket\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:20:34.406515 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.406138    2547 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7425b3e8-f859-4850-994e-96b18d488cd5-credential-socket\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:20:34.406515 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.406148    2547 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7425b3e8-f859-4850-994e-96b18d488cd5-istiod-ca-cert\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:20:34.406515 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.406161    2547 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7425b3e8-f859-4850-994e-96b18d488cd5-istio-data\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:20:34.406515 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.406172    2547 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7425b3e8-f859-4850-994e-96b18d488cd5-workload-certs\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:20:34.408158 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.408136    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7425b3e8-f859-4850-994e-96b18d488cd5-kube-api-access-qnhpw" (OuterVolumeSpecName: "kube-api-access-qnhpw") pod "7425b3e8-f859-4850-994e-96b18d488cd5" (UID: "7425b3e8-f859-4850-994e-96b18d488cd5"). InnerVolumeSpecName "kube-api-access-qnhpw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:20:34.408289 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.408236    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7425b3e8-f859-4850-994e-96b18d488cd5-istio-token" (OuterVolumeSpecName: "istio-token") pod "7425b3e8-f859-4850-994e-96b18d488cd5" (UID: "7425b3e8-f859-4850-994e-96b18d488cd5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:20:34.408637 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.408615    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7425b3e8-f859-4850-994e-96b18d488cd5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7425b3e8-f859-4850-994e-96b18d488cd5" (UID: "7425b3e8-f859-4850-994e-96b18d488cd5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:20:34.408778 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.408744    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7425b3e8-f859-4850-994e-96b18d488cd5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7425b3e8-f859-4850-994e-96b18d488cd5" (UID: "7425b3e8-f859-4850-994e-96b18d488cd5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:20:34.444819 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.444793    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:34.507083 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.507053    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnhpw\" (UniqueName: \"kubernetes.io/projected/7425b3e8-f859-4850-994e-96b18d488cd5-kube-api-access-qnhpw\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:20:34.507083 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.507083    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7425b3e8-f859-4850-994e-96b18d488cd5-istio-token\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:20:34.507278 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.507096    2547 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7425b3e8-f859-4850-994e-96b18d488cd5-istio-envoy\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:20:34.507278 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.507107    2547 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7425b3e8-f859-4850-994e-96b18d488cd5-istio-podinfo\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:20:34.639742 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.639686    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"]
Sep 11 13:20:34.643565 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:34.643539    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-cd3c29-openshift-default-669b97c4b8-49dbk"]
Sep 11 13:20:35.261135 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:35.261105    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:35.665003 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:35.664971    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7425b3e8-f859-4850-994e-96b18d488cd5" path="/var/lib/kubelet/pods/7425b3e8-f859-4850-994e-96b18d488cd5/volumes"
Sep 11 13:20:35.887475 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:35.887443    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:36.047696 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:36.047594    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:36.741959 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:36.741915    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:37.161133 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.161098    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"]
Sep 11 13:20:37.161540 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.161524    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7425b3e8-f859-4850-994e-96b18d488cd5" containerName="istio-proxy"
Sep 11 13:20:37.161540 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.161539    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="7425b3e8-f859-4850-994e-96b18d488cd5" containerName="istio-proxy"
Sep 11 13:20:37.161706 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.161557    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7425b3e8-f859-4850-994e-96b18d488cd5" containerName="istio-proxy"
Sep 11 13:20:37.161706 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.161562    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="7425b3e8-f859-4850-994e-96b18d488cd5" containerName="istio-proxy"
Sep 11 13:20:37.161706 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.161569    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78ae2e13-1a4b-4454-b2d1-f915de45220e" containerName="revoke-keys"
Sep 11 13:20:37.161706 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.161575    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="78ae2e13-1a4b-4454-b2d1-f915de45220e" containerName="revoke-keys"
Sep 11 13:20:37.161706 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.161639    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="7425b3e8-f859-4850-994e-96b18d488cd5" containerName="istio-proxy"
Sep 11 13:20:37.161706 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.161646    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="7425b3e8-f859-4850-994e-96b18d488cd5" containerName="istio-proxy"
Sep 11 13:20:37.161706 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.161655    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="78ae2e13-1a4b-4454-b2d1-f915de45220e" containerName="revoke-keys"
Sep 11 13:20:37.166104 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.166085    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:37.177035 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.177014    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-e3f42f-openshift-default-dockercfg-f98kw\""
Sep 11 13:20:37.188955 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.188922    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"]
Sep 11 13:20:37.232234 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.232202    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fd5d717-e12d-4383-a0e7-4d0083b307c9-credential-socket\") pod \"e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") " pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:37.232386 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.232243    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fd5d717-e12d-4383-a0e7-4d0083b307c9-workload-certs\") pod \"e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") " pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:37.232386 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.232324    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fd5d717-e12d-4383-a0e7-4d0083b307c9-istio-token\") pod \"e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") " pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:37.232477 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.232443    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fd5d717-e12d-4383-a0e7-4d0083b307c9-istio-envoy\") pod \"e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") " pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:37.232477 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.232464    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfvnk\" (UniqueName: \"kubernetes.io/projected/2fd5d717-e12d-4383-a0e7-4d0083b307c9-kube-api-access-hfvnk\") pod \"e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") " pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:37.232559 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.232490    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fd5d717-e12d-4383-a0e7-4d0083b307c9-workload-socket\") pod \"e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") " pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:37.232559 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.232508    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fd5d717-e12d-4383-a0e7-4d0083b307c9-istio-data\") pod \"e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") " pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:37.232648 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.232596    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fd5d717-e12d-4383-a0e7-4d0083b307c9-istio-podinfo\") pod \"e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") " pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:37.232648 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.232611    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fd5d717-e12d-4383-a0e7-4d0083b307c9-istiod-ca-cert\") pod \"e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") " pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:37.290730 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.290691    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:37.333512 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.333466    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fd5d717-e12d-4383-a0e7-4d0083b307c9-istio-envoy\") pod \"e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") " pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:37.333512 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.333512    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfvnk\" (UniqueName: \"kubernetes.io/projected/2fd5d717-e12d-4383-a0e7-4d0083b307c9-kube-api-access-hfvnk\") pod \"e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") " pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:37.333814 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.333536    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fd5d717-e12d-4383-a0e7-4d0083b307c9-workload-socket\") pod \"e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") " pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:37.333814 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.333554    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fd5d717-e12d-4383-a0e7-4d0083b307c9-istio-data\") pod \"e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") " pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:37.333814 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.333596    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fd5d717-e12d-4383-a0e7-4d0083b307c9-istio-podinfo\") pod \"e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") " pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:37.333814 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.333612    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fd5d717-e12d-4383-a0e7-4d0083b307c9-istiod-ca-cert\") pod \"e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") " pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:37.333814 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.333645    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fd5d717-e12d-4383-a0e7-4d0083b307c9-credential-socket\") pod \"e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") " pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:37.333814 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.333675    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fd5d717-e12d-4383-a0e7-4d0083b307c9-workload-certs\") pod \"e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") " pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:37.333814 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.333773    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fd5d717-e12d-4383-a0e7-4d0083b307c9-istio-token\") pod \"e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") " pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:37.334150 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.334054    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fd5d717-e12d-4383-a0e7-4d0083b307c9-workload-socket\") pod \"e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") " pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:37.334150 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.334130    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fd5d717-e12d-4383-a0e7-4d0083b307c9-istio-data\") pod \"e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") " pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:37.334221 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.334186    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fd5d717-e12d-4383-a0e7-4d0083b307c9-workload-certs\") pod \"e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") " pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:37.334408 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.334392    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fd5d717-e12d-4383-a0e7-4d0083b307c9-credential-socket\") pod \"e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") " pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:37.334607 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.334584    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fd5d717-e12d-4383-a0e7-4d0083b307c9-istiod-ca-cert\") pod \"e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") " pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:37.336024 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.336005    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fd5d717-e12d-4383-a0e7-4d0083b307c9-istio-envoy\") pod \"e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") " pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:37.336359 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.336338    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fd5d717-e12d-4383-a0e7-4d0083b307c9-istio-podinfo\") pod \"e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") " pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:37.359997 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.359973    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfvnk\" (UniqueName: \"kubernetes.io/projected/2fd5d717-e12d-4383-a0e7-4d0083b307c9-kube-api-access-hfvnk\") pod \"e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") " pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:37.367837 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.367792    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fd5d717-e12d-4383-a0e7-4d0083b307c9-istio-token\") pod \"e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") " pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:37.396002 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.395975    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:37.476797 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.476699    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:37.715124 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.715090    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:37.777016 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.776994    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"]
Sep 11 13:20:37.778574 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:20:37.778546    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fd5d717_e12d_4383_a0e7_4d0083b307c9.slice/crio-80b46510fc14a6efa02b0795f84790bffea621162d74bdb8c81c36590c3d8efb WatchSource:0}: Error finding container 80b46510fc14a6efa02b0795f84790bffea621162d74bdb8c81c36590c3d8efb: Status 404 returned error can't find the container with id 80b46510fc14a6efa02b0795f84790bffea621162d74bdb8c81c36590c3d8efb
Sep 11 13:20:37.781007 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.780974    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:20:37.781084 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.781040    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:20:37.781084 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:37.781068    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:20:38.336544 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:38.336504    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr" event={"ID":"2fd5d717-e12d-4383-a0e7-4d0083b307c9","Type":"ContainerStarted","Data":"14ce10ef3ef95a63c921c2493a09314fc9c80a61c80ac937247c36ba0f2a56ba"}
Sep 11 13:20:38.336697 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:38.336573    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr" event={"ID":"2fd5d717-e12d-4383-a0e7-4d0083b307c9","Type":"ContainerStarted","Data":"80b46510fc14a6efa02b0795f84790bffea621162d74bdb8c81c36590c3d8efb"}
Sep 11 13:20:38.365117 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:38.365070    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr" podStartSLOduration=1.365050605 podStartE2EDuration="1.365050605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:20:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:38.361567162 +0000 UTC m=+1505.223041361" watchObservedRunningTime="2026-09-11 13:20:38.365050605 +0000 UTC m=+1505.226524794"
Sep 11 13:20:38.477776 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:38.477747    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:38.483638 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:38.483617    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:38.783566 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:38.783464    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:39.343661 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:39.343627    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:39.344547 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:39.344530    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:20:40.134442 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:40.134404    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:40.615203 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:40.615163    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:40.755783 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:40.755745    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:41.781230 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:41.781197    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:43.296632 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:43.296595    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:43.468793 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:43.468762    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:43.678836 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:43.678785    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:44.454341 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:44.454303    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:44.697512 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:44.697473    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:44.722939 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:44.722858    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-e3f42f-6bd4776758-ljsm9"]
Sep 11 13:20:44.726774 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:44.726756    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e3f42f-6bd4776758-ljsm9"
Sep 11 13:20:44.731445 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:44.731419    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-e3f42f\""
Sep 11 13:20:44.759359 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:44.759328    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-e3f42f-6bd4776758-ljsm9"]
Sep 11 13:20:44.808081 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:44.808044    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5zh2\" (UniqueName: \"kubernetes.io/projected/5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5-kube-api-access-m5zh2\") pod \"payload-pre-processing-e2e-ipp-b-e3f42f-6bd4776758-ljsm9\" (UID: \"5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e3f42f-6bd4776758-ljsm9"
Sep 11 13:20:44.808295 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:44.808116    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-e3f42f-6bd4776758-ljsm9\" (UID: \"5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e3f42f-6bd4776758-ljsm9"
Sep 11 13:20:44.909368 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:44.909321    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-e3f42f-6bd4776758-ljsm9\" (UID: \"5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e3f42f-6bd4776758-ljsm9"
Sep 11 13:20:44.909626 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:44.909481    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5zh2\" (UniqueName: \"kubernetes.io/projected/5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5-kube-api-access-m5zh2\") pod \"payload-pre-processing-e2e-ipp-b-e3f42f-6bd4776758-ljsm9\" (UID: \"5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e3f42f-6bd4776758-ljsm9"
Sep 11 13:20:44.910133 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:44.910115    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-e3f42f-6bd4776758-ljsm9\" (UID: \"5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e3f42f-6bd4776758-ljsm9"
Sep 11 13:20:44.947194 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:44.947161    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5zh2\" (UniqueName: \"kubernetes.io/projected/5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5-kube-api-access-m5zh2\") pod \"payload-pre-processing-e2e-ipp-b-e3f42f-6bd4776758-ljsm9\" (UID: \"5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e3f42f-6bd4776758-ljsm9"
Sep 11 13:20:45.037019 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:45.036922    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e3f42f-6bd4776758-ljsm9"
Sep 11 13:20:45.058178 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:45.058141    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c"]
Sep 11 13:20:45.062833 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:45.062801    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c"
Sep 11 13:20:45.078141 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:45.078110    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-e3f42f-dockercfg-k9fdk\""
Sep 11 13:20:45.082397 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:45.082369    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c"]
Sep 11 13:20:45.212773 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:45.212742    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sttjd\" (UniqueName: \"kubernetes.io/projected/5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7-kube-api-access-sttjd\") pod \"payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c\" (UID: \"5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c"
Sep 11 13:20:45.212954 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:45.212846    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c\" (UID: \"5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c"
Sep 11 13:20:45.313841 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:45.313807    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c\" (UID: \"5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c"
Sep 11 13:20:45.314006 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:45.313918    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sttjd\" (UniqueName: \"kubernetes.io/projected/5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7-kube-api-access-sttjd\") pod \"payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c\" (UID: \"5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c"
Sep 11 13:20:45.314491 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:45.314471    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c\" (UID: \"5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c"
Sep 11 13:20:45.334172 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:45.334145    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sttjd\" (UniqueName: \"kubernetes.io/projected/5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7-kube-api-access-sttjd\") pod \"payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c\" (UID: \"5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c"
Sep 11 13:20:45.364171 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:45.364134    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-e3f42f-6bd4776758-ljsm9"]
Sep 11 13:20:45.372015 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:20:45.371988    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ccc14b2_9ec4_4cd9_bd4a_0940f43d72c5.slice/crio-380aa52b67546e387eaffb3e42d319645c4a8353b1ffa342cfaf588a32f62749 WatchSource:0}: Error finding container 380aa52b67546e387eaffb3e42d319645c4a8353b1ffa342cfaf588a32f62749: Status 404 returned error can't find the container with id 380aa52b67546e387eaffb3e42d319645c4a8353b1ffa342cfaf588a32f62749
Sep 11 13:20:45.378030 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:45.373590    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c"
Sep 11 13:20:45.389164 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:45.389135    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e3f42f-6bd4776758-ljsm9" event={"ID":"5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5","Type":"ContainerStarted","Data":"380aa52b67546e387eaffb3e42d319645c4a8353b1ffa342cfaf588a32f62749"}
Sep 11 13:20:45.704349 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:45.704321    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c"]
Sep 11 13:20:45.706018 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:20:45.705984    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f8c3795_dbe0_49b8_b99f_3aa562a4d6c7.slice/crio-f4a78950f082b5902bbe14eec4026e2d80170b212d39ad0759f6fb776f8ad677 WatchSource:0}: Error finding container f4a78950f082b5902bbe14eec4026e2d80170b212d39ad0759f6fb776f8ad677: Status 404 returned error can't find the container with id f4a78950f082b5902bbe14eec4026e2d80170b212d39ad0759f6fb776f8ad677
Sep 11 13:20:45.817833 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:45.817790    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:46.396470 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:46.396428    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e3f42f-6bd4776758-ljsm9" event={"ID":"5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5","Type":"ContainerStarted","Data":"482dc9d2e704d3018a8f65c2c2ffee28b8e4fb724b006cee16c44224c1ec00b6"}
Sep 11 13:20:46.396681 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:46.396498    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e3f42f-6bd4776758-ljsm9"
Sep 11 13:20:46.398126 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:46.398099    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c" event={"ID":"5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7","Type":"ContainerStarted","Data":"1aaccdb7b551346fd9f8d876fd27095a78f3f0128156cbb36ca1b324bc42e75d"}
Sep 11 13:20:46.398235 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:46.398141    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c" event={"ID":"5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7","Type":"ContainerStarted","Data":"f4a78950f082b5902bbe14eec4026e2d80170b212d39ad0759f6fb776f8ad677"}
Sep 11 13:20:46.398235 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:46.398205    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c"
Sep 11 13:20:46.429620 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:46.429573    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e3f42f-6bd4776758-ljsm9" podStartSLOduration=2.429558181 podStartE2EDuration="2.429558181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:20:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:46.427183048 +0000 UTC m=+1513.288657236" watchObservedRunningTime="2026-09-11 13:20:46.429558181 +0000 UTC m=+1513.291032367"
Sep 11 13:20:46.463815 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:46.463762    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c" podStartSLOduration=2.463739926 podStartE2EDuration="2.463739926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:20:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:46.459029856 +0000 UTC m=+1513.320504043" watchObservedRunningTime="2026-09-11 13:20:46.463739926 +0000 UTC m=+1513.325214109"
Sep 11 13:20:46.997180 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:46.997146    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:48.253766 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:48.253734    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:49.408996 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:49.408955    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:50.661379 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:50.661328    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:51.906045 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:51.906013    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:51.979653 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:51.979562    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a3785d-6d89677749-96lgq"]
Sep 11 13:20:51.979887 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:51.979815    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-a3785d-6d89677749-96lgq" podUID="bf1e7b21-62ec-4e72-9afc-5d59a098092f" containerName="payload-processing" containerID="cri-o://983bfc5f3a0a7f080648e5a7b1d9eafe4122ae77771f0deccc26984a3158ccfe" gracePeriod=30
Sep 11 13:20:51.982628 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:51.982602    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a3785d-848cf55b58-xg8j9"]
Sep 11 13:20:51.983119 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:51.982882    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a3785d-848cf55b58-xg8j9" podUID="1f1ab812-6c05-4c5d-a165-64fca39d5585" containerName="payload-pre-processing" containerID="cri-o://e45709576e1fa84371848d9fa318d412052c75c4c19846974fa13c7b055bddc0" gracePeriod=30
Sep 11 13:20:52.113063 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.113030    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:52.324886 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.324862    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a3785d-848cf55b58-xg8j9"
Sep 11 13:20:52.328236 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.328211    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-a3785d-6d89677749-96lgq"
Sep 11 13:20:52.387129 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.387097    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf1e7b21-62ec-4e72-9afc-5d59a098092f-plugins-config-volume\") pod \"bf1e7b21-62ec-4e72-9afc-5d59a098092f\" (UID: \"bf1e7b21-62ec-4e72-9afc-5d59a098092f\") "
Sep 11 13:20:52.387303 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.387149    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2f25\" (UniqueName: \"kubernetes.io/projected/1f1ab812-6c05-4c5d-a165-64fca39d5585-kube-api-access-z2f25\") pod \"1f1ab812-6c05-4c5d-a165-64fca39d5585\" (UID: \"1f1ab812-6c05-4c5d-a165-64fca39d5585\") "
Sep 11 13:20:52.387303 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.387189    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f1ab812-6c05-4c5d-a165-64fca39d5585-plugins-config-volume\") pod \"1f1ab812-6c05-4c5d-a165-64fca39d5585\" (UID: \"1f1ab812-6c05-4c5d-a165-64fca39d5585\") "
Sep 11 13:20:52.387436 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.387360    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnsnk\" (UniqueName: \"kubernetes.io/projected/bf1e7b21-62ec-4e72-9afc-5d59a098092f-kube-api-access-rnsnk\") pod \"bf1e7b21-62ec-4e72-9afc-5d59a098092f\" (UID: \"bf1e7b21-62ec-4e72-9afc-5d59a098092f\") "
Sep 11 13:20:52.387495 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.387468    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f1ab812-6c05-4c5d-a165-64fca39d5585-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1f1ab812-6c05-4c5d-a165-64fca39d5585" (UID: "1f1ab812-6c05-4c5d-a165-64fca39d5585"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:20:52.387544 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.387505    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf1e7b21-62ec-4e72-9afc-5d59a098092f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bf1e7b21-62ec-4e72-9afc-5d59a098092f" (UID: "bf1e7b21-62ec-4e72-9afc-5d59a098092f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:20:52.387877 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.387852    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f1ab812-6c05-4c5d-a165-64fca39d5585-plugins-config-volume\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:20:52.387978 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.387879    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf1e7b21-62ec-4e72-9afc-5d59a098092f-plugins-config-volume\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:20:52.389856 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.389827    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf1e7b21-62ec-4e72-9afc-5d59a098092f-kube-api-access-rnsnk" (OuterVolumeSpecName: "kube-api-access-rnsnk") pod "bf1e7b21-62ec-4e72-9afc-5d59a098092f" (UID: "bf1e7b21-62ec-4e72-9afc-5d59a098092f"). InnerVolumeSpecName "kube-api-access-rnsnk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:20:52.389972 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.389863    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f1ab812-6c05-4c5d-a165-64fca39d5585-kube-api-access-z2f25" (OuterVolumeSpecName: "kube-api-access-z2f25") pod "1f1ab812-6c05-4c5d-a165-64fca39d5585" (UID: "1f1ab812-6c05-4c5d-a165-64fca39d5585"). InnerVolumeSpecName "kube-api-access-z2f25". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:20:52.419598 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.419558    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:52.436604 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.436536    2547 generic.go:356] "Generic (PLEG): container finished" podID="bf1e7b21-62ec-4e72-9afc-5d59a098092f" containerID="983bfc5f3a0a7f080648e5a7b1d9eafe4122ae77771f0deccc26984a3158ccfe" exitCode=0
Sep 11 13:20:52.436778 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.436601    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-a3785d-6d89677749-96lgq"
Sep 11 13:20:52.436778 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.436628    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-a3785d-6d89677749-96lgq" event={"ID":"bf1e7b21-62ec-4e72-9afc-5d59a098092f","Type":"ContainerDied","Data":"983bfc5f3a0a7f080648e5a7b1d9eafe4122ae77771f0deccc26984a3158ccfe"}
Sep 11 13:20:52.436778 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.436692    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-a3785d-6d89677749-96lgq" event={"ID":"bf1e7b21-62ec-4e72-9afc-5d59a098092f","Type":"ContainerDied","Data":"5b323deb19021482d4aed524b782b938b01d046d73c60a949a7f857c1909cf58"}
Sep 11 13:20:52.436778 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.436753    2547 scope.go:117] "RemoveContainer" containerID="983bfc5f3a0a7f080648e5a7b1d9eafe4122ae77771f0deccc26984a3158ccfe"
Sep 11 13:20:52.438252 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.438221    2547 generic.go:356] "Generic (PLEG): container finished" podID="1f1ab812-6c05-4c5d-a165-64fca39d5585" containerID="e45709576e1fa84371848d9fa318d412052c75c4c19846974fa13c7b055bddc0" exitCode=0
Sep 11 13:20:52.438361 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.438307    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a3785d-848cf55b58-xg8j9"
Sep 11 13:20:52.438361 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.438330    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a3785d-848cf55b58-xg8j9" event={"ID":"1f1ab812-6c05-4c5d-a165-64fca39d5585","Type":"ContainerDied","Data":"e45709576e1fa84371848d9fa318d412052c75c4c19846974fa13c7b055bddc0"}
Sep 11 13:20:52.438453 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.438392    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a3785d-848cf55b58-xg8j9" event={"ID":"1f1ab812-6c05-4c5d-a165-64fca39d5585","Type":"ContainerDied","Data":"5d9da75fa8379ed583ec11cef9b5750e44ec9fc3d117bf268a85444529d0a4db"}
Sep 11 13:20:52.476123 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.476097    2547 scope.go:117] "RemoveContainer" containerID="983bfc5f3a0a7f080648e5a7b1d9eafe4122ae77771f0deccc26984a3158ccfe"
Sep 11 13:20:52.476502 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:20:52.476464    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"983bfc5f3a0a7f080648e5a7b1d9eafe4122ae77771f0deccc26984a3158ccfe\": container with ID starting with 983bfc5f3a0a7f080648e5a7b1d9eafe4122ae77771f0deccc26984a3158ccfe not found: ID does not exist" containerID="983bfc5f3a0a7f080648e5a7b1d9eafe4122ae77771f0deccc26984a3158ccfe"
Sep 11 13:20:52.476502 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.476497    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"983bfc5f3a0a7f080648e5a7b1d9eafe4122ae77771f0deccc26984a3158ccfe"} err="failed to get container status \"983bfc5f3a0a7f080648e5a7b1d9eafe4122ae77771f0deccc26984a3158ccfe\": rpc error: code = NotFound desc = could not find container \"983bfc5f3a0a7f080648e5a7b1d9eafe4122ae77771f0deccc26984a3158ccfe\": container with ID starting with 983bfc5f3a0a7f080648e5a7b1d9eafe4122ae77771f0deccc26984a3158ccfe not found: ID does not exist"
Sep 11 13:20:52.476649 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.476515    2547 scope.go:117] "RemoveContainer" containerID="e45709576e1fa84371848d9fa318d412052c75c4c19846974fa13c7b055bddc0"
Sep 11 13:20:52.486573 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.486557    2547 scope.go:117] "RemoveContainer" containerID="e45709576e1fa84371848d9fa318d412052c75c4c19846974fa13c7b055bddc0"
Sep 11 13:20:52.486884 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:20:52.486864    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e45709576e1fa84371848d9fa318d412052c75c4c19846974fa13c7b055bddc0\": container with ID starting with e45709576e1fa84371848d9fa318d412052c75c4c19846974fa13c7b055bddc0 not found: ID does not exist" containerID="e45709576e1fa84371848d9fa318d412052c75c4c19846974fa13c7b055bddc0"
Sep 11 13:20:52.486946 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.486895    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e45709576e1fa84371848d9fa318d412052c75c4c19846974fa13c7b055bddc0"} err="failed to get container status \"e45709576e1fa84371848d9fa318d412052c75c4c19846974fa13c7b055bddc0\": rpc error: code = NotFound desc = could not find container \"e45709576e1fa84371848d9fa318d412052c75c4c19846974fa13c7b055bddc0\": container with ID starting with e45709576e1fa84371848d9fa318d412052c75c4c19846974fa13c7b055bddc0 not found: ID does not exist"
Sep 11 13:20:52.488444 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.488423    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2f25\" (UniqueName: \"kubernetes.io/projected/1f1ab812-6c05-4c5d-a165-64fca39d5585-kube-api-access-z2f25\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:20:52.488444 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.488444    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnsnk\" (UniqueName: \"kubernetes.io/projected/bf1e7b21-62ec-4e72-9afc-5d59a098092f-kube-api-access-rnsnk\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:20:52.524586 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.524563    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a3785d-848cf55b58-xg8j9"]
Sep 11 13:20:52.536990 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.536967    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a3785d-848cf55b58-xg8j9"]
Sep 11 13:20:52.592224 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.592192    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3785d-qn5bt"]
Sep 11 13:20:52.598417 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.598383    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a3785d-6d89677749-96lgq"]
Sep 11 13:20:52.606305 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.606276    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3785d-qn5bt"]
Sep 11 13:20:52.612086 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.612063    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a3785d-6d89677749-96lgq"]
Sep 11 13:20:52.675615 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.675577    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:52.803521 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:52.803429    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:53.088356 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:53.088321    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:53.669004 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:53.668970    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f1ab812-6c05-4c5d-a165-64fca39d5585" path="/var/lib/kubelet/pods/1f1ab812-6c05-4c5d-a165-64fca39d5585/volumes"
Sep 11 13:20:53.669338 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:53.669324    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78ae2e13-1a4b-4454-b2d1-f915de45220e" path="/var/lib/kubelet/pods/78ae2e13-1a4b-4454-b2d1-f915de45220e/volumes"
Sep 11 13:20:53.669673 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:53.669660    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf1e7b21-62ec-4e72-9afc-5d59a098092f" path="/var/lib/kubelet/pods/bf1e7b21-62ec-4e72-9afc-5d59a098092f/volumes"
Sep 11 13:20:54.304092 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:54.304051    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:55.266775 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:55.266663    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:55.516154 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:55.516100    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:56.709935 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:56.709897    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:57.406851 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:57.406819    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e3f42f-6bd4776758-ljsm9"
Sep 11 13:20:57.407044 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:57.406908    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c"
Sep 11 13:20:57.851981 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:57.851936    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:58.996499 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:58.996461    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:59.505460 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:59.505363    2547 generic.go:356] "Generic (PLEG): container finished" podID="2fd5d717-e12d-4383-a0e7-4d0083b307c9" containerID="14ce10ef3ef95a63c921c2493a09314fc9c80a61c80ac937247c36ba0f2a56ba" exitCode=0
Sep 11 13:20:59.505460 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:59.505437    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr" event={"ID":"2fd5d717-e12d-4383-a0e7-4d0083b307c9","Type":"ContainerDied","Data":"14ce10ef3ef95a63c921c2493a09314fc9c80a61c80ac937247c36ba0f2a56ba"}
Sep 11 13:20:59.505899 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:59.505881    2547 scope.go:117] "RemoveContainer" containerID="14ce10ef3ef95a63c921c2493a09314fc9c80a61c80ac937247c36ba0f2a56ba"
Sep 11 13:20:59.507063 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:59.507034    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:20:59.507149 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:59.507102    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:20:59.507149 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:59.507130    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:20:59.974154 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:20:59.974105    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:00.513759 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:00.513701    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr" event={"ID":"2fd5d717-e12d-4383-a0e7-4d0083b307c9","Type":"ContainerStarted","Data":"d96f922cd205ccddee5c42a87a985e3a9ab5cfb1035018706734a7cf049a97fc"}
Sep 11 13:21:00.954487 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:00.954444    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:01.128957 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:01.128918    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:01.477193 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:01.477159    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:21:01.477508 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:01.477485    2547 patch_prober.go:28] interesting pod/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.99:15021/healthz/ready\": dial tcp 10.133.0.99:15021: connect: connection refused" start-of-body=
Sep 11 13:21:01.477558 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:01.477537    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr" podUID="2fd5d717-e12d-4383-a0e7-4d0083b307c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.99:15021/healthz/ready\": dial tcp 10.133.0.99:15021: connect: connection refused"
Sep 11 13:21:01.704122 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:01.704093    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:01.818544 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:01.818510    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4d7bb0-78rsf"]
Sep 11 13:21:01.818953 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:01.818940    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf1e7b21-62ec-4e72-9afc-5d59a098092f" containerName="payload-processing"
Sep 11 13:21:01.819001 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:01.818954    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf1e7b21-62ec-4e72-9afc-5d59a098092f" containerName="payload-processing"
Sep 11 13:21:01.819001 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:01.818965    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f1ab812-6c05-4c5d-a165-64fca39d5585" containerName="payload-pre-processing"
Sep 11 13:21:01.819001 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:01.818970    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f1ab812-6c05-4c5d-a165-64fca39d5585" containerName="payload-pre-processing"
Sep 11 13:21:01.819098 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:01.819057    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f1ab812-6c05-4c5d-a165-64fca39d5585" containerName="payload-pre-processing"
Sep 11 13:21:01.819098 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:01.819072    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf1e7b21-62ec-4e72-9afc-5d59a098092f" containerName="payload-processing"
Sep 11 13:21:01.821114 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:01.821099    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4d7bb0-78rsf"
Sep 11 13:21:01.826238 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:01.826220    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kt2vz\""
Sep 11 13:21:01.826731 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:01.826698    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:21:01.869427 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:01.869387    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4d7bb0-78rsf"]
Sep 11 13:21:01.887514 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:01.887482    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93514ade-8968-4228-994a-49c6533e5572-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-4d7bb0-78rsf\" (UID: \"93514ade-8968-4228-994a-49c6533e5572\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4d7bb0-78rsf"
Sep 11 13:21:01.988848 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:01.988815    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93514ade-8968-4228-994a-49c6533e5572-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-4d7bb0-78rsf\" (UID: \"93514ade-8968-4228-994a-49c6533e5572\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4d7bb0-78rsf"
Sep 11 13:21:01.989429 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:01.989410    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93514ade-8968-4228-994a-49c6533e5572-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-4d7bb0-78rsf\" (UID: \"93514ade-8968-4228-994a-49c6533e5572\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4d7bb0-78rsf"
Sep 11 13:21:02.132334 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:02.132257    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4d7bb0-78rsf"
Sep 11 13:21:02.440469 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:02.440434    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4d7bb0-78rsf"]
Sep 11 13:21:02.477945 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:02.477915    2547 patch_prober.go:28] interesting pod/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.99:15021/healthz/ready\": dial tcp 10.133.0.99:15021: connect: connection refused" start-of-body=
Sep 11 13:21:02.478061 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:02.477979    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr" podUID="2fd5d717-e12d-4383-a0e7-4d0083b307c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.99:15021/healthz/ready\": dial tcp 10.133.0.99:15021: connect: connection refused"
Sep 11 13:21:02.527560 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:02.527524    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4d7bb0-78rsf" event={"ID":"93514ade-8968-4228-994a-49c6533e5572","Type":"ContainerStarted","Data":"93545ee32fb10b15e447ce83938abe47e31d2c60ab79f211b5780597248480df"}
Sep 11 13:21:03.118041 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:03.117990    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:03.477108 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:03.477074    2547 patch_prober.go:28] interesting pod/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.99:15021/healthz/ready\": dial tcp 10.133.0.99:15021: connect: connection refused" start-of-body=
Sep 11 13:21:03.477282 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:03.477128    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr" podUID="2fd5d717-e12d-4383-a0e7-4d0083b307c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.99:15021/healthz/ready\": dial tcp 10.133.0.99:15021: connect: connection refused"
Sep 11 13:21:03.538025 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:03.537996    2547 generic.go:356] "Generic (PLEG): container finished" podID="93514ade-8968-4228-994a-49c6533e5572" containerID="9c4b4350ba12d2551cdacff13ae0d4647de2f6aff9cf2e9ad85cba570ce5ec54" exitCode=0
Sep 11 13:21:03.538187 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:03.538033    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4d7bb0-78rsf" event={"ID":"93514ade-8968-4228-994a-49c6533e5572","Type":"ContainerDied","Data":"9c4b4350ba12d2551cdacff13ae0d4647de2f6aff9cf2e9ad85cba570ce5ec54"}
Sep 11 13:21:04.102775 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:04.102739    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:04.478036 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:04.477939    2547 patch_prober.go:28] interesting pod/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.99:15021/healthz/ready\": dial tcp 10.133.0.99:15021: connect: connection refused" start-of-body=
Sep 11 13:21:04.478036 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:04.478001    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr" podUID="2fd5d717-e12d-4383-a0e7-4d0083b307c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.99:15021/healthz/ready\": dial tcp 10.133.0.99:15021: connect: connection refused"
Sep 11 13:21:04.717494 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:04.717467    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4d7bb0-78rsf"
Sep 11 13:21:04.818367 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:04.818340    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93514ade-8968-4228-994a-49c6533e5572-maas-api-service-ca\") pod \"93514ade-8968-4228-994a-49c6533e5572\" (UID: \"93514ade-8968-4228-994a-49c6533e5572\") "
Sep 11 13:21:04.818683 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:04.818662    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93514ade-8968-4228-994a-49c6533e5572-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "93514ade-8968-4228-994a-49c6533e5572" (UID: "93514ade-8968-4228-994a-49c6533e5572"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:21:04.919374 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:04.919343    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93514ade-8968-4228-994a-49c6533e5572-maas-api-service-ca\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:21:04.939217 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:04.939181    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:05.477427 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:05.477390    2547 patch_prober.go:28] interesting pod/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.99:15021/healthz/ready\": dial tcp 10.133.0.99:15021: connect: connection refused" start-of-body=
Sep 11 13:21:05.477610 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:05.477448    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr" podUID="2fd5d717-e12d-4383-a0e7-4d0083b307c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.99:15021/healthz/ready\": dial tcp 10.133.0.99:15021: connect: connection refused"
Sep 11 13:21:05.558244 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:05.558201    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4d7bb0-78rsf" event={"ID":"93514ade-8968-4228-994a-49c6533e5572","Type":"ContainerDied","Data":"93545ee32fb10b15e447ce83938abe47e31d2c60ab79f211b5780597248480df"}
Sep 11 13:21:05.558762 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:05.558268    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="93545ee32fb10b15e447ce83938abe47e31d2c60ab79f211b5780597248480df"
Sep 11 13:21:05.558762 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:05.558341    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4d7bb0-78rsf"
Sep 11 13:21:05.896505 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:05.896463    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c_5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7/payload-processing/0.log"
Sep 11 13:21:06.481539 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:06.481505    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:21:06.481938 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:06.481915    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:21:06.482442 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:06.482423    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:21:06.753315 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:06.753232    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:07.391632 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:07.391594    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:08.257820 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:08.257782    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:12.078782 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:12.078746    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:12.877228 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:12.877188    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:12.888657 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:12.888627    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4d7bb0-29818875-94z2g"]
Sep 11 13:21:12.893305 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:12.893283    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4d7bb0-29818875-94z2g"]
Sep 11 13:21:12.988194 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:12.988157    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:13.171671 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:13.171571    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4d7bb0-78rsf"]
Sep 11 13:21:13.174375 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:13.174347    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4d7bb0-78rsf"]
Sep 11 13:21:13.229605 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:13.229555    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:13.330124 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:13.330088    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:13.665189 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:13.665160    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93514ade-8968-4228-994a-49c6533e5572" path="/var/lib/kubelet/pods/93514ade-8968-4228-994a-49c6533e5572/volumes"
Sep 11 13:21:13.665447 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:13.665434    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db22b26f-8be2-460e-998d-10be3da21034" path="/var/lib/kubelet/pods/db22b26f-8be2-460e-998d-10be3da21034/volumes"
Sep 11 13:21:13.720796 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:13.720762    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:13.973449 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:13.973355    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:14.426559 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:14.426513    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:15.576853 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:15.576818    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:16.652503 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:16.652465    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:17.914394 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:17.914356    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:19.092409 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:19.092368    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:20.502877 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:20.502839    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:22.005755 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:22.005699    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:22.187624 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:22.187593    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:22.588574 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:22.588537    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:23.424098 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:23.424065    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:23.562264 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:23.562212    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:23.970759 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:23.970699    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:25.041644 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:25.041612    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:26.203849 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:26.203790    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:27.201088 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:27.201046    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:28.299430 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:28.299395    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:29.206776 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:29.206744    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:33.503274 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:33.503237    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:33.585191 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:33.585161    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f705b6-9d6c4d586-mshrd"]
Sep 11 13:21:33.585394 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:33.585371    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f705b6-9d6c4d586-mshrd" podUID="8bf8e379-7f8d-4467-89bc-078256340acb" containerName="payload-pre-processing" containerID="cri-o://e5e06644804c7581c0aa6f184377964203ef182e3b6b2fbc79cdc490051aed62" gracePeriod=30
Sep 11 13:21:33.614877 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:33.614838    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:33.710556 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:33.710517    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:33.738969 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:33.738932    2547 generic.go:356] "Generic (PLEG): container finished" podID="8bf8e379-7f8d-4467-89bc-078256340acb" containerID="e5e06644804c7581c0aa6f184377964203ef182e3b6b2fbc79cdc490051aed62" exitCode=0
Sep 11 13:21:33.739141 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:33.738996    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f705b6-9d6c4d586-mshrd" event={"ID":"8bf8e379-7f8d-4467-89bc-078256340acb","Type":"ContainerDied","Data":"e5e06644804c7581c0aa6f184377964203ef182e3b6b2fbc79cdc490051aed62"}
Sep 11 13:21:33.859399 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:33.859367    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f705b6-9d6c4d586-mshrd"
Sep 11 13:21:33.901263 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:33.901175    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:33.907966 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:33.907934    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8bf8e379-7f8d-4467-89bc-078256340acb-plugins-config-volume\") pod \"8bf8e379-7f8d-4467-89bc-078256340acb\" (UID: \"8bf8e379-7f8d-4467-89bc-078256340acb\") "
Sep 11 13:21:33.908186 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:33.907993    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llknw\" (UniqueName: \"kubernetes.io/projected/8bf8e379-7f8d-4467-89bc-078256340acb-kube-api-access-llknw\") pod \"8bf8e379-7f8d-4467-89bc-078256340acb\" (UID: \"8bf8e379-7f8d-4467-89bc-078256340acb\") "
Sep 11 13:21:33.908376 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:33.908355    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bf8e379-7f8d-4467-89bc-078256340acb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8bf8e379-7f8d-4467-89bc-078256340acb" (UID: "8bf8e379-7f8d-4467-89bc-078256340acb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:21:33.910489 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:33.910424    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bf8e379-7f8d-4467-89bc-078256340acb-kube-api-access-llknw" (OuterVolumeSpecName: "kube-api-access-llknw") pod "8bf8e379-7f8d-4467-89bc-078256340acb" (UID: "8bf8e379-7f8d-4467-89bc-078256340acb"). InnerVolumeSpecName "kube-api-access-llknw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:21:34.009915 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:34.009830    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8bf8e379-7f8d-4467-89bc-078256340acb-plugins-config-volume\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:21:34.009915 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:34.009856    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llknw\" (UniqueName: \"kubernetes.io/projected/8bf8e379-7f8d-4467-89bc-078256340acb-kube-api-access-llknw\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:21:34.028709 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:34.028677    2547 scope.go:117] "RemoveContainer" containerID="dba3630e337fc4bc80b5c883ace14cfb39eaf72754ece7d1fab27117b88190fc"
Sep 11 13:21:34.038943 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:34.038916    2547 scope.go:117] "RemoveContainer" containerID="e5e06644804c7581c0aa6f184377964203ef182e3b6b2fbc79cdc490051aed62"
Sep 11 13:21:34.112528 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:34.112473    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:34.298766 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:34.298645    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:34.401978 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:34.401947    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:34.745319 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:34.745286    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f705b6-9d6c4d586-mshrd" event={"ID":"8bf8e379-7f8d-4467-89bc-078256340acb","Type":"ContainerDied","Data":"58525392c2dd1f5428e12728adae574625d75beed54c0f29f021d5a1d418ba55"}
Sep 11 13:21:34.745761 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:34.745352    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f705b6-9d6c4d586-mshrd"
Sep 11 13:21:34.781359 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:34.781328    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f705b6-9d6c4d586-mshrd"]
Sep 11 13:21:34.785756 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:34.785730    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f705b6-9d6c4d586-mshrd"]
Sep 11 13:21:35.299113 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:35.299077    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:35.663978 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:35.663944    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bf8e379-7f8d-4467-89bc-078256340acb" path="/var/lib/kubelet/pods/8bf8e379-7f8d-4467-89bc-078256340acb/volumes"
Sep 11 13:21:36.507825 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:36.507784    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:37.602963 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:37.602926    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:38.480504 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:38.480458    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:41.562404 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:41.562361    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:41.915856 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:41.915767    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:42.097953 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:42.097910    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:52.097333 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:52.097298    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-cc857f-6657889b5-bnnsm_a6b690de-8359-4cd7-8ffc-f8d2944b7aea/payload-processing/0.log"
Sep 11 13:21:52.408968 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:52.408883    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c_5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7/payload-processing/0.log"
Sep 11 13:21:52.725293 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:52.725190    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:53.117853 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:53.117801    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:53.372443 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:53.372352    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:55.816670 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:55.816630    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:56.620636 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:56.620583    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:56.732675 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:56.732632    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:57.004522 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:57.004436    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:58.071501 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:58.071469    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:59.433327 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:21:59.433288    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:00.775929 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:00.775890    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:01.886146 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:01.886114    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:02.069687 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:02.069649    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:02.222608 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:02.222511    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:02.673869 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:02.673826    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:02.784653 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:02.784614    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:08.642527 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:08.642491    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:24.439930 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:24.439885    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:25.169995 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:25.169960    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:26.013570 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:26.013534    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:26.692893 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:26.692856    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:26.853897 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:26.853862    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:27.668193 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:27.668147    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:28.671242 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:28.671205    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:29.407887 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:29.407850    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:30.595287 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:30.595243    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:31.757102 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:31.757068    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:32.857018 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:32.856984    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:33.974280 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:33.974234    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:38.012545 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:38.012493    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:38.660043 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:38.659994    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:38.768504 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:38.768464    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:38.900828 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:38.900788    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:38.983608 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:38.983521    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:39.385955 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:39.385917    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:39.513393 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:39.513351    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:40.395096 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:40.395060    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:41.389461 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:41.389424    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:42.839517 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:42.839481    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:43.566842 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:43.566772    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:45.758990 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:45.758941    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:45.921019 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:45.920989    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:46.046685 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:46.046603    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:50.866890 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:50.866843    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:51.676329 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:51.676286    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:52.637876 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:52.637837    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:53.451871 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:53.451835    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:54.276207 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:54.276172    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:55.547768 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:55.547709    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:55.650605 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:22:55.650564    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:23:01.949514 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:01.949481    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:23:02.049607 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:02.049570    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:23:05.623320 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:05.623285    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:23:05.701072 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:05.701037    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-cc857f-6657889b5-bnnsm"]
Sep 11 13:23:05.701292 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:05.701266    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-cc857f-6657889b5-bnnsm" podUID="a6b690de-8359-4cd7-8ffc-f8d2944b7aea" containerName="payload-processing" containerID="cri-o://68257e58c99fa7f89348dcc6729a05abcafecc3393b4b594218dc2a427f7cd49" gracePeriod=30
Sep 11 13:23:05.720026 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:05.720003    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-cc857f-5bfb7c8658-jkh9g"]
Sep 11 13:23:05.720216 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:05.720197    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cc857f-5bfb7c8658-jkh9g" podUID="124d1df7-8f83-4667-9767-c51be163539f" containerName="payload-pre-processing" containerID="cri-o://f62cea29cecf5223d6ba80191671f9a59e40648ef3e4a8ac0e74f8e54d4fa4f7" gracePeriod=30
Sep 11 13:23:05.914450 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:05.914413    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:23:06.006938 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.006914    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-cc857f-6657889b5-bnnsm"
Sep 11 13:23:06.009772 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.009753    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cc857f-5bfb7c8658-jkh9g"
Sep 11 13:23:06.066575 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.066538    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:23:06.131386 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.131360    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/124d1df7-8f83-4667-9767-c51be163539f-plugins-config-volume\") pod \"124d1df7-8f83-4667-9767-c51be163539f\" (UID: \"124d1df7-8f83-4667-9767-c51be163539f\") "
Sep 11 13:23:06.131553 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.131415    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62bcn\" (UniqueName: \"kubernetes.io/projected/a6b690de-8359-4cd7-8ffc-f8d2944b7aea-kube-api-access-62bcn\") pod \"a6b690de-8359-4cd7-8ffc-f8d2944b7aea\" (UID: \"a6b690de-8359-4cd7-8ffc-f8d2944b7aea\") "
Sep 11 13:23:06.131553 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.131462    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6b690de-8359-4cd7-8ffc-f8d2944b7aea-plugins-config-volume\") pod \"a6b690de-8359-4cd7-8ffc-f8d2944b7aea\" (UID: \"a6b690de-8359-4cd7-8ffc-f8d2944b7aea\") "
Sep 11 13:23:06.131553 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.131526    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghmhv\" (UniqueName: \"kubernetes.io/projected/124d1df7-8f83-4667-9767-c51be163539f-kube-api-access-ghmhv\") pod \"124d1df7-8f83-4667-9767-c51be163539f\" (UID: \"124d1df7-8f83-4667-9767-c51be163539f\") "
Sep 11 13:23:06.131852 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.131819    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6b690de-8359-4cd7-8ffc-f8d2944b7aea-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a6b690de-8359-4cd7-8ffc-f8d2944b7aea" (UID: "a6b690de-8359-4cd7-8ffc-f8d2944b7aea"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:23:06.131852 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.131830    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/124d1df7-8f83-4667-9767-c51be163539f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "124d1df7-8f83-4667-9767-c51be163539f" (UID: "124d1df7-8f83-4667-9767-c51be163539f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:23:06.132034 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.131958    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/124d1df7-8f83-4667-9767-c51be163539f-plugins-config-volume\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:23:06.132034 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.131975    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6b690de-8359-4cd7-8ffc-f8d2944b7aea-plugins-config-volume\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:23:06.133810 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.133755    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6b690de-8359-4cd7-8ffc-f8d2944b7aea-kube-api-access-62bcn" (OuterVolumeSpecName: "kube-api-access-62bcn") pod "a6b690de-8359-4cd7-8ffc-f8d2944b7aea" (UID: "a6b690de-8359-4cd7-8ffc-f8d2944b7aea"). InnerVolumeSpecName "kube-api-access-62bcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:23:06.133884 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.133807    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/124d1df7-8f83-4667-9767-c51be163539f-kube-api-access-ghmhv" (OuterVolumeSpecName: "kube-api-access-ghmhv") pod "124d1df7-8f83-4667-9767-c51be163539f" (UID: "124d1df7-8f83-4667-9767-c51be163539f"). InnerVolumeSpecName "kube-api-access-ghmhv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:23:06.135240 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.135219    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:23:06.233131 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.233101    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghmhv\" (UniqueName: \"kubernetes.io/projected/124d1df7-8f83-4667-9767-c51be163539f-kube-api-access-ghmhv\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:23:06.233131 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.233129    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62bcn\" (UniqueName: \"kubernetes.io/projected/a6b690de-8359-4cd7-8ffc-f8d2944b7aea-kube-api-access-62bcn\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:23:06.307166 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.307130    2547 generic.go:356] "Generic (PLEG): container finished" podID="a6b690de-8359-4cd7-8ffc-f8d2944b7aea" containerID="68257e58c99fa7f89348dcc6729a05abcafecc3393b4b594218dc2a427f7cd49" exitCode=0
Sep 11 13:23:06.307376 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.307196    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-cc857f-6657889b5-bnnsm"
Sep 11 13:23:06.307376 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.307221    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-cc857f-6657889b5-bnnsm" event={"ID":"a6b690de-8359-4cd7-8ffc-f8d2944b7aea","Type":"ContainerDied","Data":"68257e58c99fa7f89348dcc6729a05abcafecc3393b4b594218dc2a427f7cd49"}
Sep 11 13:23:06.307376 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.307285    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-cc857f-6657889b5-bnnsm" event={"ID":"a6b690de-8359-4cd7-8ffc-f8d2944b7aea","Type":"ContainerDied","Data":"3d6f9710b0ae93baac248986223a97dcd68e1d73781bb9abd91f4879a0bacbb2"}
Sep 11 13:23:06.307376 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.307316    2547 scope.go:117] "RemoveContainer" containerID="68257e58c99fa7f89348dcc6729a05abcafecc3393b4b594218dc2a427f7cd49"
Sep 11 13:23:06.308824 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.308802    2547 generic.go:356] "Generic (PLEG): container finished" podID="124d1df7-8f83-4667-9767-c51be163539f" containerID="f62cea29cecf5223d6ba80191671f9a59e40648ef3e4a8ac0e74f8e54d4fa4f7" exitCode=0
Sep 11 13:23:06.308896 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.308864    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cc857f-5bfb7c8658-jkh9g" event={"ID":"124d1df7-8f83-4667-9767-c51be163539f","Type":"ContainerDied","Data":"f62cea29cecf5223d6ba80191671f9a59e40648ef3e4a8ac0e74f8e54d4fa4f7"}
Sep 11 13:23:06.308943 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.308898    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cc857f-5bfb7c8658-jkh9g"
Sep 11 13:23:06.309222 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.308904    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cc857f-5bfb7c8658-jkh9g" event={"ID":"124d1df7-8f83-4667-9767-c51be163539f","Type":"ContainerDied","Data":"2ee8d18e6c14bfbc6e99a2816e32f3ae05da739874bdba80645b1d26e3fb0818"}
Sep 11 13:23:06.322886 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.321599    2547 scope.go:117] "RemoveContainer" containerID="68257e58c99fa7f89348dcc6729a05abcafecc3393b4b594218dc2a427f7cd49"
Sep 11 13:23:06.322886 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:23:06.322751    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68257e58c99fa7f89348dcc6729a05abcafecc3393b4b594218dc2a427f7cd49\": container with ID starting with 68257e58c99fa7f89348dcc6729a05abcafecc3393b4b594218dc2a427f7cd49 not found: ID does not exist" containerID="68257e58c99fa7f89348dcc6729a05abcafecc3393b4b594218dc2a427f7cd49"
Sep 11 13:23:06.322886 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.322819    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68257e58c99fa7f89348dcc6729a05abcafecc3393b4b594218dc2a427f7cd49"} err="failed to get container status \"68257e58c99fa7f89348dcc6729a05abcafecc3393b4b594218dc2a427f7cd49\": rpc error: code = NotFound desc = could not find container \"68257e58c99fa7f89348dcc6729a05abcafecc3393b4b594218dc2a427f7cd49\": container with ID starting with 68257e58c99fa7f89348dcc6729a05abcafecc3393b4b594218dc2a427f7cd49 not found: ID does not exist"
Sep 11 13:23:06.322886 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.322844    2547 scope.go:117] "RemoveContainer" containerID="f62cea29cecf5223d6ba80191671f9a59e40648ef3e4a8ac0e74f8e54d4fa4f7"
Sep 11 13:23:06.332875 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.332855    2547 scope.go:117] "RemoveContainer" containerID="f62cea29cecf5223d6ba80191671f9a59e40648ef3e4a8ac0e74f8e54d4fa4f7"
Sep 11 13:23:06.333155 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:23:06.333136    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f62cea29cecf5223d6ba80191671f9a59e40648ef3e4a8ac0e74f8e54d4fa4f7\": container with ID starting with f62cea29cecf5223d6ba80191671f9a59e40648ef3e4a8ac0e74f8e54d4fa4f7 not found: ID does not exist" containerID="f62cea29cecf5223d6ba80191671f9a59e40648ef3e4a8ac0e74f8e54d4fa4f7"
Sep 11 13:23:06.333206 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.333163    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f62cea29cecf5223d6ba80191671f9a59e40648ef3e4a8ac0e74f8e54d4fa4f7"} err="failed to get container status \"f62cea29cecf5223d6ba80191671f9a59e40648ef3e4a8ac0e74f8e54d4fa4f7\": rpc error: code = NotFound desc = could not find container \"f62cea29cecf5223d6ba80191671f9a59e40648ef3e4a8ac0e74f8e54d4fa4f7\": container with ID starting with f62cea29cecf5223d6ba80191671f9a59e40648ef3e4a8ac0e74f8e54d4fa4f7 not found: ID does not exist"
Sep 11 13:23:06.347111 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.347080    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-cc857f-6657889b5-bnnsm"]
Sep 11 13:23:06.350508 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.350482    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-cc857f-6657889b5-bnnsm"]
Sep 11 13:23:06.362626 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.362600    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-cc857f-5bfb7c8658-jkh9g"]
Sep 11 13:23:06.370290 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.370264    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-cc857f-5bfb7c8658-jkh9g"]
Sep 11 13:23:06.486311 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.486219    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:23:06.584593 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:06.584556    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:23:07.457303 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:07.457264    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:23:07.664418 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:07.664390    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="124d1df7-8f83-4667-9767-c51be163539f" path="/var/lib/kubelet/pods/124d1df7-8f83-4667-9767-c51be163539f/volumes"
Sep 11 13:23:07.664776 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:07.664763    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6b690de-8359-4cd7-8ffc-f8d2944b7aea" path="/var/lib/kubelet/pods/a6b690de-8359-4cd7-8ffc-f8d2944b7aea/volumes"
Sep 11 13:23:08.522535 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:08.522497    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:23:09.427949 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:09.427911    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:23:11.556786 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:11.556740    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:23:36.741052 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:36.741015    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:23:41.756193 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:41.756142    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:23:48.684891 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:48.684850    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:23:48.841815 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:48.841774    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:23:51.951250 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:51.951212    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:23:54.840806 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:23:54.840694    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:01.058614 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:01.058580    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:01.177274 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:01.177237    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:01.415935 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:01.415834    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:02.051219 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:02.051177    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:02.951503 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:02.951463    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:03.675838 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:03.675802    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:04.520796 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:04.520761    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:05.473333 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:05.473294    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:12.707560 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:12.707517    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:12.748592 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:12.748547    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c"]
Sep 11 13:24:12.748842 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:12.748813    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c" podUID="5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7" containerName="payload-processing" containerID="cri-o://1aaccdb7b551346fd9f8d876fd27095a78f3f0128156cbb36ca1b324bc42e75d" gracePeriod=30
Sep 11 13:24:12.755234 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:12.755210    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-e3f42f-6bd4776758-ljsm9"]
Sep 11 13:24:12.755461 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:12.755429    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e3f42f-6bd4776758-ljsm9" podUID="5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5" containerName="payload-pre-processing" containerID="cri-o://482dc9d2e704d3018a8f65c2c2ffee28b8e4fb724b006cee16c44224c1ec00b6" gracePeriod=30
Sep 11 13:24:12.795216 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:12.795182    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:12.889657 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:12.889613    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:12.954470 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:12.954425    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:13.029850 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.029824    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c"
Sep 11 13:24:13.036691 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.036673    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e3f42f-6bd4776758-ljsm9"
Sep 11 13:24:13.080331 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.080297    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5zh2\" (UniqueName: \"kubernetes.io/projected/5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5-kube-api-access-m5zh2\") pod \"5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5\" (UID: \"5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5\") "
Sep 11 13:24:13.080493 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.080404    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5-plugins-config-volume\") pod \"5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5\" (UID: \"5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5\") "
Sep 11 13:24:13.080493 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.080441    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7-plugins-config-volume\") pod \"5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7\" (UID: \"5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7\") "
Sep 11 13:24:13.080623 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.080522    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sttjd\" (UniqueName: \"kubernetes.io/projected/5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7-kube-api-access-sttjd\") pod \"5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7\" (UID: \"5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7\") "
Sep 11 13:24:13.081104 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.081054    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7" (UID: "5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:24:13.081104 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.081059    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5" (UID: "5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:24:13.083689 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.083656    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5-kube-api-access-m5zh2" (OuterVolumeSpecName: "kube-api-access-m5zh2") pod "5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5" (UID: "5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5"). InnerVolumeSpecName "kube-api-access-m5zh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:24:13.083970 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.083940    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7-kube-api-access-sttjd" (OuterVolumeSpecName: "kube-api-access-sttjd") pod "5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7" (UID: "5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7"). InnerVolumeSpecName "kube-api-access-sttjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:24:13.181368 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.181331    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5-plugins-config-volume\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:24:13.181368 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.181365    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7-plugins-config-volume\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:24:13.181368 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.181377    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sttjd\" (UniqueName: \"kubernetes.io/projected/5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7-kube-api-access-sttjd\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:24:13.181613 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.181389    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5zh2\" (UniqueName: \"kubernetes.io/projected/5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5-kube-api-access-m5zh2\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:24:13.331246 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.331198    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:13.441374 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.441339    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:13.722307 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.722276    2547 generic.go:356] "Generic (PLEG): container finished" podID="5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5" containerID="482dc9d2e704d3018a8f65c2c2ffee28b8e4fb724b006cee16c44224c1ec00b6" exitCode=0
Sep 11 13:24:13.722761 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.722333    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e3f42f-6bd4776758-ljsm9"
Sep 11 13:24:13.722761 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.722371    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e3f42f-6bd4776758-ljsm9" event={"ID":"5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5","Type":"ContainerDied","Data":"482dc9d2e704d3018a8f65c2c2ffee28b8e4fb724b006cee16c44224c1ec00b6"}
Sep 11 13:24:13.722761 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.722438    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e3f42f-6bd4776758-ljsm9" event={"ID":"5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5","Type":"ContainerDied","Data":"380aa52b67546e387eaffb3e42d319645c4a8353b1ffa342cfaf588a32f62749"}
Sep 11 13:24:13.722761 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.722459    2547 scope.go:117] "RemoveContainer" containerID="482dc9d2e704d3018a8f65c2c2ffee28b8e4fb724b006cee16c44224c1ec00b6"
Sep 11 13:24:13.723935 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.723909    2547 generic.go:356] "Generic (PLEG): container finished" podID="5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7" containerID="1aaccdb7b551346fd9f8d876fd27095a78f3f0128156cbb36ca1b324bc42e75d" exitCode=0
Sep 11 13:24:13.724078 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.723964    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c"
Sep 11 13:24:13.724078 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.723963    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c" event={"ID":"5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7","Type":"ContainerDied","Data":"1aaccdb7b551346fd9f8d876fd27095a78f3f0128156cbb36ca1b324bc42e75d"}
Sep 11 13:24:13.724401 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.724090    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c" event={"ID":"5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7","Type":"ContainerDied","Data":"f4a78950f082b5902bbe14eec4026e2d80170b212d39ad0759f6fb776f8ad677"}
Sep 11 13:24:13.732442 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.732422    2547 scope.go:117] "RemoveContainer" containerID="482dc9d2e704d3018a8f65c2c2ffee28b8e4fb724b006cee16c44224c1ec00b6"
Sep 11 13:24:13.732741 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:24:13.732701    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"482dc9d2e704d3018a8f65c2c2ffee28b8e4fb724b006cee16c44224c1ec00b6\": container with ID starting with 482dc9d2e704d3018a8f65c2c2ffee28b8e4fb724b006cee16c44224c1ec00b6 not found: ID does not exist" containerID="482dc9d2e704d3018a8f65c2c2ffee28b8e4fb724b006cee16c44224c1ec00b6"
Sep 11 13:24:13.732842 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.732747    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"482dc9d2e704d3018a8f65c2c2ffee28b8e4fb724b006cee16c44224c1ec00b6"} err="failed to get container status \"482dc9d2e704d3018a8f65c2c2ffee28b8e4fb724b006cee16c44224c1ec00b6\": rpc error: code = NotFound desc = could not find container \"482dc9d2e704d3018a8f65c2c2ffee28b8e4fb724b006cee16c44224c1ec00b6\": container with ID starting with 482dc9d2e704d3018a8f65c2c2ffee28b8e4fb724b006cee16c44224c1ec00b6 not found: ID does not exist"
Sep 11 13:24:13.732842 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.732764    2547 scope.go:117] "RemoveContainer" containerID="1aaccdb7b551346fd9f8d876fd27095a78f3f0128156cbb36ca1b324bc42e75d"
Sep 11 13:24:13.741895 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.741876    2547 scope.go:117] "RemoveContainer" containerID="1aaccdb7b551346fd9f8d876fd27095a78f3f0128156cbb36ca1b324bc42e75d"
Sep 11 13:24:13.742217 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:24:13.742194    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1aaccdb7b551346fd9f8d876fd27095a78f3f0128156cbb36ca1b324bc42e75d\": container with ID starting with 1aaccdb7b551346fd9f8d876fd27095a78f3f0128156cbb36ca1b324bc42e75d not found: ID does not exist" containerID="1aaccdb7b551346fd9f8d876fd27095a78f3f0128156cbb36ca1b324bc42e75d"
Sep 11 13:24:13.742306 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.742228    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1aaccdb7b551346fd9f8d876fd27095a78f3f0128156cbb36ca1b324bc42e75d"} err="failed to get container status \"1aaccdb7b551346fd9f8d876fd27095a78f3f0128156cbb36ca1b324bc42e75d\": rpc error: code = NotFound desc = could not find container \"1aaccdb7b551346fd9f8d876fd27095a78f3f0128156cbb36ca1b324bc42e75d\": container with ID starting with 1aaccdb7b551346fd9f8d876fd27095a78f3f0128156cbb36ca1b324bc42e75d not found: ID does not exist"
Sep 11 13:24:13.743435 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.743416    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-e3f42f-6bd4776758-ljsm9"]
Sep 11 13:24:13.749959 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.749939    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-e3f42f-6bd4776758-ljsm9"]
Sep 11 13:24:13.761096 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.761076    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c"]
Sep 11 13:24:13.765379 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:13.765358    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-e3f42f-7d5d5998f9-fqt9c"]
Sep 11 13:24:14.076910 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:14.076870    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:15.043158 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:15.043116    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:15.663671 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:15.663629    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5" path="/var/lib/kubelet/pods/5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5/volumes"
Sep 11 13:24:15.664115 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:15.664095    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7" path="/var/lib/kubelet/pods/5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7/volumes"
Sep 11 13:24:19.454651 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:19.454611    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:19.547343 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:19.547295    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:19.708979 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:19.708885    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"]
Sep 11 13:24:19.709161 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:19.709137    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr" podUID="2fd5d717-e12d-4383-a0e7-4d0083b307c9" containerName="istio-proxy" containerID="cri-o://d96f922cd205ccddee5c42a87a985e3a9ab5cfb1035018706734a7cf049a97fc" gracePeriod=30
Sep 11 13:24:19.757677 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:19.757641    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:20.377556 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:20.377514    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:21.189068 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:21.189034    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:21.484462 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:21.484375    2547 patch_prober.go:28] interesting pod/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 13:24:21.484645 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:21.484449    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr" podUID="2fd5d717-e12d-4383-a0e7-4d0083b307c9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 13:24:22.103275 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:22.103219    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:22.882421 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:22.882389    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:24.958593 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:24.958568    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:24:25.095033 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.095001    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fd5d717-e12d-4383-a0e7-4d0083b307c9-istiod-ca-cert\") pod \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") "
Sep 11 13:24:25.095247 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.095054    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fd5d717-e12d-4383-a0e7-4d0083b307c9-istio-data\") pod \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") "
Sep 11 13:24:25.095247 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.095167    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fd5d717-e12d-4383-a0e7-4d0083b307c9-istio-envoy\") pod \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") "
Sep 11 13:24:25.095247 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.095232    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fd5d717-e12d-4383-a0e7-4d0083b307c9-workload-socket\") pod \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") "
Sep 11 13:24:25.095482 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.095270    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fd5d717-e12d-4383-a0e7-4d0083b307c9-istio-token\") pod \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") "
Sep 11 13:24:25.095482 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.095300    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fd5d717-e12d-4383-a0e7-4d0083b307c9-istio-podinfo\") pod \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") "
Sep 11 13:24:25.095482 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.095327    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfvnk\" (UniqueName: \"kubernetes.io/projected/2fd5d717-e12d-4383-a0e7-4d0083b307c9-kube-api-access-hfvnk\") pod \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") "
Sep 11 13:24:25.095482 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.095389    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fd5d717-e12d-4383-a0e7-4d0083b307c9-istio-data" (OuterVolumeSpecName: "istio-data") pod "2fd5d717-e12d-4383-a0e7-4d0083b307c9" (UID: "2fd5d717-e12d-4383-a0e7-4d0083b307c9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:24:25.095482 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.095436    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fd5d717-e12d-4383-a0e7-4d0083b307c9-credential-socket\") pod \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") "
Sep 11 13:24:25.095777 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.095518    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fd5d717-e12d-4383-a0e7-4d0083b307c9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2fd5d717-e12d-4383-a0e7-4d0083b307c9" (UID: "2fd5d717-e12d-4383-a0e7-4d0083b307c9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:24:25.095777 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.095545    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fd5d717-e12d-4383-a0e7-4d0083b307c9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2fd5d717-e12d-4383-a0e7-4d0083b307c9" (UID: "2fd5d717-e12d-4383-a0e7-4d0083b307c9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:24:25.095777 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.095590    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fd5d717-e12d-4383-a0e7-4d0083b307c9-workload-certs\") pod \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\" (UID: \"2fd5d717-e12d-4383-a0e7-4d0083b307c9\") "
Sep 11 13:24:25.095920 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.095863    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fd5d717-e12d-4383-a0e7-4d0083b307c9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2fd5d717-e12d-4383-a0e7-4d0083b307c9" (UID: "2fd5d717-e12d-4383-a0e7-4d0083b307c9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:24:25.096009 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.095991    2547 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fd5d717-e12d-4383-a0e7-4d0083b307c9-istiod-ca-cert\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:24:25.096058 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.096021    2547 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fd5d717-e12d-4383-a0e7-4d0083b307c9-istio-data\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:24:25.096142 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.096036    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fd5d717-e12d-4383-a0e7-4d0083b307c9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2fd5d717-e12d-4383-a0e7-4d0083b307c9" (UID: "2fd5d717-e12d-4383-a0e7-4d0083b307c9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:24:25.096210 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.096110    2547 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fd5d717-e12d-4383-a0e7-4d0083b307c9-workload-socket\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:24:25.096210 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.096174    2547 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fd5d717-e12d-4383-a0e7-4d0083b307c9-credential-socket\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:24:25.097563 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.097540    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fd5d717-e12d-4383-a0e7-4d0083b307c9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2fd5d717-e12d-4383-a0e7-4d0083b307c9" (UID: "2fd5d717-e12d-4383-a0e7-4d0083b307c9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:24:25.097670 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.097658    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fd5d717-e12d-4383-a0e7-4d0083b307c9-kube-api-access-hfvnk" (OuterVolumeSpecName: "kube-api-access-hfvnk") pod "2fd5d717-e12d-4383-a0e7-4d0083b307c9" (UID: "2fd5d717-e12d-4383-a0e7-4d0083b307c9"). InnerVolumeSpecName "kube-api-access-hfvnk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:24:25.098160 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.098135    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2fd5d717-e12d-4383-a0e7-4d0083b307c9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2fd5d717-e12d-4383-a0e7-4d0083b307c9" (UID: "2fd5d717-e12d-4383-a0e7-4d0083b307c9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:24:25.098263 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.098160    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fd5d717-e12d-4383-a0e7-4d0083b307c9-istio-token" (OuterVolumeSpecName: "istio-token") pod "2fd5d717-e12d-4383-a0e7-4d0083b307c9" (UID: "2fd5d717-e12d-4383-a0e7-4d0083b307c9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:24:25.197560 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.197524    2547 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fd5d717-e12d-4383-a0e7-4d0083b307c9-istio-envoy\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:24:25.197560 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.197550    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fd5d717-e12d-4383-a0e7-4d0083b307c9-istio-token\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:24:25.197560 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.197559    2547 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fd5d717-e12d-4383-a0e7-4d0083b307c9-istio-podinfo\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:24:25.197560 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.197568    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfvnk\" (UniqueName: \"kubernetes.io/projected/2fd5d717-e12d-4383-a0e7-4d0083b307c9-kube-api-access-hfvnk\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:24:25.197878 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.197577    2547 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fd5d717-e12d-4383-a0e7-4d0083b307c9-workload-certs\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:24:25.799167 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.799135    2547 generic.go:356] "Generic (PLEG): container finished" podID="2fd5d717-e12d-4383-a0e7-4d0083b307c9" containerID="d96f922cd205ccddee5c42a87a985e3a9ab5cfb1035018706734a7cf049a97fc" exitCode=0
Sep 11 13:24:25.799350 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.799189    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"
Sep 11 13:24:25.799350 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.799227    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr" event={"ID":"2fd5d717-e12d-4383-a0e7-4d0083b307c9","Type":"ContainerDied","Data":"d96f922cd205ccddee5c42a87a985e3a9ab5cfb1035018706734a7cf049a97fc"}
Sep 11 13:24:25.799350 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.799292    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr" event={"ID":"2fd5d717-e12d-4383-a0e7-4d0083b307c9","Type":"ContainerDied","Data":"80b46510fc14a6efa02b0795f84790bffea621162d74bdb8c81c36590c3d8efb"}
Sep 11 13:24:25.799350 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.799320    2547 scope.go:117] "RemoveContainer" containerID="d96f922cd205ccddee5c42a87a985e3a9ab5cfb1035018706734a7cf049a97fc"
Sep 11 13:24:25.809315 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.809290    2547 scope.go:117] "RemoveContainer" containerID="14ce10ef3ef95a63c921c2493a09314fc9c80a61c80ac937247c36ba0f2a56ba"
Sep 11 13:24:25.818663 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.818644    2547 scope.go:117] "RemoveContainer" containerID="d96f922cd205ccddee5c42a87a985e3a9ab5cfb1035018706734a7cf049a97fc"
Sep 11 13:24:25.818990 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:24:25.818972    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d96f922cd205ccddee5c42a87a985e3a9ab5cfb1035018706734a7cf049a97fc\": container with ID starting with d96f922cd205ccddee5c42a87a985e3a9ab5cfb1035018706734a7cf049a97fc not found: ID does not exist" containerID="d96f922cd205ccddee5c42a87a985e3a9ab5cfb1035018706734a7cf049a97fc"
Sep 11 13:24:25.819047 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.819006    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d96f922cd205ccddee5c42a87a985e3a9ab5cfb1035018706734a7cf049a97fc"} err="failed to get container status \"d96f922cd205ccddee5c42a87a985e3a9ab5cfb1035018706734a7cf049a97fc\": rpc error: code = NotFound desc = could not find container \"d96f922cd205ccddee5c42a87a985e3a9ab5cfb1035018706734a7cf049a97fc\": container with ID starting with d96f922cd205ccddee5c42a87a985e3a9ab5cfb1035018706734a7cf049a97fc not found: ID does not exist"
Sep 11 13:24:25.819047 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.819024    2547 scope.go:117] "RemoveContainer" containerID="14ce10ef3ef95a63c921c2493a09314fc9c80a61c80ac937247c36ba0f2a56ba"
Sep 11 13:24:25.819274 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:24:25.819255    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14ce10ef3ef95a63c921c2493a09314fc9c80a61c80ac937247c36ba0f2a56ba\": container with ID starting with 14ce10ef3ef95a63c921c2493a09314fc9c80a61c80ac937247c36ba0f2a56ba not found: ID does not exist" containerID="14ce10ef3ef95a63c921c2493a09314fc9c80a61c80ac937247c36ba0f2a56ba"
Sep 11 13:24:25.819321 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.819283    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14ce10ef3ef95a63c921c2493a09314fc9c80a61c80ac937247c36ba0f2a56ba"} err="failed to get container status \"14ce10ef3ef95a63c921c2493a09314fc9c80a61c80ac937247c36ba0f2a56ba\": rpc error: code = NotFound desc = could not find container \"14ce10ef3ef95a63c921c2493a09314fc9c80a61c80ac937247c36ba0f2a56ba\": container with ID starting with 14ce10ef3ef95a63c921c2493a09314fc9c80a61c80ac937247c36ba0f2a56ba not found: ID does not exist"
Sep 11 13:24:25.833856 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.833828    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"]
Sep 11 13:24:25.842173 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:25.842147    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-e3f42f-openshift-default-676c8ff656-nx8gr"]
Sep 11 13:24:27.663831 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:27.663797    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fd5d717-e12d-4383-a0e7-4d0083b307c9" path="/var/lib/kubelet/pods/2fd5d717-e12d-4383-a0e7-4d0083b307c9/volumes"
Sep 11 13:24:30.753299 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:30.753264    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:30.758451 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:30.758419    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1841da-29818875-bjrph"]
Sep 11 13:24:30.762440 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:30.762416    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1841da-29818875-bjrph"]
Sep 11 13:24:30.804724 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:30.804670    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf"]
Sep 11 13:24:30.804913 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:30.804891    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf" podUID="f8e4400f-71aa-462f-a054-7f24fe710d8b" containerName="payload-pre-processing" containerID="cri-o://d318fa3a67f5c4233155c8459241c2ddaa43e7e751b991314b190f110c300d0f" gracePeriod=30
Sep 11 13:24:30.850914 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:30.850885    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:30.957793 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:30.957748    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:31.062624 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:31.062603    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf"
Sep 11 13:24:31.085474 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:31.085436    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:31.156445 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:31.156417    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8e4400f-71aa-462f-a054-7f24fe710d8b-plugins-config-volume\") pod \"f8e4400f-71aa-462f-a054-7f24fe710d8b\" (UID: \"f8e4400f-71aa-462f-a054-7f24fe710d8b\") "
Sep 11 13:24:31.156636 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:31.156517    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ldth\" (UniqueName: \"kubernetes.io/projected/f8e4400f-71aa-462f-a054-7f24fe710d8b-kube-api-access-5ldth\") pod \"f8e4400f-71aa-462f-a054-7f24fe710d8b\" (UID: \"f8e4400f-71aa-462f-a054-7f24fe710d8b\") "
Sep 11 13:24:31.156842 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:31.156816    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8e4400f-71aa-462f-a054-7f24fe710d8b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f8e4400f-71aa-462f-a054-7f24fe710d8b" (UID: "f8e4400f-71aa-462f-a054-7f24fe710d8b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:24:31.158725 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:31.158695    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8e4400f-71aa-462f-a054-7f24fe710d8b-kube-api-access-5ldth" (OuterVolumeSpecName: "kube-api-access-5ldth") pod "f8e4400f-71aa-462f-a054-7f24fe710d8b" (UID: "f8e4400f-71aa-462f-a054-7f24fe710d8b"). InnerVolumeSpecName "kube-api-access-5ldth". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:24:31.257313 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:31.257284    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8e4400f-71aa-462f-a054-7f24fe710d8b-plugins-config-volume\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:24:31.257313 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:31.257310    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ldth\" (UniqueName: \"kubernetes.io/projected/f8e4400f-71aa-462f-a054-7f24fe710d8b-kube-api-access-5ldth\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:24:31.456865 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:31.456823    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:31.573241 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:31.573208    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:31.664085 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:31.664044    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55580b1b-8687-4035-8d6f-55af33bb6720" path="/var/lib/kubelet/pods/55580b1b-8687-4035-8d6f-55af33bb6720/volumes"
Sep 11 13:24:31.839798 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:31.839763    2547 generic.go:356] "Generic (PLEG): container finished" podID="f8e4400f-71aa-462f-a054-7f24fe710d8b" containerID="d318fa3a67f5c4233155c8459241c2ddaa43e7e751b991314b190f110c300d0f" exitCode=0
Sep 11 13:24:31.840208 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:31.839810    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf"
Sep 11 13:24:31.840208 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:31.839851    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf" event={"ID":"f8e4400f-71aa-462f-a054-7f24fe710d8b","Type":"ContainerDied","Data":"d318fa3a67f5c4233155c8459241c2ddaa43e7e751b991314b190f110c300d0f"}
Sep 11 13:24:31.840208 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:31.839910    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf" event={"ID":"f8e4400f-71aa-462f-a054-7f24fe710d8b","Type":"ContainerDied","Data":"c998e2c001d5777a2e7c5a5c38c1ec12d0d2ed4b67e7ed328226f84068c489f6"}
Sep 11 13:24:31.840208 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:31.839940    2547 scope.go:117] "RemoveContainer" containerID="d318fa3a67f5c4233155c8459241c2ddaa43e7e751b991314b190f110c300d0f"
Sep 11 13:24:31.849544 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:31.849526    2547 scope.go:117] "RemoveContainer" containerID="d318fa3a67f5c4233155c8459241c2ddaa43e7e751b991314b190f110c300d0f"
Sep 11 13:24:31.849851 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:24:31.849825    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d318fa3a67f5c4233155c8459241c2ddaa43e7e751b991314b190f110c300d0f\": container with ID starting with d318fa3a67f5c4233155c8459241c2ddaa43e7e751b991314b190f110c300d0f not found: ID does not exist" containerID="d318fa3a67f5c4233155c8459241c2ddaa43e7e751b991314b190f110c300d0f"
Sep 11 13:24:31.849917 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:31.849854    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d318fa3a67f5c4233155c8459241c2ddaa43e7e751b991314b190f110c300d0f"} err="failed to get container status \"d318fa3a67f5c4233155c8459241c2ddaa43e7e751b991314b190f110c300d0f\": rpc error: code = NotFound desc = could not find container \"d318fa3a67f5c4233155c8459241c2ddaa43e7e751b991314b190f110c300d0f\": container with ID starting with d318fa3a67f5c4233155c8459241c2ddaa43e7e751b991314b190f110c300d0f not found: ID does not exist"
Sep 11 13:24:31.860323 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:31.860299    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf"]
Sep 11 13:24:31.864913 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:31.864890    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1841da-85477fb566-9cvqf"]
Sep 11 13:24:32.406443 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:32.406396    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:33.664798 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:33.664765    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8e4400f-71aa-462f-a054-7f24fe710d8b" path="/var/lib/kubelet/pods/f8e4400f-71aa-462f-a054-7f24fe710d8b/volumes"
Sep 11 13:24:34.111909 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:34.111878    2547 scope.go:117] "RemoveContainer" containerID="d763d182b79d511ed980d733a679e6dcb9090511ca495d6bd8ce231b5e8a80c2"
Sep 11 13:24:38.111883 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:38.111836    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:38.249359 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:38.249326    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:38.396303 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:38.396215    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"]
Sep 11 13:24:38.396448 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:38.396430    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm" podUID="2bc48f20-9192-477b-b5f7-24cf7b942b18" containerName="istio-proxy" containerID="cri-o://fe48c98f0c1bc31335ae73f9e1825656a3073efb819710b55450250f40f47785" gracePeriod=30
Sep 11 13:24:38.416326 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:38.416289    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:39.952502 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:39.952452    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:40.859892 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:40.859855    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:43.649310 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.649283    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:24:43.669943 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.669883    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7mrr\" (UniqueName: \"kubernetes.io/projected/2bc48f20-9192-477b-b5f7-24cf7b942b18-kube-api-access-f7mrr\") pod \"2bc48f20-9192-477b-b5f7-24cf7b942b18\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") "
Sep 11 13:24:43.670081 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.669945    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bc48f20-9192-477b-b5f7-24cf7b942b18-istio-envoy\") pod \"2bc48f20-9192-477b-b5f7-24cf7b942b18\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") "
Sep 11 13:24:43.670081 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.669972    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bc48f20-9192-477b-b5f7-24cf7b942b18-istio-data\") pod \"2bc48f20-9192-477b-b5f7-24cf7b942b18\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") "
Sep 11 13:24:43.670081 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.669987    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bc48f20-9192-477b-b5f7-24cf7b942b18-workload-socket\") pod \"2bc48f20-9192-477b-b5f7-24cf7b942b18\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") "
Sep 11 13:24:43.670081 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.670007    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bc48f20-9192-477b-b5f7-24cf7b942b18-istio-token\") pod \"2bc48f20-9192-477b-b5f7-24cf7b942b18\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") "
Sep 11 13:24:43.670081 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.670026    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bc48f20-9192-477b-b5f7-24cf7b942b18-workload-certs\") pod \"2bc48f20-9192-477b-b5f7-24cf7b942b18\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") "
Sep 11 13:24:43.670081 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.670067    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bc48f20-9192-477b-b5f7-24cf7b942b18-istiod-ca-cert\") pod \"2bc48f20-9192-477b-b5f7-24cf7b942b18\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") "
Sep 11 13:24:43.670373 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.670096    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bc48f20-9192-477b-b5f7-24cf7b942b18-istio-podinfo\") pod \"2bc48f20-9192-477b-b5f7-24cf7b942b18\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") "
Sep 11 13:24:43.670373 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.670126    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bc48f20-9192-477b-b5f7-24cf7b942b18-credential-socket\") pod \"2bc48f20-9192-477b-b5f7-24cf7b942b18\" (UID: \"2bc48f20-9192-477b-b5f7-24cf7b942b18\") "
Sep 11 13:24:43.670373 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.670273    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bc48f20-9192-477b-b5f7-24cf7b942b18-istio-data" (OuterVolumeSpecName: "istio-data") pod "2bc48f20-9192-477b-b5f7-24cf7b942b18" (UID: "2bc48f20-9192-477b-b5f7-24cf7b942b18"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:24:43.670373 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.670357    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bc48f20-9192-477b-b5f7-24cf7b942b18-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2bc48f20-9192-477b-b5f7-24cf7b942b18" (UID: "2bc48f20-9192-477b-b5f7-24cf7b942b18"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:24:43.670635 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.670410    2547 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bc48f20-9192-477b-b5f7-24cf7b942b18-istio-data\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:24:43.670635 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.670547    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bc48f20-9192-477b-b5f7-24cf7b942b18-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2bc48f20-9192-477b-b5f7-24cf7b942b18" (UID: "2bc48f20-9192-477b-b5f7-24cf7b942b18"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:24:43.670635 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.670589    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bc48f20-9192-477b-b5f7-24cf7b942b18-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2bc48f20-9192-477b-b5f7-24cf7b942b18" (UID: "2bc48f20-9192-477b-b5f7-24cf7b942b18"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:24:43.670789 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.670628    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bc48f20-9192-477b-b5f7-24cf7b942b18-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2bc48f20-9192-477b-b5f7-24cf7b942b18" (UID: "2bc48f20-9192-477b-b5f7-24cf7b942b18"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:24:43.672737 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.672656    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bc48f20-9192-477b-b5f7-24cf7b942b18-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2bc48f20-9192-477b-b5f7-24cf7b942b18" (UID: "2bc48f20-9192-477b-b5f7-24cf7b942b18"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:24:43.673142 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.673109    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2bc48f20-9192-477b-b5f7-24cf7b942b18-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2bc48f20-9192-477b-b5f7-24cf7b942b18" (UID: "2bc48f20-9192-477b-b5f7-24cf7b942b18"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:24:43.673364 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.673339    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bc48f20-9192-477b-b5f7-24cf7b942b18-kube-api-access-f7mrr" (OuterVolumeSpecName: "kube-api-access-f7mrr") pod "2bc48f20-9192-477b-b5f7-24cf7b942b18" (UID: "2bc48f20-9192-477b-b5f7-24cf7b942b18"). InnerVolumeSpecName "kube-api-access-f7mrr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:24:43.673364 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.673355    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bc48f20-9192-477b-b5f7-24cf7b942b18-istio-token" (OuterVolumeSpecName: "istio-token") pod "2bc48f20-9192-477b-b5f7-24cf7b942b18" (UID: "2bc48f20-9192-477b-b5f7-24cf7b942b18"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:24:43.771156 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.771120    2547 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bc48f20-9192-477b-b5f7-24cf7b942b18-istiod-ca-cert\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:24:43.771156 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.771150    2547 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bc48f20-9192-477b-b5f7-24cf7b942b18-istio-podinfo\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:24:43.771156 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.771162    2547 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bc48f20-9192-477b-b5f7-24cf7b942b18-credential-socket\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:24:43.771407 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.771175    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7mrr\" (UniqueName: \"kubernetes.io/projected/2bc48f20-9192-477b-b5f7-24cf7b942b18-kube-api-access-f7mrr\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:24:43.771407 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.771188    2547 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bc48f20-9192-477b-b5f7-24cf7b942b18-istio-envoy\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:24:43.771407 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.771200    2547 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bc48f20-9192-477b-b5f7-24cf7b942b18-workload-socket\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:24:43.771407 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.771210    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bc48f20-9192-477b-b5f7-24cf7b942b18-istio-token\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:24:43.771407 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.771222    2547 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bc48f20-9192-477b-b5f7-24cf7b942b18-workload-certs\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:24:43.915101 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.915065    2547 generic.go:356] "Generic (PLEG): container finished" podID="2bc48f20-9192-477b-b5f7-24cf7b942b18" containerID="fe48c98f0c1bc31335ae73f9e1825656a3073efb819710b55450250f40f47785" exitCode=0
Sep 11 13:24:43.915266 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.915108    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"
Sep 11 13:24:43.915266 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.915148    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm" event={"ID":"2bc48f20-9192-477b-b5f7-24cf7b942b18","Type":"ContainerDied","Data":"fe48c98f0c1bc31335ae73f9e1825656a3073efb819710b55450250f40f47785"}
Sep 11 13:24:43.915266 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.915210    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm" event={"ID":"2bc48f20-9192-477b-b5f7-24cf7b942b18","Type":"ContainerDied","Data":"86ac48a3f8beb66dae3e5ffbdc10e5d53fd40f1897bdb0e7abc341cac82ee967"}
Sep 11 13:24:43.915266 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.915238    2547 scope.go:117] "RemoveContainer" containerID="fe48c98f0c1bc31335ae73f9e1825656a3073efb819710b55450250f40f47785"
Sep 11 13:24:43.925525 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.925505    2547 scope.go:117] "RemoveContainer" containerID="9a9b7c1848f280cc870f65861dc6a00431b34664f51b9decd9135058acf5c4e5"
Sep 11 13:24:43.935255 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.934821    2547 scope.go:117] "RemoveContainer" containerID="fe48c98f0c1bc31335ae73f9e1825656a3073efb819710b55450250f40f47785"
Sep 11 13:24:43.935502 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:24:43.935474    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe48c98f0c1bc31335ae73f9e1825656a3073efb819710b55450250f40f47785\": container with ID starting with fe48c98f0c1bc31335ae73f9e1825656a3073efb819710b55450250f40f47785 not found: ID does not exist" containerID="fe48c98f0c1bc31335ae73f9e1825656a3073efb819710b55450250f40f47785"
Sep 11 13:24:43.935603 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.935512    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe48c98f0c1bc31335ae73f9e1825656a3073efb819710b55450250f40f47785"} err="failed to get container status \"fe48c98f0c1bc31335ae73f9e1825656a3073efb819710b55450250f40f47785\": rpc error: code = NotFound desc = could not find container \"fe48c98f0c1bc31335ae73f9e1825656a3073efb819710b55450250f40f47785\": container with ID starting with fe48c98f0c1bc31335ae73f9e1825656a3073efb819710b55450250f40f47785 not found: ID does not exist"
Sep 11 13:24:43.935603 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.935536    2547 scope.go:117] "RemoveContainer" containerID="9a9b7c1848f280cc870f65861dc6a00431b34664f51b9decd9135058acf5c4e5"
Sep 11 13:24:43.935884 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:24:43.935864    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a9b7c1848f280cc870f65861dc6a00431b34664f51b9decd9135058acf5c4e5\": container with ID starting with 9a9b7c1848f280cc870f65861dc6a00431b34664f51b9decd9135058acf5c4e5 not found: ID does not exist" containerID="9a9b7c1848f280cc870f65861dc6a00431b34664f51b9decd9135058acf5c4e5"
Sep 11 13:24:43.935965 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.935890    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a9b7c1848f280cc870f65861dc6a00431b34664f51b9decd9135058acf5c4e5"} err="failed to get container status \"9a9b7c1848f280cc870f65861dc6a00431b34664f51b9decd9135058acf5c4e5\": rpc error: code = NotFound desc = could not find container \"9a9b7c1848f280cc870f65861dc6a00431b34664f51b9decd9135058acf5c4e5\": container with ID starting with 9a9b7c1848f280cc870f65861dc6a00431b34664f51b9decd9135058acf5c4e5 not found: ID does not exist"
Sep 11 13:24:43.937438 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.937420    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"]
Sep 11 13:24:43.944450 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:43.944431    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1841da-openshift-default-8978d78b6-qwtvm"]
Sep 11 13:24:45.663319 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:45.663278    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bc48f20-9192-477b-b5f7-24cf7b942b18" path="/var/lib/kubelet/pods/2bc48f20-9192-477b-b5f7-24cf7b942b18/volumes"
Sep 11 13:24:49.479382 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:49.479343    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-82825f-29818875-c8vgh"]
Sep 11 13:24:49.482072 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:49.482042    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:49.492782 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:49.492756    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-82825f-29818875-c8vgh"]
Sep 11 13:24:49.581101 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:49.581068    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:49.663907 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:49.663872    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d827145-131a-4881-950f-58b7b1ba769d" path="/var/lib/kubelet/pods/4d827145-131a-4881-950f-58b7b1ba769d/volumes"
Sep 11 13:24:49.676503 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:49.676470    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:49.763457 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:49.763372    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:49.829869 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:49.829820    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:50.161654 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:50.161628    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:50.266485 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:50.266442    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:56.699512 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:56.699476    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:56.801506 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:56.801468    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:57.014382 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:57.014292    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"]
Sep 11 13:24:57.014599 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:57.014560    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds" podUID="d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49" containerName="istio-proxy" containerID="cri-o://e1efc2e08df56a3d0dc2d72968389dcd4eafdde666e29a1b11f89765fa773dd7" gracePeriod=30
Sep 11 13:24:57.053305 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:24:57.053268    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:25:00.520560 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:00.520518    2547 patch_prober.go:28] interesting pod/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 13:25:00.520937 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:00.520603    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds" podUID="d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 13:25:02.256374 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:02.256347    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:25:02.334303 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:02.334254    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-istio-podinfo\") pod \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") "
Sep 11 13:25:02.334303 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:02.334309    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-istio-token\") pod \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") "
Sep 11 13:25:02.334574 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:02.334337    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-workload-certs\") pod \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") "
Sep 11 13:25:02.334574 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:02.334356    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-istiod-ca-cert\") pod \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") "
Sep 11 13:25:02.334574 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:02.334391    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-istio-data\") pod \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") "
Sep 11 13:25:02.334574 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:02.334448    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-credential-socket\") pod \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") "
Sep 11 13:25:02.334574 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:02.334491    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-istio-envoy\") pod \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") "
Sep 11 13:25:02.334574 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:02.334516    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-workload-socket\") pod \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") "
Sep 11 13:25:02.334574 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:02.334555    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5gx2\" (UniqueName: \"kubernetes.io/projected/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-kube-api-access-c5gx2\") pod \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\" (UID: \"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49\") "
Sep 11 13:25:02.334981 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:02.334687    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-istio-data" (OuterVolumeSpecName: "istio-data") pod "d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49" (UID: "d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:25:02.334981 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:02.334704    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49" (UID: "d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:25:02.334981 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:02.334776    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49" (UID: "d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:25:02.334981 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:02.334945    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49" (UID: "d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:25:02.334981 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:02.334947    2547 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-credential-socket\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:25:02.335407 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:02.334985    2547 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-workload-certs\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:25:02.335407 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:02.335001    2547 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-istio-data\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:25:02.335407 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:02.335095    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49" (UID: "d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:25:02.336764 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:02.336740    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-istio-token" (OuterVolumeSpecName: "istio-token") pod "d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49" (UID: "d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:25:02.336877 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:02.336822    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49" (UID: "d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:25:02.336937 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:02.336867    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-kube-api-access-c5gx2" (OuterVolumeSpecName: "kube-api-access-c5gx2") pod "d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49" (UID: "d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49"). InnerVolumeSpecName "kube-api-access-c5gx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:25:02.337037 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:02.337019    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49" (UID: "d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:25:02.436402 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:02.436368    2547 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-workload-socket\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:25:02.436402 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:02.436396    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5gx2\" (UniqueName: \"kubernetes.io/projected/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-kube-api-access-c5gx2\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:25:02.436604 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:02.436411    2547 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-istio-podinfo\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:25:02.436604 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:02.436423    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-istio-token\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:25:02.436604 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:02.436431    2547 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-istiod-ca-cert\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:25:02.436604 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:02.436438    2547 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49-istio-envoy\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:25:03.022165 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:03.022131    2547 generic.go:356] "Generic (PLEG): container finished" podID="d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49" containerID="e1efc2e08df56a3d0dc2d72968389dcd4eafdde666e29a1b11f89765fa773dd7" exitCode=0
Sep 11 13:25:03.022370 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:03.022188    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds" event={"ID":"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49","Type":"ContainerDied","Data":"e1efc2e08df56a3d0dc2d72968389dcd4eafdde666e29a1b11f89765fa773dd7"}
Sep 11 13:25:03.022370 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:03.022191    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"
Sep 11 13:25:03.022370 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:03.022234    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds" event={"ID":"d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49","Type":"ContainerDied","Data":"326e29df22dea05d3a7a3add7c69dc5d7c24bce5a7299ca7198b02826a226e14"}
Sep 11 13:25:03.022370 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:03.022258    2547 scope.go:117] "RemoveContainer" containerID="e1efc2e08df56a3d0dc2d72968389dcd4eafdde666e29a1b11f89765fa773dd7"
Sep 11 13:25:03.035024 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:03.035001    2547 scope.go:117] "RemoveContainer" containerID="ce51b8a3276c9ddd39cba7833ff813fd2c1cdd79aac37f5591a1e0f094608a7a"
Sep 11 13:25:03.043635 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:03.043614    2547 scope.go:117] "RemoveContainer" containerID="e1efc2e08df56a3d0dc2d72968389dcd4eafdde666e29a1b11f89765fa773dd7"
Sep 11 13:25:03.043913 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:25:03.043892    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1efc2e08df56a3d0dc2d72968389dcd4eafdde666e29a1b11f89765fa773dd7\": container with ID starting with e1efc2e08df56a3d0dc2d72968389dcd4eafdde666e29a1b11f89765fa773dd7 not found: ID does not exist" containerID="e1efc2e08df56a3d0dc2d72968389dcd4eafdde666e29a1b11f89765fa773dd7"
Sep 11 13:25:03.044019 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:03.043920    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1efc2e08df56a3d0dc2d72968389dcd4eafdde666e29a1b11f89765fa773dd7"} err="failed to get container status \"e1efc2e08df56a3d0dc2d72968389dcd4eafdde666e29a1b11f89765fa773dd7\": rpc error: code = NotFound desc = could not find container \"e1efc2e08df56a3d0dc2d72968389dcd4eafdde666e29a1b11f89765fa773dd7\": container with ID starting with e1efc2e08df56a3d0dc2d72968389dcd4eafdde666e29a1b11f89765fa773dd7 not found: ID does not exist"
Sep 11 13:25:03.044019 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:03.043938    2547 scope.go:117] "RemoveContainer" containerID="ce51b8a3276c9ddd39cba7833ff813fd2c1cdd79aac37f5591a1e0f094608a7a"
Sep 11 13:25:03.044276 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:25:03.044252    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce51b8a3276c9ddd39cba7833ff813fd2c1cdd79aac37f5591a1e0f094608a7a\": container with ID starting with ce51b8a3276c9ddd39cba7833ff813fd2c1cdd79aac37f5591a1e0f094608a7a not found: ID does not exist" containerID="ce51b8a3276c9ddd39cba7833ff813fd2c1cdd79aac37f5591a1e0f094608a7a"
Sep 11 13:25:03.044366 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:03.044285    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce51b8a3276c9ddd39cba7833ff813fd2c1cdd79aac37f5591a1e0f094608a7a"} err="failed to get container status \"ce51b8a3276c9ddd39cba7833ff813fd2c1cdd79aac37f5591a1e0f094608a7a\": rpc error: code = NotFound desc = could not find container \"ce51b8a3276c9ddd39cba7833ff813fd2c1cdd79aac37f5591a1e0f094608a7a\": container with ID starting with ce51b8a3276c9ddd39cba7833ff813fd2c1cdd79aac37f5591a1e0f094608a7a not found: ID does not exist"
Sep 11 13:25:03.046982 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:03.046961    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"]
Sep 11 13:25:03.052143 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:03.052122    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-82825f-openshift-default-55b66bd8d-ptqds"]
Sep 11 13:25:03.663656 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:03.663621    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49" path="/var/lib/kubelet/pods/d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49/volumes"
Sep 11 13:25:33.793934 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:33.793902    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-b7gsm_b22738d7-e796-4173-8fb4-80f9208b99dd/console-operator/2.log"
Sep 11 13:25:33.798173 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:33.798147    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-b7gsm_b22738d7-e796-4173-8fb4-80f9208b99dd/console-operator/2.log"
Sep 11 13:25:34.150510 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:25:34.150476    2547 scope.go:117] "RemoveContainer" containerID="f113e6c51f6e492b1100ba2c49fcd8f3d0888c650d92f0f81d18fb9dbaa9fa7c"
Sep 11 13:26:23.643572 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:26:23.643510    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:26:25.164326 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:26:25.164282    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:26:34.179357 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:26:34.179315    2547 scope.go:117] "RemoveContainer" containerID="bda79a041db4ea5bb499055a7e19f6067c8540599f132b0e61ac99411e7cbf0f"
Sep 11 13:26:34.188200 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:26:34.188178    2547 scope.go:117] "RemoveContainer" containerID="48b96e53c8f49b52dbb31fdd906ddf53590a6ee7e3255742f058915bcc9ba075"
Sep 11 13:26:49.456926 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:26:49.456872    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:26:49.566799 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:26:49.566757    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:34.216595 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:27:34.216562    2547 scope.go:117] "RemoveContainer" containerID="9c4b4350ba12d2551cdacff13ae0d4647de2f6aff9cf2e9ad85cba570ce5ec54"
Sep 11 13:27:43.554409 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:27:43.554364    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:50.842041 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:27:50.841995    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:28:00.706409 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:28:00.706371    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:28:00.859988 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:28:00.859953    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:30.305505 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:30.305462    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:53.587564 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.587529    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"]
Sep 11 13:29:53.588062 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.587867    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bc48f20-9192-477b-b5f7-24cf7b942b18" containerName="istio-proxy"
Sep 11 13:29:53.588062 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.587880    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bc48f20-9192-477b-b5f7-24cf7b942b18" containerName="istio-proxy"
Sep 11 13:29:53.588062 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.587888    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8e4400f-71aa-462f-a054-7f24fe710d8b" containerName="payload-pre-processing"
Sep 11 13:29:53.588062 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.587893    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8e4400f-71aa-462f-a054-7f24fe710d8b" containerName="payload-pre-processing"
Sep 11 13:29:53.588062 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.587902    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bc48f20-9192-477b-b5f7-24cf7b942b18" containerName="istio-proxy"
Sep 11 13:29:53.588062 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.587907    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bc48f20-9192-477b-b5f7-24cf7b942b18" containerName="istio-proxy"
Sep 11 13:29:53.588062 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.587919    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="124d1df7-8f83-4667-9767-c51be163539f" containerName="payload-pre-processing"
Sep 11 13:29:53.588062 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.587925    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="124d1df7-8f83-4667-9767-c51be163539f" containerName="payload-pre-processing"
Sep 11 13:29:53.588062 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.587931    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fd5d717-e12d-4383-a0e7-4d0083b307c9" containerName="istio-proxy"
Sep 11 13:29:53.588062 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.587936    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fd5d717-e12d-4383-a0e7-4d0083b307c9" containerName="istio-proxy"
Sep 11 13:29:53.588062 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.587943    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fd5d717-e12d-4383-a0e7-4d0083b307c9" containerName="istio-proxy"
Sep 11 13:29:53.588062 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.587948    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fd5d717-e12d-4383-a0e7-4d0083b307c9" containerName="istio-proxy"
Sep 11 13:29:53.588062 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.587955    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5" containerName="payload-pre-processing"
Sep 11 13:29:53.588062 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.587960    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5" containerName="payload-pre-processing"
Sep 11 13:29:53.588062 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.587967    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49" containerName="istio-proxy"
Sep 11 13:29:53.588062 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.587971    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49" containerName="istio-proxy"
Sep 11 13:29:53.588062 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.587976    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bf8e379-7f8d-4467-89bc-078256340acb" containerName="payload-pre-processing"
Sep 11 13:29:53.588062 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.587980    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bf8e379-7f8d-4467-89bc-078256340acb" containerName="payload-pre-processing"
Sep 11 13:29:53.588062 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.587989    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93514ade-8968-4228-994a-49c6533e5572" containerName="revoke-keys"
Sep 11 13:29:53.588062 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.587993    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="93514ade-8968-4228-994a-49c6533e5572" containerName="revoke-keys"
Sep 11 13:29:53.588062 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.588001    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6b690de-8359-4cd7-8ffc-f8d2944b7aea" containerName="payload-processing"
Sep 11 13:29:53.588062 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.588006    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6b690de-8359-4cd7-8ffc-f8d2944b7aea" containerName="payload-processing"
Sep 11 13:29:53.588062 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.588012    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7" containerName="payload-processing"
Sep 11 13:29:53.588062 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.588017    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7" containerName="payload-processing"
Sep 11 13:29:53.588062 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.588067    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8e4400f-71aa-462f-a054-7f24fe710d8b" containerName="payload-pre-processing"
Sep 11 13:29:53.588062 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.588076    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49" containerName="istio-proxy"
Sep 11 13:29:53.588855 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.588081    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="93514ade-8968-4228-994a-49c6533e5572" containerName="revoke-keys"
Sep 11 13:29:53.588855 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.588087    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bf8e379-7f8d-4467-89bc-078256340acb" containerName="payload-pre-processing"
Sep 11 13:29:53.588855 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.588093    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bc48f20-9192-477b-b5f7-24cf7b942b18" containerName="istio-proxy"
Sep 11 13:29:53.588855 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.588097    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fd5d717-e12d-4383-a0e7-4d0083b307c9" containerName="istio-proxy"
Sep 11 13:29:53.588855 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.588111    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="124d1df7-8f83-4667-9767-c51be163539f" containerName="payload-pre-processing"
Sep 11 13:29:53.588855 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.588117    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fd5d717-e12d-4383-a0e7-4d0083b307c9" containerName="istio-proxy"
Sep 11 13:29:53.588855 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.588122    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f8c3795-dbe0-49b8-b99f-3aa562a4d6c7" containerName="payload-processing"
Sep 11 13:29:53.588855 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.588129    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bc48f20-9192-477b-b5f7-24cf7b942b18" containerName="istio-proxy"
Sep 11 13:29:53.588855 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.588135    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6b690de-8359-4cd7-8ffc-f8d2944b7aea" containerName="payload-processing"
Sep 11 13:29:53.588855 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.588139    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ccc14b2-9ec4-4cd9-bd4a-0940f43d72c5" containerName="payload-pre-processing"
Sep 11 13:29:53.591143 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.591127    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"
Sep 11 13:29:53.598056 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.598035    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-893f6e7c-kserve-self-signed-certs\""
Sep 11 13:29:53.606723 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.606691    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-dshm\") pod \"e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p\" (UID: \"d84f3d0d-cb0c-4a78-9224-0413bb1961d6\") " pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"
Sep 11 13:29:53.606789 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.606746    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-tls-certs\") pod \"e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p\" (UID: \"d84f3d0d-cb0c-4a78-9224-0413bb1961d6\") " pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"
Sep 11 13:29:53.606789 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.606765    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtrkx\" (UniqueName: \"kubernetes.io/projected/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-kube-api-access-vtrkx\") pod \"e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p\" (UID: \"d84f3d0d-cb0c-4a78-9224-0413bb1961d6\") " pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"
Sep 11 13:29:53.606856 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.606803    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-tmp-dir\") pod \"e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p\" (UID: \"d84f3d0d-cb0c-4a78-9224-0413bb1961d6\") " pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"
Sep 11 13:29:53.606856 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.606821    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-home\") pod \"e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p\" (UID: \"d84f3d0d-cb0c-4a78-9224-0413bb1961d6\") " pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"
Sep 11 13:29:53.606922 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.606882    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-model-cache\") pod \"e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p\" (UID: \"d84f3d0d-cb0c-4a78-9224-0413bb1961d6\") " pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"
Sep 11 13:29:53.685908 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.685875    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"]
Sep 11 13:29:53.708269 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.708230    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-tmp-dir\") pod \"e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p\" (UID: \"d84f3d0d-cb0c-4a78-9224-0413bb1961d6\") " pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"
Sep 11 13:29:53.708269 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.708268    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-home\") pod \"e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p\" (UID: \"d84f3d0d-cb0c-4a78-9224-0413bb1961d6\") " pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"
Sep 11 13:29:53.708531 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.708386    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-model-cache\") pod \"e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p\" (UID: \"d84f3d0d-cb0c-4a78-9224-0413bb1961d6\") " pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"
Sep 11 13:29:53.708531 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.708461    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-dshm\") pod \"e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p\" (UID: \"d84f3d0d-cb0c-4a78-9224-0413bb1961d6\") " pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"
Sep 11 13:29:53.708531 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.708501    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-tls-certs\") pod \"e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p\" (UID: \"d84f3d0d-cb0c-4a78-9224-0413bb1961d6\") " pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"
Sep 11 13:29:53.708531 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.708527    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtrkx\" (UniqueName: \"kubernetes.io/projected/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-kube-api-access-vtrkx\") pod \"e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p\" (UID: \"d84f3d0d-cb0c-4a78-9224-0413bb1961d6\") " pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"
Sep 11 13:29:53.708772 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.708708    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-tmp-dir\") pod \"e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p\" (UID: \"d84f3d0d-cb0c-4a78-9224-0413bb1961d6\") " pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"
Sep 11 13:29:53.708772 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.708746    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-home\") pod \"e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p\" (UID: \"d84f3d0d-cb0c-4a78-9224-0413bb1961d6\") " pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"
Sep 11 13:29:53.708852 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.708820    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-model-cache\") pod \"e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p\" (UID: \"d84f3d0d-cb0c-4a78-9224-0413bb1961d6\") " pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"
Sep 11 13:29:53.710875 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.710852    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-dshm\") pod \"e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p\" (UID: \"d84f3d0d-cb0c-4a78-9224-0413bb1961d6\") " pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"
Sep 11 13:29:53.711103 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.711081    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-tls-certs\") pod \"e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p\" (UID: \"d84f3d0d-cb0c-4a78-9224-0413bb1961d6\") " pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"
Sep 11 13:29:53.729438 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.729412    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtrkx\" (UniqueName: \"kubernetes.io/projected/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-kube-api-access-vtrkx\") pod \"e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p\" (UID: \"d84f3d0d-cb0c-4a78-9224-0413bb1961d6\") " pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"
Sep 11 13:29:53.759688 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.759649    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:53.899446 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:53.899353    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"
Sep 11 13:29:54.186302 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:54.184866    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"]
Sep 11 13:29:54.594460 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:54.594360    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p" event={"ID":"d84f3d0d-cb0c-4a78-9224-0413bb1961d6","Type":"ContainerStarted","Data":"5a4eda3e3453b30b6e3de7e750c9fc94d0a3155efaa9978137f7c08eba6fae21"}
Sep 11 13:29:54.594460 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:54.594414    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p" event={"ID":"d84f3d0d-cb0c-4a78-9224-0413bb1961d6","Type":"ContainerStarted","Data":"96c97da73a6821e7eda36c9cff19393bff126f135a828239de22da930b5ecc00"}
Sep 11 13:29:54.621090 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:29:54.621040    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p" podStartSLOduration=1.621023728 podStartE2EDuration="1.621023728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:29:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:29:54.617486808 +0000 UTC m=+2061.478960993" watchObservedRunningTime="2026-09-11 13:29:54.621023728 +0000 UTC m=+2061.482497915"
Sep 11 13:30:00.107144 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:00.107094    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:30:03.899548 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:03.899511    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"
Sep 11 13:30:03.899967 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:03.899572    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"
Sep 11 13:30:03.912265 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:03.912235    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"
Sep 11 13:30:04.659509 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:04.659482    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"
Sep 11 13:30:07.575884 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:07.575844    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:30:09.321844 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:09.321806    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"]
Sep 11 13:30:09.385203 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:09.385165    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:30:24.340778 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:24.340696    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p" podUID="d84f3d0d-cb0c-4a78-9224-0413bb1961d6" containerName="main" containerID="cri-o://5a4eda3e3453b30b6e3de7e750c9fc94d0a3155efaa9978137f7c08eba6fae21" gracePeriod=45
Sep 11 13:30:24.585864 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:24.585835    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"
Sep 11 13:30:24.674789 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:24.674686    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-tls-certs\") pod \"d84f3d0d-cb0c-4a78-9224-0413bb1961d6\" (UID: \"d84f3d0d-cb0c-4a78-9224-0413bb1961d6\") "
Sep 11 13:30:24.674976 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:24.674807    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-home\") pod \"d84f3d0d-cb0c-4a78-9224-0413bb1961d6\" (UID: \"d84f3d0d-cb0c-4a78-9224-0413bb1961d6\") "
Sep 11 13:30:24.674976 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:24.674863    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-tmp-dir\") pod \"d84f3d0d-cb0c-4a78-9224-0413bb1961d6\" (UID: \"d84f3d0d-cb0c-4a78-9224-0413bb1961d6\") "
Sep 11 13:30:24.674976 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:24.674893    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-model-cache\") pod \"d84f3d0d-cb0c-4a78-9224-0413bb1961d6\" (UID: \"d84f3d0d-cb0c-4a78-9224-0413bb1961d6\") "
Sep 11 13:30:24.674976 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:24.674943    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtrkx\" (UniqueName: \"kubernetes.io/projected/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-kube-api-access-vtrkx\") pod \"d84f3d0d-cb0c-4a78-9224-0413bb1961d6\" (UID: \"d84f3d0d-cb0c-4a78-9224-0413bb1961d6\") "
Sep 11 13:30:24.674976 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:24.674966    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-dshm\") pod \"d84f3d0d-cb0c-4a78-9224-0413bb1961d6\" (UID: \"d84f3d0d-cb0c-4a78-9224-0413bb1961d6\") "
Sep 11 13:30:24.675210 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:24.675051    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-home" (OuterVolumeSpecName: "home") pod "d84f3d0d-cb0c-4a78-9224-0413bb1961d6" (UID: "d84f3d0d-cb0c-4a78-9224-0413bb1961d6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:30:24.675210 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:24.675188    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d84f3d0d-cb0c-4a78-9224-0413bb1961d6" (UID: "d84f3d0d-cb0c-4a78-9224-0413bb1961d6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:30:24.675284 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:24.675204    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-model-cache" (OuterVolumeSpecName: "model-cache") pod "d84f3d0d-cb0c-4a78-9224-0413bb1961d6" (UID: "d84f3d0d-cb0c-4a78-9224-0413bb1961d6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:30:24.675342 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:24.675300    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-home\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:30:24.675342 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:24.675336    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-tmp-dir\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:30:24.675454 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:24.675346    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-model-cache\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:30:24.677040 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:24.677015    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d84f3d0d-cb0c-4a78-9224-0413bb1961d6" (UID: "d84f3d0d-cb0c-4a78-9224-0413bb1961d6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:30:24.677155 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:24.677092    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-kube-api-access-vtrkx" (OuterVolumeSpecName: "kube-api-access-vtrkx") pod "d84f3d0d-cb0c-4a78-9224-0413bb1961d6" (UID: "d84f3d0d-cb0c-4a78-9224-0413bb1961d6"). InnerVolumeSpecName "kube-api-access-vtrkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:30:24.677197 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:24.677177    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-dshm" (OuterVolumeSpecName: "dshm") pod "d84f3d0d-cb0c-4a78-9224-0413bb1961d6" (UID: "d84f3d0d-cb0c-4a78-9224-0413bb1961d6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:30:24.751803 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:24.751766    2547 generic.go:356] "Generic (PLEG): container finished" podID="d84f3d0d-cb0c-4a78-9224-0413bb1961d6" containerID="5a4eda3e3453b30b6e3de7e750c9fc94d0a3155efaa9978137f7c08eba6fae21" exitCode=0
Sep 11 13:30:24.751978 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:24.751817    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"
Sep 11 13:30:24.751978 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:24.751858    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p" event={"ID":"d84f3d0d-cb0c-4a78-9224-0413bb1961d6","Type":"ContainerDied","Data":"5a4eda3e3453b30b6e3de7e750c9fc94d0a3155efaa9978137f7c08eba6fae21"}
Sep 11 13:30:24.751978 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:24.751903    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p" event={"ID":"d84f3d0d-cb0c-4a78-9224-0413bb1961d6","Type":"ContainerDied","Data":"96c97da73a6821e7eda36c9cff19393bff126f135a828239de22da930b5ecc00"}
Sep 11 13:30:24.751978 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:24.751921    2547 scope.go:117] "RemoveContainer" containerID="5a4eda3e3453b30b6e3de7e750c9fc94d0a3155efaa9978137f7c08eba6fae21"
Sep 11 13:30:24.761375 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:24.761355    2547 scope.go:117] "RemoveContainer" containerID="5a4eda3e3453b30b6e3de7e750c9fc94d0a3155efaa9978137f7c08eba6fae21"
Sep 11 13:30:24.761683 ip-10-0-133-79 kubenswrapper[2547]: E0911 13:30:24.761664    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a4eda3e3453b30b6e3de7e750c9fc94d0a3155efaa9978137f7c08eba6fae21\": container with ID starting with 5a4eda3e3453b30b6e3de7e750c9fc94d0a3155efaa9978137f7c08eba6fae21 not found: ID does not exist" containerID="5a4eda3e3453b30b6e3de7e750c9fc94d0a3155efaa9978137f7c08eba6fae21"
Sep 11 13:30:24.761761 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:24.761692    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a4eda3e3453b30b6e3de7e750c9fc94d0a3155efaa9978137f7c08eba6fae21"} err="failed to get container status \"5a4eda3e3453b30b6e3de7e750c9fc94d0a3155efaa9978137f7c08eba6fae21\": rpc error: code = NotFound desc = could not find container \"5a4eda3e3453b30b6e3de7e750c9fc94d0a3155efaa9978137f7c08eba6fae21\": container with ID starting with 5a4eda3e3453b30b6e3de7e750c9fc94d0a3155efaa9978137f7c08eba6fae21 not found: ID does not exist"
Sep 11 13:30:24.776190 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:24.776163    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-tls-certs\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:30:24.776190 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:24.776188    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtrkx\" (UniqueName: \"kubernetes.io/projected/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-kube-api-access-vtrkx\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:30:24.776348 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:24.776200    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d84f3d0d-cb0c-4a78-9224-0413bb1961d6-dshm\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\""
Sep 11 13:30:25.977896 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:25.977863    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"]
Sep 11 13:30:25.983524 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:25.983495    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-893f6e7c-kserve-74b5b9f8c-bg45p"]
Sep 11 13:30:27.663699 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:27.663668    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d84f3d0d-cb0c-4a78-9224-0413bb1961d6" path="/var/lib/kubelet/pods/d84f3d0d-cb0c-4a78-9224-0413bb1961d6/volumes"
Sep 11 13:30:33.837834 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:33.837804    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-b7gsm_b22738d7-e796-4173-8fb4-80f9208b99dd/console-operator/2.log"
Sep 11 13:30:33.842443 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:30:33.842416    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-b7gsm_b22738d7-e796-4173-8fb4-80f9208b99dd/console-operator/2.log"
Sep 11 13:31:18.705066 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:18.705036    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56f55dc566-skp7s_b5f91c1e-a86a-47ca-be91-e252b22b8a9d/copy-manifests/0.log"
Sep 11 13:31:18.712405 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:18.712375    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56f55dc566-skp7s_b5f91c1e-a86a-47ca-be91-e252b22b8a9d/manager/0.log"
Sep 11 13:31:20.701469 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:20.701413    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-jx9rx_1ce1c87c-4111-4b04-83d0-1d38f5108e9f/kuadrant-console-plugin/0.log"
Sep 11 13:31:21.865197 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:21.865164    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85d97b946f-kslsb_85575799-be02-4bcc-81ba-a1ac1ee0fa71/kube-auth-proxy/0.log"
Sep 11 13:31:22.395837 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:22.395806    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7457bf46d8-8fk2h_69fdee23-6a53-4095-a856-3e34a64835c3/router/0.log"
Sep 11 13:31:22.881489 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:22.881455    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-6xb2d_105751e2-655e-4df5-9836-d784c926b7f9/main/0.log"
Sep 11 13:31:22.998441 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:22.998410    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-92hsd_869b3226-5f7e-4c7c-a7cb-5ce418527e27/main/0.log"
Sep 11 13:31:23.346267 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:23.346237    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-tsxtp_623cc444-e1c4-4b67-8d12-5667dc0e8bba/main/0.log"
Sep 11 13:31:23.461875 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:23.461841    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-l8ckk_0bfad827-4c24-47b1-a2b7-2d8d65e96783/main/0.log"
Sep 11 13:31:29.037263 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:29.037169    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ljsx5/must-gather-cxksj"]
Sep 11 13:31:29.038562 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:29.038536    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49" containerName="istio-proxy"
Sep 11 13:31:29.038740 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:29.038708    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49" containerName="istio-proxy"
Sep 11 13:31:29.038853 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:29.038843    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d84f3d0d-cb0c-4a78-9224-0413bb1961d6" containerName="main"
Sep 11 13:31:29.038926 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:29.038917    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d84f3d0d-cb0c-4a78-9224-0413bb1961d6" containerName="main"
Sep 11 13:31:29.039196 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:29.039182    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="d735ca6d-078b-4cd3-ae5e-a7ceec5bbd49" containerName="istio-proxy"
Sep 11 13:31:29.039285 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:29.039275    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="d84f3d0d-cb0c-4a78-9224-0413bb1961d6" containerName="main"
Sep 11 13:31:29.043839 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:29.043809    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ljsx5/must-gather-cxksj"
Sep 11 13:31:29.048282 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:29.048243    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ljsx5\"/\"kube-root-ca.crt\""
Sep 11 13:31:29.049008 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:29.048986    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ljsx5\"/\"default-dockercfg-cht8v\""
Sep 11 13:31:29.049119 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:29.048986    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ljsx5\"/\"openshift-service-ca.crt\""
Sep 11 13:31:29.053972 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:29.053948    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ljsx5/must-gather-cxksj"]
Sep 11 13:31:29.062193 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:29.062167    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7129f980-5e1a-4fa3-b018-d698270d738c-must-gather-output\") pod \"must-gather-cxksj\" (UID: \"7129f980-5e1a-4fa3-b018-d698270d738c\") " pod="openshift-must-gather-ljsx5/must-gather-cxksj"
Sep 11 13:31:29.062354 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:29.062232    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55x9x\" (UniqueName: \"kubernetes.io/projected/7129f980-5e1a-4fa3-b018-d698270d738c-kube-api-access-55x9x\") pod \"must-gather-cxksj\" (UID: \"7129f980-5e1a-4fa3-b018-d698270d738c\") " pod="openshift-must-gather-ljsx5/must-gather-cxksj"
Sep 11 13:31:29.063159 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:29.063131    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:31:29.163660 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:29.163618    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7129f980-5e1a-4fa3-b018-d698270d738c-must-gather-output\") pod \"must-gather-cxksj\" (UID: \"7129f980-5e1a-4fa3-b018-d698270d738c\") " pod="openshift-must-gather-ljsx5/must-gather-cxksj"
Sep 11 13:31:29.163874 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:29.163679    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55x9x\" (UniqueName: \"kubernetes.io/projected/7129f980-5e1a-4fa3-b018-d698270d738c-kube-api-access-55x9x\") pod \"must-gather-cxksj\" (UID: \"7129f980-5e1a-4fa3-b018-d698270d738c\") " pod="openshift-must-gather-ljsx5/must-gather-cxksj"
Sep 11 13:31:29.164009 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:29.163989    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7129f980-5e1a-4fa3-b018-d698270d738c-must-gather-output\") pod \"must-gather-cxksj\" (UID: \"7129f980-5e1a-4fa3-b018-d698270d738c\") " pod="openshift-must-gather-ljsx5/must-gather-cxksj"
Sep 11 13:31:29.172677 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:29.172656    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55x9x\" (UniqueName: \"kubernetes.io/projected/7129f980-5e1a-4fa3-b018-d698270d738c-kube-api-access-55x9x\") pod \"must-gather-cxksj\" (UID: \"7129f980-5e1a-4fa3-b018-d698270d738c\") " pod="openshift-must-gather-ljsx5/must-gather-cxksj"
Sep 11 13:31:29.354674 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:29.354641    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ljsx5/must-gather-cxksj"
Sep 11 13:31:29.628054 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:29.628023    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ljsx5/must-gather-cxksj"]
Sep 11 13:31:29.630001 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:31:29.629975    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7129f980_5e1a_4fa3_b018_d698270d738c.slice/crio-962489b6ba16a47fbd9eb78c4ea1180682629cfd7df0ef34a049c3871fb0b838 WatchSource:0}: Error finding container 962489b6ba16a47fbd9eb78c4ea1180682629cfd7df0ef34a049c3871fb0b838: Status 404 returned error can't find the container with id 962489b6ba16a47fbd9eb78c4ea1180682629cfd7df0ef34a049c3871fb0b838
Sep 11 13:31:29.632415 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:29.632398    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 13:31:30.093037 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:30.093001    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ljsx5/must-gather-cxksj" event={"ID":"7129f980-5e1a-4fa3-b018-d698270d738c","Type":"ContainerStarted","Data":"962489b6ba16a47fbd9eb78c4ea1180682629cfd7df0ef34a049c3871fb0b838"}
Sep 11 13:31:30.986580 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:30.986543    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:31:31.102501 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:31.102412    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ljsx5/must-gather-cxksj" event={"ID":"7129f980-5e1a-4fa3-b018-d698270d738c","Type":"ContainerStarted","Data":"3b3953ad6af2380e965708c69ed038e87699ecc404341917ae75ab4c81192528"}
Sep 11 13:31:31.102501 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:31.102461    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ljsx5/must-gather-cxksj" event={"ID":"7129f980-5e1a-4fa3-b018-d698270d738c","Type":"ContainerStarted","Data":"055ba839b46700aebefda25a017041e31680ef9c4545f8fc94eff70fcfc98636"}
Sep 11 13:31:31.122376 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:31.122314    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ljsx5/must-gather-cxksj" podStartSLOduration=0.939883124 podStartE2EDuration="2.122293734s" totalImagesPullingTime="1.18241061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:31:31.120041487 +0000 UTC m=+2157.981515687" watchObservedRunningTime="2026-09-11 13:31:31.122293734 +0000 UTC m=+2157.983767921"
Sep 11 13:31:32.453977 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:32.453941    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hw4b9_4a0213c0-ea91-46ef-963b-eebfca575f1d/global-pull-secret-syncer/0.log"
Sep 11 13:31:32.674284 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:32.674254    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log"
Sep 11 13:31:32.905256 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:32.905220    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-79.ec2.internal_0f092973866d00f19dd94cc0896a8414/haproxy/0.log"
Sep 11 13:31:37.205916 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:37.205872    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-jx9rx_1ce1c87c-4111-4b04-83d0-1d38f5108e9f/kuadrant-console-plugin/0.log"
Sep 11 13:31:39.078260 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:39.078224    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-rmbdd_026870b5-9a92-410e-ad2b-cb6d9a648da6/cluster-monitoring-operator/0.log"
Sep 11 13:31:39.115052 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:39.115018    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-8fbg6_d631454d-ff93-43ea-8807-f1f633d724ea/kube-state-metrics/0.log"
Sep 11 13:31:39.143170 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:39.143132    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-8fbg6_d631454d-ff93-43ea-8807-f1f633d724ea/kube-rbac-proxy-main/0.log"
Sep 11 13:31:39.174918 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:39.174884    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-8fbg6_d631454d-ff93-43ea-8807-f1f633d724ea/kube-rbac-proxy-self/0.log"
Sep 11 13:31:39.246647 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:39.246610    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-h7s4s_e366bf09-f550-467a-a7ef-351e61bc1386/monitoring-plugin/0.log"
Sep 11 13:31:39.304993 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:39.304959    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-htlmm_4513137d-518a-45a7-9ea4-84db18a11c39/node-exporter/0.log"
Sep 11 13:31:39.335025 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:39.334931    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-htlmm_4513137d-518a-45a7-9ea4-84db18a11c39/kube-rbac-proxy/0.log"
Sep 11 13:31:39.368634 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:39.368606    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-htlmm_4513137d-518a-45a7-9ea4-84db18a11c39/init-textfile/0.log"
Sep 11 13:31:40.632578 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:40.632538    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:31:42.683292 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:42.683249    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-b7gsm_b22738d7-e796-4173-8fb4-80f9208b99dd/console-operator/2.log"
Sep 11 13:31:42.691375 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:42.691338    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-b7gsm_b22738d7-e796-4173-8fb4-80f9208b99dd/console-operator/3.log"
Sep 11 13:31:42.734196 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:42.734141    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ljsx5/perf-node-gather-daemonset-5qpwn"]
Sep 11 13:31:42.739225 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:42.739188    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-5qpwn"
Sep 11 13:31:42.748426 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:42.748392    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ljsx5/perf-node-gather-daemonset-5qpwn"]
Sep 11 13:31:42.801249 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:42.801201    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/59142d14-b12f-41c7-ac28-15a19ba8f515-proc\") pod \"perf-node-gather-daemonset-5qpwn\" (UID: \"59142d14-b12f-41c7-ac28-15a19ba8f515\") " pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-5qpwn"
Sep 11 13:31:42.801535 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:42.801515    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/59142d14-b12f-41c7-ac28-15a19ba8f515-podres\") pod \"perf-node-gather-daemonset-5qpwn\" (UID: \"59142d14-b12f-41c7-ac28-15a19ba8f515\") " pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-5qpwn"
Sep 11 13:31:42.801670 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:42.801656    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/59142d14-b12f-41c7-ac28-15a19ba8f515-lib-modules\") pod \"perf-node-gather-daemonset-5qpwn\" (UID: \"59142d14-b12f-41c7-ac28-15a19ba8f515\") " pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-5qpwn"
Sep 11 13:31:42.801787 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:42.801772    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvbfr\" (UniqueName: \"kubernetes.io/projected/59142d14-b12f-41c7-ac28-15a19ba8f515-kube-api-access-cvbfr\") pod \"perf-node-gather-daemonset-5qpwn\" (UID: \"59142d14-b12f-41c7-ac28-15a19ba8f515\") " pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-5qpwn"
Sep 11 13:31:42.801957 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:42.801940    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59142d14-b12f-41c7-ac28-15a19ba8f515-sys\") pod \"perf-node-gather-daemonset-5qpwn\" (UID: \"59142d14-b12f-41c7-ac28-15a19ba8f515\") " pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-5qpwn"
Sep 11 13:31:42.903014 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:42.902981    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/59142d14-b12f-41c7-ac28-15a19ba8f515-proc\") pod \"perf-node-gather-daemonset-5qpwn\" (UID: \"59142d14-b12f-41c7-ac28-15a19ba8f515\") " pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-5qpwn"
Sep 11 13:31:42.903014 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:42.903018    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/59142d14-b12f-41c7-ac28-15a19ba8f515-podres\") pod \"perf-node-gather-daemonset-5qpwn\" (UID: \"59142d14-b12f-41c7-ac28-15a19ba8f515\") " pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-5qpwn"
Sep 11 13:31:42.903277 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:42.903045    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/59142d14-b12f-41c7-ac28-15a19ba8f515-lib-modules\") pod \"perf-node-gather-daemonset-5qpwn\" (UID: \"59142d14-b12f-41c7-ac28-15a19ba8f515\") " pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-5qpwn"
Sep 11 13:31:42.903277 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:42.903065    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvbfr\" (UniqueName: \"kubernetes.io/projected/59142d14-b12f-41c7-ac28-15a19ba8f515-kube-api-access-cvbfr\") pod \"perf-node-gather-daemonset-5qpwn\" (UID: \"59142d14-b12f-41c7-ac28-15a19ba8f515\") " pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-5qpwn"
Sep 11 13:31:42.903277 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:42.903101    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59142d14-b12f-41c7-ac28-15a19ba8f515-sys\") pod \"perf-node-gather-daemonset-5qpwn\" (UID: \"59142d14-b12f-41c7-ac28-15a19ba8f515\") " pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-5qpwn"
Sep 11 13:31:42.903277 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:42.903118    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/59142d14-b12f-41c7-ac28-15a19ba8f515-proc\") pod \"perf-node-gather-daemonset-5qpwn\" (UID: \"59142d14-b12f-41c7-ac28-15a19ba8f515\") " pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-5qpwn"
Sep 11 13:31:42.903277 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:42.903202    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59142d14-b12f-41c7-ac28-15a19ba8f515-sys\") pod \"perf-node-gather-daemonset-5qpwn\" (UID: \"59142d14-b12f-41c7-ac28-15a19ba8f515\") " pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-5qpwn"
Sep 11 13:31:42.903277 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:42.903200    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/59142d14-b12f-41c7-ac28-15a19ba8f515-podres\") pod \"perf-node-gather-daemonset-5qpwn\" (UID: \"59142d14-b12f-41c7-ac28-15a19ba8f515\") " pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-5qpwn"
Sep 11 13:31:42.903277 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:42.903277    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/59142d14-b12f-41c7-ac28-15a19ba8f515-lib-modules\") pod \"perf-node-gather-daemonset-5qpwn\" (UID: \"59142d14-b12f-41c7-ac28-15a19ba8f515\") " pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-5qpwn"
Sep 11 13:31:42.912147 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:42.912109    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvbfr\" (UniqueName: \"kubernetes.io/projected/59142d14-b12f-41c7-ac28-15a19ba8f515-kube-api-access-cvbfr\") pod \"perf-node-gather-daemonset-5qpwn\" (UID: \"59142d14-b12f-41c7-ac28-15a19ba8f515\") " pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-5qpwn"
Sep 11 13:31:43.060740 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:43.060686    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-5qpwn"
Sep 11 13:31:43.323023 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:43.322942    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-666bf8f6c5-944qj_a4957857-10f5-40a3-b86c-35f4bec85b19/console/0.log"
Sep 11 13:31:43.368247 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:43.368219    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ljsx5/perf-node-gather-daemonset-5qpwn"]
Sep 11 13:31:43.369128 ip-10-0-133-79 kubenswrapper[2547]: W0911 13:31:43.369098    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod59142d14_b12f_41c7_ac28_15a19ba8f515.slice/crio-331a69f56bfb22b1c5934e976b79122f5a5417045088ee9468bf68b127af318c WatchSource:0}: Error finding container 331a69f56bfb22b1c5934e976b79122f5a5417045088ee9468bf68b127af318c: Status 404 returned error can't find the container with id 331a69f56bfb22b1c5934e976b79122f5a5417045088ee9468bf68b127af318c
Sep 11 13:31:44.210265 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:44.210235    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-kzws9_71bcc6fe-50d4-4d8f-bc8a-8c0073ac3b54/volume-data-source-validator/0.log"
Sep 11 13:31:44.217931 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:44.217899    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-5qpwn" event={"ID":"59142d14-b12f-41c7-ac28-15a19ba8f515","Type":"ContainerStarted","Data":"d517ef8f289bdb0a9d7b5278f47ed8fd0a963386ef3b8f9aacfecf6522037b30"}
Sep 11 13:31:44.218104 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:44.217961    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-5qpwn" event={"ID":"59142d14-b12f-41c7-ac28-15a19ba8f515","Type":"ContainerStarted","Data":"331a69f56bfb22b1c5934e976b79122f5a5417045088ee9468bf68b127af318c"}
Sep 11 13:31:44.218104 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:44.217985    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-5qpwn"
Sep 11 13:31:44.247275 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:44.247217    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-5qpwn" podStartSLOduration=2.2471974 podStartE2EDuration="2.2471974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:31:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:31:44.246049542 +0000 UTC m=+2171.107523732" watchObservedRunningTime="2026-09-11 13:31:44.2471974 +0000 UTC m=+2171.108671587"
Sep 11 13:31:45.520411 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:45.520368    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-75kfq_0be127eb-c133-4cbd-b442-9c8d0ae735aa/dns/0.log"
Sep 11 13:31:45.560930 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:45.560898    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-75kfq_0be127eb-c133-4cbd-b442-9c8d0ae735aa/kube-rbac-proxy/0.log"
Sep 11 13:31:45.719193 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:45.719162    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9bb5n_68d59d28-7efe-4ac2-955b-697b740b7781/dns-node-resolver/0.log"
Sep 11 13:31:46.453919 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:46.453890    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v26jw_21d7503a-0156-478a-b2c2-8555a08faf52/node-ca/0.log"
Sep 11 13:31:48.268097 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:48.268061    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85d97b946f-kslsb_85575799-be02-4bcc-81ba-a1ac1ee0fa71/kube-auth-proxy/0.log"
Sep 11 13:31:48.484673 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:48.484639    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7457bf46d8-8fk2h_69fdee23-6a53-4095-a856-3e34a64835c3/router/0.log"
Sep 11 13:31:49.604502 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:49.604469    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8nv6f_1dd7158a-e1f4-4aa4-82b0-f85ad37fd213/serve-healthcheck-canary/0.log"
Sep 11 13:31:50.175703 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:50.175668    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-6h8mp_1585ba00-5e8f-42ec-bcd3-a18167f281ea/insights-operator/0.log"
Sep 11 13:31:50.176538 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:50.176503    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-6h8mp_1585ba00-5e8f-42ec-bcd3-a18167f281ea/insights-operator/1.log"
Sep 11 13:31:50.235089 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:50.235063    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-5qpwn"
Sep 11 13:31:50.375875 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:50.375844    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v9qrk_da903b32-17b4-42ff-849c-deb3e59ce02b/kube-rbac-proxy/0.log"
Sep 11 13:31:50.399353 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:50.399309    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v9qrk_da903b32-17b4-42ff-849c-deb3e59ce02b/exporter/0.log"
Sep 11 13:31:50.426811 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:50.426686    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v9qrk_da903b32-17b4-42ff-849c-deb3e59ce02b/extractor/0.log"
Sep 11 13:31:52.567656 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:52.567614    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22m8j_de418b7e-552a-4d60-94bf-fcb75207e5ab/konnectivity-agent/0.log" limit=1024
Sep 11 13:31:53.884413 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:53.884382    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56f55dc566-skp7s_b5f91c1e-a86a-47ca-be91-e252b22b8a9d/manager/0.log"
Sep 11 13:31:53.921239 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:53.921208    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56f55dc566-skp7s_b5f91c1e-a86a-47ca-be91-e252b22b8a9d/copy-manifests/0.log"
Sep 11 13:31:54.412561 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:54.412523    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85d97b946f-kslsb_85575799-be02-4bcc-81ba-a1ac1ee0fa71/kube-auth-proxy/0.log"
Sep 11 13:31:54.576494 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:54.576401    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7457bf46d8-8fk2h_69fdee23-6a53-4095-a856-3e34a64835c3/router/0.log"
Sep 11 13:31:55.264599 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:55.264568    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5cd99cffb8-wnfj9_03d9cd23-d60c-4c17-99ff-d1cf3a11bc3a/manager/0.log"
Sep 11 13:31:56.748619 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:56.748579    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85d97b946f-kslsb_85575799-be02-4bcc-81ba-a1ac1ee0fa71/kube-auth-proxy/0.log"
Sep 11 13:31:56.902175 ip-10-0-133-79 kubenswrapper[2547]: I0911 13:31:56.902146    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7457bf46d8-8fk2h_69fdee23-6a53-4095-a856-3e34a64835c3/router/0.log"