Sep 16 02:16:36.918539 ip-10-0-137-62 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 16 02:16:36.918552 ip-10-0-137-62 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 16 02:16:36.918562 ip-10-0-137-62 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 16 02:16:36.918782 ip-10-0-137-62 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 16 02:16:47.071947 ip-10-0-137-62 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 16 02:16:47.071964 ip-10-0-137-62 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 3b74e168b3174b70a50c409269dbaf01 --
Sep 16 02:18:41.848616 ip-10-0-137-62 systemd[1]: Starting Kubernetes Kubelet...
Sep 16 02:18:42.170387 ip-10-0-137-62 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 02:18:42.170387 ip-10-0-137-62 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 16 02:18:42.170387 ip-10-0-137-62 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 02:18:42.170387 ip-10-0-137-62 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 16 02:18:42.170387 ip-10-0-137-62 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 02:18:42.171271 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.171207    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 16 02:18:42.175444 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175430    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 02:18:42.175444 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175444    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 02:18:42.175514 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175448    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 02:18:42.175514 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175451    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 02:18:42.175514 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175454    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 02:18:42.175514 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175459    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 02:18:42.175514 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175463    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 02:18:42.175514 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175466    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 02:18:42.175514 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175470    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 02:18:42.175514 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175473    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 02:18:42.175514 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175476    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 02:18:42.175514 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175478    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 02:18:42.175514 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175481    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 02:18:42.175514 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175484    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 02:18:42.175514 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175486    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 02:18:42.175514 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175489    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 02:18:42.175514 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175497    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 02:18:42.175514 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175500    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 02:18:42.175514 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175503    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 02:18:42.175514 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175505    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 02:18:42.175514 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175508    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 02:18:42.175514 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175511    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 02:18:42.175993 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175513    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 02:18:42.175993 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175516    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 02:18:42.175993 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175519    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 02:18:42.175993 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175523    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 02:18:42.175993 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175527    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 02:18:42.175993 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175530    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 02:18:42.175993 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175533    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 02:18:42.175993 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175536    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 02:18:42.175993 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175538    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 02:18:42.175993 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175542    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 02:18:42.175993 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175544    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 02:18:42.175993 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175547    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 02:18:42.175993 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175549    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 02:18:42.175993 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175552    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 02:18:42.175993 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175555    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 02:18:42.175993 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175558    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 02:18:42.175993 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175560    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 02:18:42.175993 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175570    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 02:18:42.175993 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175573    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 02:18:42.176478 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175576    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 02:18:42.176478 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175578    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 02:18:42.176478 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175581    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 02:18:42.176478 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175584    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 02:18:42.176478 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175587    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 02:18:42.176478 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175589    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 02:18:42.176478 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175592    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 02:18:42.176478 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175594    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 02:18:42.176478 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175597    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 02:18:42.176478 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175599    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 02:18:42.176478 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175601    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 02:18:42.176478 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175604    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 02:18:42.176478 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175607    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 02:18:42.176478 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175610    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 02:18:42.176478 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175613    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 02:18:42.176478 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175618    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 02:18:42.176478 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175621    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 02:18:42.176478 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175624    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 02:18:42.176478 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175627    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 02:18:42.176937 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175629    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 02:18:42.176937 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175632    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 02:18:42.176937 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175635    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 02:18:42.176937 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175637    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 02:18:42.176937 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175640    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 02:18:42.176937 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175643    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 02:18:42.176937 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175645    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 02:18:42.176937 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175648    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 02:18:42.176937 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175650    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 02:18:42.176937 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175653    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 02:18:42.176937 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175656    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 02:18:42.176937 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175658    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 02:18:42.176937 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175661    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 02:18:42.176937 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175663    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 02:18:42.176937 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175666    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 02:18:42.176937 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175669    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 02:18:42.176937 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175671    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 02:18:42.176937 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175674    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 02:18:42.176937 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175676    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 02:18:42.176937 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175679    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 02:18:42.177430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175681    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 02:18:42.177430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175684    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 02:18:42.177430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175686    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 02:18:42.177430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175689    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 02:18:42.177430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175691    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 02:18:42.177430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175694    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 02:18:42.177430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175697    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 02:18:42.177430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175700    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 02:18:42.177430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175703    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 02:18:42.177430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175705    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 02:18:42.177430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175708    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 02:18:42.177430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175710    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 02:18:42.177430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175713    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 02:18:42.177430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175715    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 02:18:42.177430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175718    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 02:18:42.177430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175720    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 02:18:42.177430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175723    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 02:18:42.177430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175725    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 02:18:42.177430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.175728    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 02:18:42.177430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176398    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 02:18:42.177943 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176405    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 02:18:42.177943 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176408    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 02:18:42.177943 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176411    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 02:18:42.177943 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176414    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 02:18:42.177943 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176417    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 02:18:42.177943 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176420    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 02:18:42.177943 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176422    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 02:18:42.177943 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176425    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 02:18:42.177943 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176428    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 02:18:42.177943 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176431    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 02:18:42.177943 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176433    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 02:18:42.177943 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176436    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 02:18:42.177943 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176438    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 02:18:42.177943 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176441    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 02:18:42.177943 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176444    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 02:18:42.177943 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176446    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 02:18:42.177943 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176451    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 02:18:42.177943 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176455    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 02:18:42.177943 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176459    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 02:18:42.178435 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176463    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 02:18:42.178435 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176466    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 02:18:42.178435 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176470    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 02:18:42.178435 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176473    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 02:18:42.178435 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176476    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 02:18:42.178435 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176479    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 02:18:42.178435 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176481    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 02:18:42.178435 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176485    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 02:18:42.178435 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176487    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 02:18:42.178435 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176490    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 02:18:42.178435 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176493    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 02:18:42.178435 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176495    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 02:18:42.178435 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176498    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 02:18:42.178435 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176501    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 02:18:42.178435 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176503    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 02:18:42.178435 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176506    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 02:18:42.178435 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176508    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 02:18:42.178435 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176511    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 02:18:42.178435 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176514    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 02:18:42.178435 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176517    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 02:18:42.178926 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176519    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 02:18:42.178926 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176522    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 02:18:42.178926 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176525    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 02:18:42.178926 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176527    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 02:18:42.178926 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176530    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 02:18:42.178926 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176534    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 02:18:42.178926 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176537    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 02:18:42.178926 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176540    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 02:18:42.178926 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176543    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 02:18:42.178926 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176545    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 02:18:42.178926 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176549    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 02:18:42.178926 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176552    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 02:18:42.178926 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176555    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 02:18:42.178926 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176558    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 02:18:42.178926 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176560    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 02:18:42.178926 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176563    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 02:18:42.178926 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176565    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 02:18:42.178926 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176568    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 02:18:42.178926 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176571    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 02:18:42.178926 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176574    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 02:18:42.179430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176577    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 02:18:42.179430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176579    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 02:18:42.179430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176582    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 02:18:42.179430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176584    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 02:18:42.179430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176587    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 02:18:42.179430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176590    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 02:18:42.179430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176593    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 02:18:42.179430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176595    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 02:18:42.179430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176597    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 02:18:42.179430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176600    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 02:18:42.179430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176603    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 02:18:42.179430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176605    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 02:18:42.179430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176607    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 02:18:42.179430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176610    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 02:18:42.179430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176613    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 02:18:42.179430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176616    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 02:18:42.179430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176618    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 02:18:42.179430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176622    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 02:18:42.179430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176625    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 02:18:42.179430 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176627    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 02:18:42.179944 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176630    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 02:18:42.179944 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176633    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 02:18:42.179944 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176635    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 02:18:42.179944 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176638    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 02:18:42.179944 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176641    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 02:18:42.179944 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176644    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 02:18:42.179944 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176646    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 02:18:42.179944 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176649    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 02:18:42.179944 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176653    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 02:18:42.179944 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176656    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 02:18:42.179944 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176659    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 02:18:42.179944 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176662    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 02:18:42.179944 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176665    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 02:18:42.179944 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176667    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 02:18:42.179944 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176670    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 02:18:42.179944 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176672    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 02:18:42.179944 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176675    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 02:18:42.179944 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176677    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 02:18:42.179944 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.176680    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 02:18:42.179944 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177018    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 02:18:42.180437 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177023    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 02:18:42.180437 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177026    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 02:18:42.180437 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177028    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 02:18:42.180437 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177031    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 02:18:42.180437 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177033    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 02:18:42.180437 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177036    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 02:18:42.180437 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177038    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 02:18:42.180437 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177042    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 02:18:42.180437 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177044    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 02:18:42.180437 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177047    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 02:18:42.180437 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177050    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 02:18:42.180437 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177053    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 02:18:42.180437 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177055    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 02:18:42.180437 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177058    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 02:18:42.180437 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177060    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 02:18:42.180437 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177063    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 02:18:42.180437 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177066    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 02:18:42.180437 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177069    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 02:18:42.180437 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177072    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 02:18:42.180437 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177075    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 02:18:42.180998 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177077    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 02:18:42.180998 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177080    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 02:18:42.180998 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177082    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 02:18:42.180998 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177085    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 02:18:42.180998 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177087    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 02:18:42.180998 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177090    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 02:18:42.180998 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177093    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 02:18:42.180998 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177095    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 02:18:42.180998 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177098    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 02:18:42.180998 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177100    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 02:18:42.180998 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177103    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 02:18:42.180998 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177105    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 02:18:42.180998 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177108    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 02:18:42.180998 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177110    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 02:18:42.180998 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177113    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 02:18:42.180998 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177115    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 02:18:42.180998 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177118    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 02:18:42.180998 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177121    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 02:18:42.180998 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177123    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 02:18:42.180998 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177126    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 02:18:42.181512 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177129    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 02:18:42.181512 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177132    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 02:18:42.181512 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177135    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 02:18:42.181512 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177138    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 02:18:42.181512 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177140    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 02:18:42.181512 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177146    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 02:18:42.181512 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177149    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 02:18:42.181512 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177153    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 02:18:42.181512 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177155    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 02:18:42.181512 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177158    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 02:18:42.181512 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177161    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 02:18:42.181512 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177164    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 02:18:42.181512 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177167    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 02:18:42.181512 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177170    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 02:18:42.181512 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177172    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 02:18:42.181512 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177175    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 02:18:42.181512 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177177    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 02:18:42.181512 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177180    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 02:18:42.181512 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177182    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 02:18:42.181512 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177185    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 02:18:42.182003 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177188    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 02:18:42.182003 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177191    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 02:18:42.182003 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177193    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 02:18:42.182003 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177195    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 02:18:42.182003 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177198    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 02:18:42.182003 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177201    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 02:18:42.182003 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177203    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 02:18:42.182003 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177206    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 02:18:42.182003 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177209    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 02:18:42.182003 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177211    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 02:18:42.182003 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177214    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 02:18:42.182003 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177216    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 02:18:42.182003 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177219    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 02:18:42.182003 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177226    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 02:18:42.182003 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177229    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 02:18:42.182003 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177231    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 02:18:42.182003 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177234    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 02:18:42.182003 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177236    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 02:18:42.182003 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177239    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 02:18:42.182003 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177241    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 02:18:42.182525 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177244    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 02:18:42.182525 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177246    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 02:18:42.182525 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177249    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 02:18:42.182525 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177251    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 02:18:42.182525 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177255    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 02:18:42.182525 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177259    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 02:18:42.182525 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177262    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 02:18:42.182525 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177264    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 02:18:42.182525 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177267    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 02:18:42.182525 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177270    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 02:18:42.182525 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177273    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 02:18:42.182525 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177276    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 02:18:42.182525 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177278    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 02:18:42.182525 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177281    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 02:18:42.182525 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177284    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 02:18:42.182525 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177286    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 02:18:42.182525 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177289    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 02:18:42.182525 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.177291    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 02:18:42.182525 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177372    2565 flags.go:64] FLAG: --address="0.0.0.0"
Sep 16 02:18:42.182525 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177405    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 16 02:18:42.183011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177411    2565 flags.go:64] FLAG: --anonymous-auth="true"
Sep 16 02:18:42.183011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177415    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 16 02:18:42.183011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177429    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 16 02:18:42.183011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177433    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 16 02:18:42.183011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177437    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 16 02:18:42.183011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177445    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 16 02:18:42.183011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177449    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 16 02:18:42.183011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177451    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 16 02:18:42.183011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177455    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 16 02:18:42.183011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177458    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 16 02:18:42.183011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177461    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 16 02:18:42.183011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177464    2565 flags.go:64] FLAG: --cgroup-root=""
Sep 16 02:18:42.183011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177467    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 16 02:18:42.183011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177470    2565 flags.go:64] FLAG: --client-ca-file=""
Sep 16 02:18:42.183011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177473    2565 flags.go:64] FLAG: --cloud-provider="external"
Sep 16 02:18:42.183011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177476    2565 flags.go:64] FLAG: --cluster-dns="[]"
Sep 16 02:18:42.183011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177483    2565 flags.go:64] FLAG: --cluster-domain=""
Sep 16 02:18:42.183011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177486    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 16 02:18:42.183011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177489    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 16 02:18:42.183011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177492    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 16 02:18:42.183011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177496    2565 flags.go:64] FLAG: --container-log-max-files="5"
Sep 16 02:18:42.183011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177499    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 16 02:18:42.183011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177502    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 16 02:18:42.183624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177505    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 16 02:18:42.183624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177508    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 16 02:18:42.183624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177511    2565 flags.go:64] FLAG: --contention-profiling="false"
Sep 16 02:18:42.183624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177514    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 16 02:18:42.183624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177517    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 16 02:18:42.183624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177520    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 16 02:18:42.183624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177523    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 16 02:18:42.183624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177527    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 16 02:18:42.183624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177530    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 16 02:18:42.183624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177532    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 16 02:18:42.183624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177535    2565 flags.go:64] FLAG: --enable-load-reader="false"
Sep 16 02:18:42.183624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177538    2565 flags.go:64] FLAG: --enable-server="true"
Sep 16 02:18:42.183624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177541    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 16 02:18:42.183624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177545    2565 flags.go:64] FLAG: --event-burst="100"
Sep 16 02:18:42.183624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177551    2565 flags.go:64] FLAG: --event-qps="50"
Sep 16 02:18:42.183624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177554    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 16 02:18:42.183624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177557    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 16 02:18:42.183624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177560    2565 flags.go:64] FLAG: --eviction-hard=""
Sep 16 02:18:42.183624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177563    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 16 02:18:42.183624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177566    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 16 02:18:42.183624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177569    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 16 02:18:42.183624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177572    2565 flags.go:64] FLAG: --eviction-soft=""
Sep 16 02:18:42.183624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177575    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 16 02:18:42.183624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177578    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 16 02:18:42.183624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177581    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 16 02:18:42.184255 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177584    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 16 02:18:42.184255 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177587    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 16 02:18:42.184255 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177590    2565 flags.go:64] FLAG: --fail-swap-on="true"
Sep 16 02:18:42.184255 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177593    2565 flags.go:64] FLAG: --feature-gates=""
Sep 16 02:18:42.184255 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177596    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 16 02:18:42.184255 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177599    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 16 02:18:42.184255 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177602    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 16 02:18:42.184255 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177605    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 16 02:18:42.184255 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177608    2565 flags.go:64] FLAG: --healthz-port="10248"
Sep 16 02:18:42.184255 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177611    2565 flags.go:64] FLAG: --help="false"
Sep 16 02:18:42.184255 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177614    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-137-62.ec2.internal"
Sep 16 02:18:42.184255 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177617    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 16 02:18:42.184255 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177620    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 16 02:18:42.184255 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177623    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 16 02:18:42.184255 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177626    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 16 02:18:42.184255 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177629    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 16 02:18:42.184255 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177632    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 16 02:18:42.184255 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177635    2565 flags.go:64] FLAG: --image-service-endpoint=""
Sep 16 02:18:42.184255 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177637    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 16 02:18:42.184255 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177640    2565 flags.go:64] FLAG: --kube-api-burst="100"
Sep 16 02:18:42.184255 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177643    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 16 02:18:42.184255 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177650    2565 flags.go:64] FLAG: --kube-api-qps="50"
Sep 16 02:18:42.184255 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177653    2565 flags.go:64] FLAG: --kube-reserved=""
Sep 16 02:18:42.184255 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177656    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 16 02:18:42.184896 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177660    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 16 02:18:42.184896 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177663    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 16 02:18:42.184896 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177666    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 16 02:18:42.184896 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177669    2565 flags.go:64] FLAG: --lock-file=""
Sep 16 02:18:42.184896 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177672    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 16 02:18:42.184896 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177675    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 16 02:18:42.184896 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177678    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 16 02:18:42.184896 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177683    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 16 02:18:42.184896 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177686    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 16 02:18:42.184896 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177689    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 16 02:18:42.184896 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177692    2565 flags.go:64] FLAG: --logging-format="text"
Sep 16 02:18:42.184896 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177695    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 16 02:18:42.184896 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177698    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 16 02:18:42.184896 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177701    2565 flags.go:64] FLAG: --manifest-url=""
Sep 16 02:18:42.184896 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177704    2565 flags.go:64] FLAG: --manifest-url-header=""
Sep 16 02:18:42.184896 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177708    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 16 02:18:42.184896 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177711    2565 flags.go:64] FLAG: --max-open-files="1000000"
Sep 16 02:18:42.184896 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177715    2565 flags.go:64] FLAG: --max-pods="110"
Sep 16 02:18:42.184896 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177718    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 16 02:18:42.184896 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177721    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 16 02:18:42.184896 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177724    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 16 02:18:42.184896 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177727    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 16 02:18:42.184896 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177730    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 16 02:18:42.184896 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177733    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 16 02:18:42.184896 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177736    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 16 02:18:42.185507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177742    2565 flags.go:64] FLAG: --node-status-max-images="50"
Sep 16 02:18:42.185507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177745    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 16 02:18:42.185507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177748    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 16 02:18:42.185507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177751    2565 flags.go:64] FLAG: --pod-cidr=""
Sep 16 02:18:42.185507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177756    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 16 02:18:42.185507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177761    2565 flags.go:64] FLAG: --pod-manifest-path=""
Sep 16 02:18:42.185507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177764    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 16 02:18:42.185507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177767    2565 flags.go:64] FLAG: --pods-per-core="0"
Sep 16 02:18:42.185507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177770    2565 flags.go:64] FLAG: --port="10250"
Sep 16 02:18:42.185507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177773    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 16 02:18:42.185507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177776    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02e12c051a6b7a49a"
Sep 16 02:18:42.185507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177779    2565 flags.go:64] FLAG: --qos-reserved=""
Sep 16 02:18:42.185507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177782    2565 flags.go:64] FLAG: --read-only-port="10255"
Sep 16 02:18:42.185507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177785    2565 flags.go:64] FLAG: --register-node="true"
Sep 16 02:18:42.185507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177788    2565 flags.go:64] FLAG: --register-with-taints=""
Sep 16 02:18:42.185507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177792    2565 flags.go:64] FLAG: --registry-burst="10"
Sep 16 02:18:42.185507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177795    2565 flags.go:64] FLAG: --registry-qps="5"
Sep 16 02:18:42.185507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177797    2565 flags.go:64] FLAG: --reserved-cpus=""
Sep 16 02:18:42.185507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177800    2565 flags.go:64] FLAG: --reserved-memory=""
Sep 16 02:18:42.185507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177804    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 16 02:18:42.185507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177807    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 16 02:18:42.185507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177810    2565 flags.go:64] FLAG: --rotate-certificates="false"
Sep 16 02:18:42.185507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177813    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 16 02:18:42.185507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177815    2565 flags.go:64] FLAG: --runonce="false"
Sep 16 02:18:42.185507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177818    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 16 02:18:42.186143 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177821    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 16 02:18:42.186143 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177824    2565 flags.go:64] FLAG: --seccomp-default="false"
Sep 16 02:18:42.186143 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177827    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 16 02:18:42.186143 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177830    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 16 02:18:42.186143 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177833    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 16 02:18:42.186143 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177836    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 16 02:18:42.186143 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177838    2565 flags.go:64] FLAG: --storage-driver-password="root"
Sep 16 02:18:42.186143 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177841    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 16 02:18:42.186143 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177844    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 16 02:18:42.186143 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177847    2565 flags.go:64] FLAG: --storage-driver-user="root"
Sep 16 02:18:42.186143 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177850    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 16 02:18:42.186143 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177854    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 16 02:18:42.186143 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177858    2565 flags.go:64] FLAG: --system-cgroups=""
Sep 16 02:18:42.186143 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177861    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 16 02:18:42.186143 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177866    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 16 02:18:42.186143 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177868    2565 flags.go:64] FLAG: --tls-cert-file=""
Sep 16 02:18:42.186143 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177872    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 16 02:18:42.186143 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177876    2565 flags.go:64] FLAG: --tls-min-version=""
Sep 16 02:18:42.186143 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177879    2565 flags.go:64] FLAG: --tls-private-key-file=""
Sep 16 02:18:42.186143 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177882    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 16 02:18:42.186143 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177884    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 16 02:18:42.186143 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177887    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 16 02:18:42.186143 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177890    2565 flags.go:64] FLAG: --v="2"
Sep 16 02:18:42.186143 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177894    2565 flags.go:64] FLAG: --version="false"
Sep 16 02:18:42.186143 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177898    2565 flags.go:64] FLAG: --vmodule=""
Sep 16 02:18:42.186754 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177901    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 16 02:18:42.186754 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.177904    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 16 02:18:42.186754 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178049    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 02:18:42.186754 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178053    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 02:18:42.186754 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178057    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 02:18:42.186754 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178060    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 02:18:42.186754 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178063    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 02:18:42.186754 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178066    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 02:18:42.186754 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178069    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 02:18:42.186754 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178071    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 02:18:42.186754 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178074    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 02:18:42.186754 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178076    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 02:18:42.186754 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178079    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 02:18:42.186754 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178082    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 02:18:42.186754 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178085    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 02:18:42.186754 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178087    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 02:18:42.186754 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178090    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 02:18:42.186754 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178093    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 02:18:42.186754 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178097    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 02:18:42.186754 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178100    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 02:18:42.187274 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178103    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 02:18:42.187274 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178105    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 02:18:42.187274 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178108    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 02:18:42.187274 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178111    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 02:18:42.187274 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178114    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 02:18:42.187274 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178117    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 02:18:42.187274 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178119    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 02:18:42.187274 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178122    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 02:18:42.187274 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178125    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 02:18:42.187274 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178127    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 02:18:42.187274 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178130    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 02:18:42.187274 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178132    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 02:18:42.187274 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178135    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 02:18:42.187274 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178137    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 02:18:42.187274 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178140    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 02:18:42.187274 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178142    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 02:18:42.187274 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178145    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 02:18:42.187274 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178147    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 02:18:42.187274 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178150    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 02:18:42.187274 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178153    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 02:18:42.187798 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178156    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 02:18:42.187798 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178158    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 02:18:42.187798 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178161    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 02:18:42.187798 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178164    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 02:18:42.187798 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178166    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 02:18:42.187798 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178169    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 02:18:42.187798 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178171    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 02:18:42.187798 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178174    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 02:18:42.187798 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178176    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 02:18:42.187798 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178179    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 02:18:42.187798 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178182    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 02:18:42.187798 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178185    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 02:18:42.187798 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178188    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 02:18:42.187798 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178190    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 02:18:42.187798 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178193    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 02:18:42.187798 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178196    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 02:18:42.187798 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178198    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 02:18:42.187798 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178201    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 02:18:42.187798 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178204    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 02:18:42.187798 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178206    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 02:18:42.188477 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178209    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 02:18:42.188477 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178212    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 02:18:42.188477 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178214    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 02:18:42.188477 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178217    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 02:18:42.188477 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178220    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 02:18:42.188477 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178223    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 02:18:42.188477 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178225    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 02:18:42.188477 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178228    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 02:18:42.188477 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178232    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 02:18:42.188477 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178236    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 02:18:42.188477 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178238    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 02:18:42.188477 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178241    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 02:18:42.188477 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178244    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 02:18:42.188477 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178246    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 02:18:42.188477 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178249    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 02:18:42.188477 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178251    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 02:18:42.188477 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178254    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 02:18:42.188477 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178257    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 02:18:42.188477 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178259    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 02:18:42.188983 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178262    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 02:18:42.188983 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178264    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 02:18:42.188983 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178267    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 02:18:42.188983 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178270    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 02:18:42.188983 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178273    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 02:18:42.188983 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178275    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 02:18:42.188983 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178278    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 02:18:42.188983 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178281    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 02:18:42.188983 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178284    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 02:18:42.188983 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178286    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 02:18:42.188983 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178289    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 02:18:42.188983 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178292    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 02:18:42.188983 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178294    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 02:18:42.188983 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178297    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 02:18:42.188983 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178301    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 02:18:42.188983 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178305    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 02:18:42.188983 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178308    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 02:18:42.188983 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178310    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 02:18:42.188983 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178313    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 02:18:42.189505 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178317    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 02:18:42.189505 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178320    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 02:18:42.189505 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.178323    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 02:18:42.189505 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.178328    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 02:18:42.189505 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.184438    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 16 02:18:42.189505 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.184450    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 16 02:18:42.189505 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.184468    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 16 02:18:42.189505 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.184476    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 16 02:18:42.189505 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184531    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 02:18:42.189505 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184537    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 02:18:42.189505 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184540    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 02:18:42.189505 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184543    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 02:18:42.189505 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184546    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 02:18:42.189505 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184549    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 02:18:42.190061 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184552    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 02:18:42.190061 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184555    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 02:18:42.190061 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184559    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 02:18:42.190061 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184562    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 02:18:42.190061 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184564    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 02:18:42.190061 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184567    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 02:18:42.190061 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184570    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 02:18:42.190061 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184572    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 02:18:42.190061 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184575    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 02:18:42.190061 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184578    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 02:18:42.190061 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184582    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 02:18:42.190061 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184584    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 02:18:42.190061 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184587    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 02:18:42.190061 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184590    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 02:18:42.190061 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184592    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 02:18:42.190061 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184595    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 02:18:42.190061 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184598    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 02:18:42.190061 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184601    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 02:18:42.190061 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184603    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 02:18:42.190061 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184606    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 02:18:42.190594 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184608    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 02:18:42.190594 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184611    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 02:18:42.190594 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184614    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 02:18:42.190594 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184616    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 02:18:42.190594 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184619    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 02:18:42.190594 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184622    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 02:18:42.190594 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184624    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 02:18:42.190594 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184627    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 02:18:42.190594 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184630    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 02:18:42.190594 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184634    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 02:18:42.190594 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184638    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 02:18:42.190594 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184641    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 02:18:42.190594 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184644    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 02:18:42.190594 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184647    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 02:18:42.190594 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184651    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 02:18:42.190594 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184654    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 02:18:42.190594 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184657    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 02:18:42.190594 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184660    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 02:18:42.190594 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184663    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 02:18:42.191227 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184666    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 02:18:42.191227 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184669    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 02:18:42.191227 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184672    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 02:18:42.191227 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184675    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 02:18:42.191227 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184678    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 02:18:42.191227 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184681    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 02:18:42.191227 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184683    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 02:18:42.191227 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184686    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 02:18:42.191227 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184688    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 02:18:42.191227 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184691    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 02:18:42.191227 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184694    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 02:18:42.191227 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184696    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 02:18:42.191227 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184699    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 02:18:42.191227 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184702    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 02:18:42.191227 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184705    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 02:18:42.191227 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184707    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 02:18:42.191227 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184711    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 02:18:42.191227 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184715    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 02:18:42.191227 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184718    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 02:18:42.191227 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184721    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 02:18:42.191828 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184723    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 02:18:42.191828 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184726    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 02:18:42.191828 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184729    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 02:18:42.191828 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184731    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 02:18:42.191828 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184734    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 02:18:42.191828 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184737    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 02:18:42.191828 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184739    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 02:18:42.191828 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184742    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 02:18:42.191828 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184745    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 02:18:42.191828 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184747    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 02:18:42.191828 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184750    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 02:18:42.191828 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184753    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 02:18:42.191828 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184756    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 02:18:42.191828 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184758    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 02:18:42.191828 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184761    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 02:18:42.191828 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184763    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 02:18:42.191828 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184766    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 02:18:42.191828 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184769    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 02:18:42.191828 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184772    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 02:18:42.191828 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184774    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 02:18:42.192376 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184777    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 02:18:42.192376 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184780    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 02:18:42.192376 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184782    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 02:18:42.192376 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184785    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 02:18:42.192376 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184789    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 02:18:42.192376 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184793    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 02:18:42.192376 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184795    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 02:18:42.192376 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184798    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 02:18:42.192376 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184801    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 02:18:42.192376 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184804    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 02:18:42.192376 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184806    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 02:18:42.192376 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184809    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 02:18:42.192376 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184812    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 02:18:42.192376 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184815    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 02:18:42.192780 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.184820    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 02:18:42.192780 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184922    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 02:18:42.192780 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184926    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 02:18:42.192780 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184929    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 02:18:42.192780 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184932    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 02:18:42.192780 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184936    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 02:18:42.192780 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184939    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 02:18:42.192780 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184942    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 02:18:42.192780 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184944    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 02:18:42.192780 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184947    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 02:18:42.192780 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184951    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 02:18:42.192780 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184954    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 02:18:42.192780 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184958    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 02:18:42.192780 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184960    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 02:18:42.192780 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184963    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 02:18:42.193153 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184966    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 02:18:42.193153 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184969    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 02:18:42.193153 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184972    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 02:18:42.193153 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184974    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 02:18:42.193153 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184977    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 02:18:42.193153 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184979    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 02:18:42.193153 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184982    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 02:18:42.193153 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184985    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 02:18:42.193153 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184987    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 02:18:42.193153 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184990    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 02:18:42.193153 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184992    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 02:18:42.193153 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184995    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 02:18:42.193153 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.184997    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 02:18:42.193153 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185000    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 02:18:42.193153 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185002    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 02:18:42.193153 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185005    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 02:18:42.193153 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185008    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 02:18:42.193153 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185011    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 02:18:42.193153 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185014    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 02:18:42.193153 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185017    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 02:18:42.193700 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185020    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 02:18:42.193700 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185022    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 02:18:42.193700 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185025    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 02:18:42.193700 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185028    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 02:18:42.193700 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185030    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 02:18:42.193700 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185033    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 02:18:42.193700 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185035    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 02:18:42.193700 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185038    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 02:18:42.193700 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185041    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 02:18:42.193700 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185044    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 02:18:42.193700 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185047    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 02:18:42.193700 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185049    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 02:18:42.193700 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185052    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 02:18:42.193700 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185054    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 02:18:42.193700 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185057    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 02:18:42.193700 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185060    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 02:18:42.193700 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185063    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 02:18:42.193700 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185065    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 02:18:42.193700 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185068    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 02:18:42.193700 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185070    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 02:18:42.194380 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185073    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 02:18:42.194380 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185076    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 02:18:42.194380 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185078    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 02:18:42.194380 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185081    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 02:18:42.194380 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185083    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 02:18:42.194380 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185086    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 02:18:42.194380 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185089    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 02:18:42.194380 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185091    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 02:18:42.194380 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185094    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 02:18:42.194380 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185097    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 02:18:42.194380 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185101    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 02:18:42.194380 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185104    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 02:18:42.194380 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185107    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 02:18:42.194380 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185110    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 02:18:42.194380 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185113    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 02:18:42.194380 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185116    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 02:18:42.194380 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185119    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 02:18:42.194380 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185121    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 02:18:42.194380 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185124    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 02:18:42.194380 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185127    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 02:18:42.194874 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185130    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 02:18:42.194874 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185132    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 02:18:42.194874 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185135    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 02:18:42.194874 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185137    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 02:18:42.194874 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185140    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 02:18:42.194874 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185143    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 02:18:42.194874 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185145    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 02:18:42.194874 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185148    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 02:18:42.194874 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185151    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 02:18:42.194874 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185153    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 02:18:42.194874 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185156    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 02:18:42.194874 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185158    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 02:18:42.194874 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185161    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 02:18:42.194874 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185163    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 02:18:42.194874 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185166    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 02:18:42.194874 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185169    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 02:18:42.194874 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185171    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 02:18:42.194874 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185174    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 02:18:42.194874 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185177    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 02:18:42.195538 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185186    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 02:18:42.195538 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185189    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 02:18:42.195538 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185192    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 02:18:42.195538 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185194    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 02:18:42.195538 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185197    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 02:18:42.195538 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:42.185200    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 02:18:42.195538 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.185205    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 02:18:42.195538 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.185295    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 16 02:18:42.195538 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.187027    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 16 02:18:42.195538 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.187849    2565 server.go:1019] "Starting client certificate rotation"
Sep 16 02:18:42.195538 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.187968    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 02:18:42.195538 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.188020    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 02:18:42.195538 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.190156    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 02:18:42.196073 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.194236    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 02:18:42.203581 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.203556    2565 log.go:25] "Validated CRI v1 runtime API"
Sep 16 02:18:42.205768 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.205746    2565 log.go:25] "Validated CRI v1 image API"
Sep 16 02:18:42.206617 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.206594    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 16 02:18:42.208457 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.208440    2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b136b052-dae6-44e2-ae29-952da6906be8:/dev/nvme0n1p3 b44dabde-c7ca-4c19-a719-39270a7ca2a0:/dev/nvme0n1p4]
Sep 16 02:18:42.208533 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.208456    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 16 02:18:42.212954 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.212849    2565 manager.go:216] Machine: {Timestamp:2026-09-16 02:18:42.21181073 +0000 UTC m=+0.262155225 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3091126 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28450de8d4ebafde25a8b69aeff20d SystemUUID:ec28450d-e8d4-ebaf-de25-a8b69aeff20d BootID:3b74e168-b317-4b70-a50c-409269dbaf01 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e2:a0:c8:09 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e2:a0:c8:09 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:d0:08:43:cf:34 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 16 02:18:42.212954 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.212943    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 16 02:18:42.213089 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.213009    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 16 02:18:42.214428 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.214413    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 02:18:42.215708 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.215681    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 16 02:18:42.215867 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.215713    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-62.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 16 02:18:42.216393 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.216380    2565 topology_manager.go:138] "Creating topology manager with none policy"
Sep 16 02:18:42.216450 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.216399    2565 container_manager_linux.go:309] "Creating device plugin manager"
Sep 16 02:18:42.216450 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.216409    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 02:18:42.216925 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.216913    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 02:18:42.217586 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.217574    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 16 02:18:42.219905 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.219891    2565 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 02:18:42.220029 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.220018    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 16 02:18:42.220084 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.220055    2565 kubelet.go:486] "Attempting to sync node with API server"
Sep 16 02:18:42.220084 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.220069    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 16 02:18:42.220084 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.220084    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 16 02:18:42.220206 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.220096    2565 kubelet.go:398] "Adding apiserver pod source"
Sep 16 02:18:42.220206 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.220108    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 16 02:18:42.220459 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.220439    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 02:18:42.220521 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.220468    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 02:18:42.223017 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.223000    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 16 02:18:42.225161 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.225146    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 16 02:18:42.225234 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.225175    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 16 02:18:42.226302 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.226289    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 16 02:18:42.226348 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.226309    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 16 02:18:42.226348 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.226316    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 16 02:18:42.226348 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.226321    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 16 02:18:42.226348 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.226329    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 16 02:18:42.226348 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.226334    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 16 02:18:42.226348 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.226347    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 16 02:18:42.226518 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.226375    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 16 02:18:42.226518 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.226383    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 16 02:18:42.226518 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.226388    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 16 02:18:42.226518 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.226400    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 16 02:18:42.226518 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.226405    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 16 02:18:42.227911 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.227900    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 16 02:18:42.227911 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.227910    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 16 02:18:42.230765 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:42.230730    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-62.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 16 02:18:42.230765 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:42.230748    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 16 02:18:42.230871 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.230827    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-62.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 16 02:18:42.231313 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.231301    2565 server.go:1268] "Started kubelet"
Sep 16 02:18:42.231396 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.231367    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 16 02:18:42.231489 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.231455    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 16 02:18:42.231536 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.231503    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 16 02:18:42.236233 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.235397    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 16 02:18:42.235513 ip-10-0-137-62 systemd[1]: Started Kubernetes Kubelet.
Sep 16 02:18:42.236989 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.236970    2565 server.go:310] "Adding debug handlers to kubelet server"
Sep 16 02:18:42.237958 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.237935    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tztgw"
Sep 16 02:18:42.239069 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:42.238327    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 16 02:18:42.240995 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:42.240225    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-62.ec2.internal.18d5ab9e0b3b9187  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-62.ec2.internal,UID:ip-10-0-137-62.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-62.ec2.internal,},FirstTimestamp:2026-09-16 02:18:42.231275911 +0000 UTC m=+0.281620395,LastTimestamp:2026-09-16 02:18:42.231275911 +0000 UTC m=+0.281620395,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-62.ec2.internal,}"
Sep 16 02:18:42.241610 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.241593    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 16 02:18:42.242072 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.242047    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 16 02:18:42.242249 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:42.242226    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Sep 16 02:18:42.242492 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.242476    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 16 02:18:42.242492 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.242493    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 16 02:18:42.242600 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.242478    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 16 02:18:42.242600 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.242570    2565 reconstruct.go:97] "Volume reconstruction finished"
Sep 16 02:18:42.242600 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.242576    2565 reconciler.go:29] "Reconciler: start to sync state"
Sep 16 02:18:42.243097 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.243083    2565 factory.go:153] Registering CRI-O factory
Sep 16 02:18:42.243157 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.243101    2565 factory.go:223] Registration of the crio container factory successfully
Sep 16 02:18:42.243157 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.243146    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 16 02:18:42.243157 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.243153    2565 factory.go:55] Registering systemd factory
Sep 16 02:18:42.243157 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.243158    2565 factory.go:223] Registration of the systemd container factory successfully
Sep 16 02:18:42.243306 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.243169    2565 factory.go:103] Registering Raw factory
Sep 16 02:18:42.243306 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.243178    2565 manager.go:1196] Started watching for new ooms in manager
Sep 16 02:18:42.243482 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.243471    2565 manager.go:349] Starting recovery of all containers
Sep 16 02:18:42.245146 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:42.245120    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 16 02:18:42.245325 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:42.245305    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-62.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 16 02:18:42.246035 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.246013    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tztgw"
Sep 16 02:18:42.254812 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.254685    2565 manager.go:354] Recovery completed
Sep 16 02:18:42.259195 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.259183    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 02:18:42.261042 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.261026    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 02:18:42.261119 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.261053    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 02:18:42.261119 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.261063    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientPID"
Sep 16 02:18:42.261653 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.261637    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 16 02:18:42.261653 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.261650    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 16 02:18:42.261653 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.261653    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 02:18:42.261816 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.261664    2565 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 02:18:42.262335 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.262323    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 02:18:42.262424 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.262345    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 02:18:42.262424 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.262354    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientPID"
Sep 16 02:18:42.262686 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.262672    2565 policy_none.go:49] "None policy: Start"
Sep 16 02:18:42.262686 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.262687    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 16 02:18:42.262776 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.262697    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 16 02:18:42.263550 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.263540    2565 policy_none.go:47] "Start"
Sep 16 02:18:42.286946 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.286930    2565 manager.go:337] "Starting Device Plugin manager"
Sep 16 02:18:42.287038 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:42.286964    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 16 02:18:42.287038 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.286974    2565 server.go:87] "Starting device plugin registration server"
Sep 16 02:18:42.287270 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.287253    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 16 02:18:42.287348 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.287268    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 16 02:18:42.287776 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.287433    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 16 02:18:42.287776 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.287557    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 16 02:18:42.287776 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.287574    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 16 02:18:42.288213 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:42.288189    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 16 02:18:42.288294 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:42.288248    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-62.ec2.internal\" not found"
Sep 16 02:18:42.383067 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.383036    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 16 02:18:42.384165 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.384146    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 16 02:18:42.384246 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.384197    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 16 02:18:42.384246 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.384218    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 16 02:18:42.384324 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:42.384290    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 16 02:18:42.386427 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.386400    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 02:18:42.387964 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.387949    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 02:18:42.388771 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.388753    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 02:18:42.388839 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.388786    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 02:18:42.388839 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.388798    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientPID"
Sep 16 02:18:42.388839 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.388817    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-62.ec2.internal"
Sep 16 02:18:42.397007 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.396994    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-62.ec2.internal"
Sep 16 02:18:42.397056 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:42.397013    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-62.ec2.internal\": node \"ip-10-0-137-62.ec2.internal\" not found"
Sep 16 02:18:42.412055 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:42.412019    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Sep 16 02:18:42.485077 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.485015    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"]
Sep 16 02:18:42.485176 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.485082    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 02:18:42.485863 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.485847    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 02:18:42.485925 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.485877    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 02:18:42.485925 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.485891    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientPID"
Sep 16 02:18:42.487121 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.487108    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 02:18:42.487243 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.487228    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal"
Sep 16 02:18:42.487288 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.487263    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 02:18:42.487790 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.487774    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 02:18:42.487859 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.487821    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 02:18:42.487859 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.487833    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientPID"
Sep 16 02:18:42.487951 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.487774    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 02:18:42.487951 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.487904    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 02:18:42.487951 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.487923    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientPID"
Sep 16 02:18:42.489169 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.489154    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Sep 16 02:18:42.489242 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.489178    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 02:18:42.489787 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.489770    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 02:18:42.489870 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.489803    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 02:18:42.489870 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.489817    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientPID"
Sep 16 02:18:42.512406 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:42.512387    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Sep 16 02:18:42.516935 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:42.516915    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-62.ec2.internal\" not found" node="ip-10-0-137-62.ec2.internal"
Sep 16 02:18:42.521231 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:42.521216    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-62.ec2.internal\" not found" node="ip-10-0-137-62.ec2.internal"
Sep 16 02:18:42.543931 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.543910    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b013639e5bdde50b7081afc18d07a1f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal\" (UID: \"1b013639e5bdde50b7081afc18d07a1f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Sep 16 02:18:42.544000 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.543942    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9119e0687bd7d52fed7d7ab65f2ce9e1-config\") pod \"kube-apiserver-proxy-ip-10-0-137-62.ec2.internal\" (UID: \"9119e0687bd7d52fed7d7ab65f2ce9e1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal"
Sep 16 02:18:42.544000 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.543971    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1b013639e5bdde50b7081afc18d07a1f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal\" (UID: \"1b013639e5bdde50b7081afc18d07a1f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Sep 16 02:18:42.613462 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:42.613443    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Sep 16 02:18:42.644196 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.644177    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9119e0687bd7d52fed7d7ab65f2ce9e1-config\") pod \"kube-apiserver-proxy-ip-10-0-137-62.ec2.internal\" (UID: \"9119e0687bd7d52fed7d7ab65f2ce9e1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal"
Sep 16 02:18:42.644257 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.644201    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1b013639e5bdde50b7081afc18d07a1f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal\" (UID: \"1b013639e5bdde50b7081afc18d07a1f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Sep 16 02:18:42.644257 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.644235    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b013639e5bdde50b7081afc18d07a1f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal\" (UID: \"1b013639e5bdde50b7081afc18d07a1f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Sep 16 02:18:42.644318 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.644283    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9119e0687bd7d52fed7d7ab65f2ce9e1-config\") pod \"kube-apiserver-proxy-ip-10-0-137-62.ec2.internal\" (UID: \"9119e0687bd7d52fed7d7ab65f2ce9e1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal"
Sep 16 02:18:42.644318 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.644294    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1b013639e5bdde50b7081afc18d07a1f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal\" (UID: \"1b013639e5bdde50b7081afc18d07a1f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Sep 16 02:18:42.644395 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.644283    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b013639e5bdde50b7081afc18d07a1f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal\" (UID: \"1b013639e5bdde50b7081afc18d07a1f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Sep 16 02:18:42.713500 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:42.713479    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Sep 16 02:18:42.814101 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:42.814056    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Sep 16 02:18:42.819249 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.819234    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal"
Sep 16 02:18:42.824120 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:42.823754    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Sep 16 02:18:42.914770 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:42.914748    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Sep 16 02:18:43.015190 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:43.015167    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Sep 16 02:18:43.117707 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:43.117683    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Sep 16 02:18:43.188748 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:43.188721    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 16 02:18:43.189100 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:43.188844    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 02:18:43.218311 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:43.218292    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Sep 16 02:18:43.250099 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:43.250062    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-15 02:13:42 +0000 UTC" deadline="2028-03-22 02:12:48.578416331 +0000 UTC"
Sep 16 02:18:43.250099 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:43.250089    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13271h54m5.328330864s"
Sep 16 02:18:43.319228 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:43.319203    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Sep 16 02:18:43.332308 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:43.332275    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9119e0687bd7d52fed7d7ab65f2ce9e1.slice/crio-c82b5386b4a585ca3025622a6797013c1246f22436febf52ac96e885a034995a WatchSource:0}: Error finding container c82b5386b4a585ca3025622a6797013c1246f22436febf52ac96e885a034995a: Status 404 returned error can't find the container with id c82b5386b4a585ca3025622a6797013c1246f22436febf52ac96e885a034995a
Sep 16 02:18:43.332654 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:43.332634    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b013639e5bdde50b7081afc18d07a1f.slice/crio-09aac7d03dd8acda844990943288ae7745305b5b8cb36820d8880cfdc9d44a71 WatchSource:0}: Error finding container 09aac7d03dd8acda844990943288ae7745305b5b8cb36820d8880cfdc9d44a71: Status 404 returned error can't find the container with id 09aac7d03dd8acda844990943288ae7745305b5b8cb36820d8880cfdc9d44a71
Sep 16 02:18:43.336706 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:43.336692    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 02:18:43.383822 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:43.383804    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 02:18:43.387816 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:43.387768    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal" event={"ID":"1b013639e5bdde50b7081afc18d07a1f","Type":"ContainerStarted","Data":"09aac7d03dd8acda844990943288ae7745305b5b8cb36820d8880cfdc9d44a71"}
Sep 16 02:18:43.388932 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:43.388909    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal" event={"ID":"9119e0687bd7d52fed7d7ab65f2ce9e1","Type":"ContainerStarted","Data":"c82b5386b4a585ca3025622a6797013c1246f22436febf52ac96e885a034995a"}
Sep 16 02:18:43.419790 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:43.419766    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Sep 16 02:18:43.525156 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:43.525130    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Sep 16 02:18:43.620180 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:43.620129    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 02:18:43.643041 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:43.643019    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Sep 16 02:18:43.653614 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:43.653594    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 02:18:43.654995 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:43.654981    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal"
Sep 16 02:18:43.662261 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:43.662244    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 02:18:43.757043 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:43.756754    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 02:18:44.221337 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.221304    2565 apiserver.go:52] "Watching apiserver"
Sep 16 02:18:44.228390 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.228363    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 16 02:18:44.229692 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.229662    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-j8mcn","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhqs","openshift-cluster-node-tuning-operator/tuned-vrb2j","openshift-multus/network-metrics-daemon-p7rcn","openshift-network-diagnostics/network-check-target-2mmw9","kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal","openshift-dns/node-resolver-znbz8","openshift-image-registry/node-ca-jhvrv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal","openshift-multus/multus-4sw86","openshift-multus/multus-additional-cni-plugins-5nl9d","openshift-network-operator/iptables-alerter-682bh","openshift-ovn-kubernetes/ovnkube-node-8s2zg","kube-system/global-pull-secret-syncer-5z7kc"]
Sep 16 02:18:44.231598 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.231571    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-znbz8"
Sep 16 02:18:44.233127 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.233103    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.234113 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.233989    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 16 02:18:44.234113 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.234094    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xb5rd\""
Sep 16 02:18:44.234296 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.234281    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 16 02:18:44.234847 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.234625    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.235631 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.235596    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2cb98\""
Sep 16 02:18:44.235949 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.235930    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 16 02:18:44.236237 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.236213    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 16 02:18:44.236334 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.236286    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 16 02:18:44.236424 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.236394    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 16 02:18:44.236608 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.236516    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 16 02:18:44.236608 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.236218    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 16 02:18:44.236803 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.236783    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:18:44.236905 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:44.236878    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7rcn" podUID="57b965f8-cef0-417c-b3a8-8c5c1a0883bf"
Sep 16 02:18:44.236992 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.236968    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 16 02:18:44.236992 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.236978    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 16 02:18:44.237105 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.237055    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p94bc\""
Sep 16 02:18:44.238163 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.238142    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:18:44.238276 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:44.238252    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mmw9" podUID="f05bbb56-ee96-4d5c-918d-18cddf968e87"
Sep 16 02:18:44.241629 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.241612    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:18:44.241715 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:44.241679    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5z7kc" podUID="4b569dfd-1a91-4dfd-a893-355d2a94681c"
Sep 16 02:18:44.242909 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.242888    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 16 02:18:44.243571 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.243547    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jhvrv"
Sep 16 02:18:44.245008 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.244971    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j8mcn"
Sep 16 02:18:44.245444 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.245426    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 16 02:18:44.245924 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.245846    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4wvg9\""
Sep 16 02:18:44.245924 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.245862    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 16 02:18:44.245924 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.245884    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 16 02:18:44.246856 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.246761    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhqs"
Sep 16 02:18:44.247476 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.247258    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 16 02:18:44.248456 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.247953    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 16 02:18:44.248456 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.247973    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-k5js4\""
Sep 16 02:18:44.249682 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.249169    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.252142 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.251709    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxv5p\" (UniqueName: \"kubernetes.io/projected/02463170-036b-4e43-8335-bb6aff297805-kube-api-access-mxv5p\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.252142 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.251756    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4b569dfd-1a91-4dfd-a893-355d2a94681c-dbus\") pod \"global-pull-secret-syncer-5z7kc\" (UID: \"4b569dfd-1a91-4dfd-a893-355d2a94681c\") " pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:18:44.252142 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.251791    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.252142 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.251829    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a767a10-1fc2-4f3c-b655-74c71d814656-host\") pod \"node-ca-jhvrv\" (UID: \"6a767a10-1fc2-4f3c-b655-74c71d814656\") " pod="openshift-image-registry/node-ca-jhvrv"
Sep 16 02:18:44.252142 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.251876    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-var-lib-openvswitch\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.252142 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.251908    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-run-openvswitch\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.252142 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.251943    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-etc-sysctl-d\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.252142 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.251979    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txxz7\" (UniqueName: \"kubernetes.io/projected/57b965f8-cef0-417c-b3a8-8c5c1a0883bf-kube-api-access-txxz7\") pod \"network-metrics-daemon-p7rcn\" (UID: \"57b965f8-cef0-417c-b3a8-8c5c1a0883bf\") " pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:18:44.252142 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.252017    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f343f46e-3e8c-4d87-a516-5e37eeb16035-tmp-dir\") pod \"node-resolver-znbz8\" (UID: \"f343f46e-3e8c-4d87-a516-5e37eeb16035\") " pod="openshift-dns/node-resolver-znbz8"
Sep 16 02:18:44.252142 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.252050    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-run-systemd\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.252142 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.252078    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-run-ovn\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.252142 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.252116    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2s55\" (UniqueName: \"kubernetes.io/projected/f05bbb56-ee96-4d5c-918d-18cddf968e87-kube-api-access-d2s55\") pod \"network-check-target-2mmw9\" (UID: \"f05bbb56-ee96-4d5c-918d-18cddf968e87\") " pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:18:44.252779 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.252171    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-etc-systemd\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.252779 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.252202    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57b965f8-cef0-417c-b3a8-8c5c1a0883bf-metrics-certs\") pod \"network-metrics-daemon-p7rcn\" (UID: \"57b965f8-cef0-417c-b3a8-8c5c1a0883bf\") " pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:18:44.252779 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.252233    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-log-socket\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.252779 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.252263    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-host-run-ovn-kubernetes\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.252779 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.252294    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-etc-sysctl-conf\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.252779 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.252327    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-lib-modules\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.252779 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.252359    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-tmp\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.252779 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.252391    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4b569dfd-1a91-4dfd-a893-355d2a94681c-kubelet-config\") pod \"global-pull-secret-syncer-5z7kc\" (UID: \"4b569dfd-1a91-4dfd-a893-355d2a94681c\") " pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:18:44.252779 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.252425    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-node-log\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.252779 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.252472    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-host-cni-netd\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.252779 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.252510    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6a767a10-1fc2-4f3c-b655-74c71d814656-serviceca\") pod \"node-ca-jhvrv\" (UID: \"6a767a10-1fc2-4f3c-b655-74c71d814656\") " pod="openshift-image-registry/node-ca-jhvrv"
Sep 16 02:18:44.252779 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.252550    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-etc-sysconfig\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.252779 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.252579    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-run\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.252779 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.252608    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-host-cni-bin\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.252779 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.252646    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/02463170-036b-4e43-8335-bb6aff297805-ovnkube-config\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.252779 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.252680    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/02463170-036b-4e43-8335-bb6aff297805-ovnkube-script-lib\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.252779 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.252716    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f343f46e-3e8c-4d87-a516-5e37eeb16035-hosts-file\") pod \"node-resolver-znbz8\" (UID: \"f343f46e-3e8c-4d87-a516-5e37eeb16035\") " pod="openshift-dns/node-resolver-znbz8"
Sep 16 02:18:44.253640 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.252753    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-systemd-units\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.253640 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.252779    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-host-slash\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.253640 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.252813    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-etc-openvswitch\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.253640 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.252824    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 16 02:18:44.253640 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.252851    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9wk7\" (UniqueName: \"kubernetes.io/projected/f343f46e-3e8c-4d87-a516-5e37eeb16035-kube-api-access-f9wk7\") pod \"node-resolver-znbz8\" (UID: \"f343f46e-3e8c-4d87-a516-5e37eeb16035\") " pod="openshift-dns/node-resolver-znbz8"
Sep 16 02:18:44.253640 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.252892    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f68pv\" (UniqueName: \"kubernetes.io/projected/6a767a10-1fc2-4f3c-b655-74c71d814656-kube-api-access-f68pv\") pod \"node-ca-jhvrv\" (UID: \"6a767a10-1fc2-4f3c-b655-74c71d814656\") " pod="openshift-image-registry/node-ca-jhvrv"
Sep 16 02:18:44.253640 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.253080    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 16 02:18:44.253640 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.253190    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 16 02:18:44.253640 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.252935    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-etc-modprobe-d\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.254070 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.253672    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-etc-kubernetes\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.254070 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.253708    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-sys\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.254070 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.253739    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-var-lib-kubelet\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.254070 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.253780    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xn4h\" (UniqueName: \"kubernetes.io/projected/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-kube-api-access-7xn4h\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.254070 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.253787    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 16 02:18:44.254070 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.253984    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b569dfd-1a91-4dfd-a893-355d2a94681c-original-pull-secret\") pod \"global-pull-secret-syncer-5z7kc\" (UID: \"4b569dfd-1a91-4dfd-a893-355d2a94681c\") " pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:18:44.254070 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.254023    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/02463170-036b-4e43-8335-bb6aff297805-env-overrides\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.254420 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.254142    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5nl9d"
Sep 16 02:18:44.254420 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.254185    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-host\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.254420 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.254191    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sv6k9\""
Sep 16 02:18:44.254420 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.254228    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-etc-tuned\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.254420 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.254266    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-host-kubelet\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.254420 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.254299    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-host-run-netns\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.254420 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.254334    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/02463170-036b-4e43-8335-bb6aff297805-ovn-node-metrics-cert\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.254856 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.254646    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-682bh"
Sep 16 02:18:44.254856 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.254708    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 16 02:18:44.254856 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.254719    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 16 02:18:44.255003 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.254877    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 16 02:18:44.255059 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.255011    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nkq6s\""
Sep 16 02:18:44.258085 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.257435    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 16 02:18:44.258085 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.257537    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5z8vk\""
Sep 16 02:18:44.258085 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.257640    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 16 02:18:44.258085 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.257752    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 16 02:18:44.258085 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.258009    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 16 02:18:44.258694 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.258214    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nb2cv\""
Sep 16 02:18:44.259268 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.259088    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 16 02:18:44.263480 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.263385    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 02:18:44.282517 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.282501    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-s5rc4"
Sep 16 02:18:44.288324 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.288301    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-s5rc4"
Sep 16 02:18:44.344286 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.344251    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 16 02:18:44.354864 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.354836    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-host-var-lib-cni-multus\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.354967 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.354876    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-hostroot\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.354967 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.354902    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xpv8\" (UniqueName: \"kubernetes.io/projected/f085f4b0-6a6b-4c05-b83e-45418e1df86b-kube-api-access-4xpv8\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.354967 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.354951    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d-registration-dir\") pod \"aws-ebs-csi-driver-node-jhhqs\" (UID: \"d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhqs"
Sep 16 02:18:44.355131 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.354979    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64xv5\" (UniqueName: \"kubernetes.io/projected/d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d-kube-api-access-64xv5\") pod \"aws-ebs-csi-driver-node-jhhqs\" (UID: \"d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhqs"
Sep 16 02:18:44.355131 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355005    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-host\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.355131 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355032    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-multus-socket-dir-parent\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.355131 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355056    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-host-run-multus-certs\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.355131 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355079    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e3d5667-b41e-4ff5-beb3-ebe791b48183-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5nl9d\" (UID: \"0e3d5667-b41e-4ff5-beb3-ebe791b48183\") " pod="openshift-multus/multus-additional-cni-plugins-5nl9d"
Sep 16 02:18:44.355131 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355088    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-host\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.355131 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355104    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-host-kubelet\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.355515 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355140    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxv5p\" (UniqueName: \"kubernetes.io/projected/02463170-036b-4e43-8335-bb6aff297805-kube-api-access-mxv5p\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.355515 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355158    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4b569dfd-1a91-4dfd-a893-355d2a94681c-dbus\") pod \"global-pull-secret-syncer-5z7kc\" (UID: \"4b569dfd-1a91-4dfd-a893-355d2a94681c\") " pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:18:44.355515 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355174    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-host-kubelet\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.355515 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355178    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e3d5667-b41e-4ff5-beb3-ebe791b48183-cni-binary-copy\") pod \"multus-additional-cni-plugins-5nl9d\" (UID: \"0e3d5667-b41e-4ff5-beb3-ebe791b48183\") " pod="openshift-multus/multus-additional-cni-plugins-5nl9d"
Sep 16 02:18:44.355515 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355223    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0e3d5667-b41e-4ff5-beb3-ebe791b48183-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5nl9d\" (UID: \"0e3d5667-b41e-4ff5-beb3-ebe791b48183\") " pod="openshift-multus/multus-additional-cni-plugins-5nl9d"
Sep 16 02:18:44.355515 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355229    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4b569dfd-1a91-4dfd-a893-355d2a94681c-dbus\") pod \"global-pull-secret-syncer-5z7kc\" (UID: \"4b569dfd-1a91-4dfd-a893-355d2a94681c\") " pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:18:44.355515 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355249    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdpb8\" (UniqueName: \"kubernetes.io/projected/0e3d5667-b41e-4ff5-beb3-ebe791b48183-kube-api-access-fdpb8\") pod \"multus-additional-cni-plugins-5nl9d\" (UID: \"0e3d5667-b41e-4ff5-beb3-ebe791b48183\") " pod="openshift-multus/multus-additional-cni-plugins-5nl9d"
Sep 16 02:18:44.355515 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355280    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jhhqs\" (UID: \"d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhqs"
Sep 16 02:18:44.355515 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355301    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f085f4b0-6a6b-4c05-b83e-45418e1df86b-cni-binary-copy\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.355515 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355316    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a767a10-1fc2-4f3c-b655-74c71d814656-host\") pod \"node-ca-jhvrv\" (UID: \"6a767a10-1fc2-4f3c-b655-74c71d814656\") " pod="openshift-image-registry/node-ca-jhvrv"
Sep 16 02:18:44.355515 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355343    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-run-openvswitch\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.355515 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355368    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-etc-sysctl-d\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.355515 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355390    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a767a10-1fc2-4f3c-b655-74c71d814656-host\") pod \"node-ca-jhvrv\" (UID: \"6a767a10-1fc2-4f3c-b655-74c71d814656\") " pod="openshift-image-registry/node-ca-jhvrv"
Sep 16 02:18:44.355515 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355420    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-cnibin\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.355515 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355430    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-run-openvswitch\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.355515 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355448    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d-socket-dir\") pod \"aws-ebs-csi-driver-node-jhhqs\" (UID: \"d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhqs"
Sep 16 02:18:44.355515 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355472    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f343f46e-3e8c-4d87-a516-5e37eeb16035-tmp-dir\") pod \"node-resolver-znbz8\" (UID: \"f343f46e-3e8c-4d87-a516-5e37eeb16035\") " pod="openshift-dns/node-resolver-znbz8"
Sep 16 02:18:44.356487 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355492    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-run-systemd\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.356487 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355512    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-run-ovn\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.356487 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355548    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-etc-sysctl-d\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.356487 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355556    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-etc-systemd\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.356487 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355582    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57b965f8-cef0-417c-b3a8-8c5c1a0883bf-metrics-certs\") pod \"network-metrics-daemon-p7rcn\" (UID: \"57b965f8-cef0-417c-b3a8-8c5c1a0883bf\") " pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:18:44.356487 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355587    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-run-systemd\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.356487 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355608    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e3d5667-b41e-4ff5-beb3-ebe791b48183-system-cni-dir\") pod \"multus-additional-cni-plugins-5nl9d\" (UID: \"0e3d5667-b41e-4ff5-beb3-ebe791b48183\") " pod="openshift-multus/multus-additional-cni-plugins-5nl9d"
Sep 16 02:18:44.356487 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355636    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-etc-systemd\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.356487 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355637    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d-device-dir\") pod \"aws-ebs-csi-driver-node-jhhqs\" (UID: \"d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhqs"
Sep 16 02:18:44.356487 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355668    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-host-run-ovn-kubernetes\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.356487 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355692    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-lib-modules\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.356487 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355714    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-tmp\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.356487 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:44.355738    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 02:18:44.356487 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355780    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4b569dfd-1a91-4dfd-a893-355d2a94681c-kubelet-config\") pod \"global-pull-secret-syncer-5z7kc\" (UID: \"4b569dfd-1a91-4dfd-a893-355d2a94681c\") " pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:18:44.356487 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355808    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f343f46e-3e8c-4d87-a516-5e37eeb16035-tmp-dir\") pod \"node-resolver-znbz8\" (UID: \"f343f46e-3e8c-4d87-a516-5e37eeb16035\") " pod="openshift-dns/node-resolver-znbz8"
Sep 16 02:18:44.356487 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355823    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-run-ovn\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.356487 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:44.355820    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57b965f8-cef0-417c-b3a8-8c5c1a0883bf-metrics-certs podName:57b965f8-cef0-417c-b3a8-8c5c1a0883bf nodeName:}" failed. No retries permitted until 2026-09-16 02:18:44.85578653 +0000 UTC m=+2.906131020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/57b965f8-cef0-417c-b3a8-8c5c1a0883bf-metrics-certs") pod "network-metrics-daemon-p7rcn" (UID: "57b965f8-cef0-417c-b3a8-8c5c1a0883bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 02:18:44.357352 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355857    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-host-run-ovn-kubernetes\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.357352 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.355738    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4b569dfd-1a91-4dfd-a893-355d2a94681c-kubelet-config\") pod \"global-pull-secret-syncer-5z7kc\" (UID: \"4b569dfd-1a91-4dfd-a893-355d2a94681c\") " pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:18:44.357352 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356021    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-host-var-lib-cni-bin\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.357352 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356034    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-lib-modules\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.357352 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356054    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f085f4b0-6a6b-4c05-b83e-45418e1df86b-multus-daemon-config\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.357352 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356084    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-node-log\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.357352 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356133    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-node-log\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.357352 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356161    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6a767a10-1fc2-4f3c-b655-74c71d814656-serviceca\") pod \"node-ca-jhvrv\" (UID: \"6a767a10-1fc2-4f3c-b655-74c71d814656\") " pod="openshift-image-registry/node-ca-jhvrv"
Sep 16 02:18:44.357352 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356191    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/02463170-036b-4e43-8335-bb6aff297805-ovnkube-config\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.357352 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356217    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-systemd-units\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.357352 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356243    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-etc-openvswitch\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.357352 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356269    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-etc-modprobe-d\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.357352 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356296    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-etc-kubernetes\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.357352 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356325    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-host-run-k8s-cni-cncf-io\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.357352 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356350    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-host-var-lib-kubelet\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.357352 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356395    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5ded3669-6a0b-4d56-8617-e0291ab7f5bd-host-slash\") pod \"iptables-alerter-682bh\" (UID: \"5ded3669-6a0b-4d56-8617-e0291ab7f5bd\") " pod="openshift-network-operator/iptables-alerter-682bh"
Sep 16 02:18:44.357352 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356426    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9wk7\" (UniqueName: \"kubernetes.io/projected/f343f46e-3e8c-4d87-a516-5e37eeb16035-kube-api-access-f9wk7\") pod \"node-resolver-znbz8\" (UID: \"f343f46e-3e8c-4d87-a516-5e37eeb16035\") " pod="openshift-dns/node-resolver-znbz8"
Sep 16 02:18:44.358294 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356452    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-sys\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.358294 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356479    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-etc-kubernetes\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.358294 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356507    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e92efdb-9c85-4515-9195-1fdb836771ae-konnectivity-ca\") pod \"konnectivity-agent-j8mcn\" (UID: \"7e92efdb-9c85-4515-9195-1fdb836771ae\") " pod="kube-system/konnectivity-agent-j8mcn"
Sep 16 02:18:44.358294 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356538    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d-etc-selinux\") pod \"aws-ebs-csi-driver-node-jhhqs\" (UID: \"d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhqs"
Sep 16 02:18:44.358294 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356530    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 16 02:18:44.358294 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356571    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/02463170-036b-4e43-8335-bb6aff297805-env-overrides\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.358294 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356618    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-etc-tuned\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.358294 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356640    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-system-cni-dir\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.358294 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356671    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-host-run-netns\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.358294 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356718    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6a767a10-1fc2-4f3c-b655-74c71d814656-serviceca\") pod \"node-ca-jhvrv\" (UID: \"6a767a10-1fc2-4f3c-b655-74c71d814656\") " pod="openshift-image-registry/node-ca-jhvrv"
Sep 16 02:18:44.358294 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356720    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfgcj\" (UniqueName: \"kubernetes.io/projected/5ded3669-6a0b-4d56-8617-e0291ab7f5bd-kube-api-access-mfgcj\") pod \"iptables-alerter-682bh\" (UID: \"5ded3669-6a0b-4d56-8617-e0291ab7f5bd\") " pod="openshift-network-operator/iptables-alerter-682bh"
Sep 16 02:18:44.358294 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356787    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-host-run-netns\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.358294 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356795    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-systemd-units\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.358294 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356813    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/02463170-036b-4e43-8335-bb6aff297805-ovn-node-metrics-cert\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.358294 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356857    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5ded3669-6a0b-4d56-8617-e0291ab7f5bd-iptables-alerter-script\") pod \"iptables-alerter-682bh\" (UID: \"5ded3669-6a0b-4d56-8617-e0291ab7f5bd\") " pod="openshift-network-operator/iptables-alerter-682bh"
Sep 16 02:18:44.358294 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356881    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-etc-openvswitch\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.358294 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356886    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d-sys-fs\") pod \"aws-ebs-csi-driver-node-jhhqs\" (UID: \"d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhqs"
Sep 16 02:18:44.359196 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356926    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.359196 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356951    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-var-lib-openvswitch\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.359196 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356977    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txxz7\" (UniqueName: \"kubernetes.io/projected/57b965f8-cef0-417c-b3a8-8c5c1a0883bf-kube-api-access-txxz7\") pod \"network-metrics-daemon-p7rcn\" (UID: \"57b965f8-cef0-417c-b3a8-8c5c1a0883bf\") " pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:18:44.359196 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356997    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-multus-conf-dir\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.359196 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.356987    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-etc-modprobe-d\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.359196 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.357022    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e3d5667-b41e-4ff5-beb3-ebe791b48183-cnibin\") pod \"multus-additional-cni-plugins-5nl9d\" (UID: \"0e3d5667-b41e-4ff5-beb3-ebe791b48183\") " pod="openshift-multus/multus-additional-cni-plugins-5nl9d"
Sep 16 02:18:44.359196 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.357045    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0e3d5667-b41e-4ff5-beb3-ebe791b48183-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5nl9d\" (UID: \"0e3d5667-b41e-4ff5-beb3-ebe791b48183\") " pod="openshift-multus/multus-additional-cni-plugins-5nl9d"
Sep 16 02:18:44.359196 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.357055    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/02463170-036b-4e43-8335-bb6aff297805-ovnkube-config\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.359196 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.357072    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2s55\" (UniqueName: \"kubernetes.io/projected/f05bbb56-ee96-4d5c-918d-18cddf968e87-kube-api-access-d2s55\") pod \"network-check-target-2mmw9\" (UID: \"f05bbb56-ee96-4d5c-918d-18cddf968e87\") " pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:18:44.359196 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.357091    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-etc-kubernetes\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.359196 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.357110    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-log-socket\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.359196 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.357182    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-host-run-netns\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.359196 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.357228    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-log-socket\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.359196 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.357655    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-etc-sysctl-conf\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.359196 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.357702    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-host-cni-netd\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.359196 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.357730    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-etc-sysconfig\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.359196 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.357756    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-run\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.360055 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.357782    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e92efdb-9c85-4515-9195-1fdb836771ae-agent-certs\") pod \"konnectivity-agent-j8mcn\" (UID: \"7e92efdb-9c85-4515-9195-1fdb836771ae\") " pod="kube-system/konnectivity-agent-j8mcn"
Sep 16 02:18:44.360055 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.357807    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-host-cni-bin\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.360055 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.357828    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/02463170-036b-4e43-8335-bb6aff297805-ovnkube-script-lib\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.360055 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.357853    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f343f46e-3e8c-4d87-a516-5e37eeb16035-hosts-file\") pod \"node-resolver-znbz8\" (UID: \"f343f46e-3e8c-4d87-a516-5e37eeb16035\") " pod="openshift-dns/node-resolver-znbz8"
Sep 16 02:18:44.360055 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.357873    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-host-slash\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.360055 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.357871    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-sys\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.360055 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.357900    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f68pv\" (UniqueName: \"kubernetes.io/projected/6a767a10-1fc2-4f3c-b655-74c71d814656-kube-api-access-f68pv\") pod \"node-ca-jhvrv\" (UID: \"6a767a10-1fc2-4f3c-b655-74c71d814656\") " pod="openshift-image-registry/node-ca-jhvrv"
Sep 16 02:18:44.360055 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.357928    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xn4h\" (UniqueName: \"kubernetes.io/projected/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-kube-api-access-7xn4h\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.360055 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.357945    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-var-lib-openvswitch\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.360055 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.357965    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b569dfd-1a91-4dfd-a893-355d2a94681c-original-pull-secret\") pod \"global-pull-secret-syncer-5z7kc\" (UID: \"4b569dfd-1a91-4dfd-a893-355d2a94681c\") " pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:18:44.360055 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.358032    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-var-lib-kubelet\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.360055 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:44.358049    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 02:18:44.360055 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.358064    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-multus-cni-dir\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.360055 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:44.358103    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b569dfd-1a91-4dfd-a893-355d2a94681c-original-pull-secret podName:4b569dfd-1a91-4dfd-a893-355d2a94681c nodeName:}" failed. No retries permitted until 2026-09-16 02:18:44.858083719 +0000 UTC m=+2.908428208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b569dfd-1a91-4dfd-a893-355d2a94681c-original-pull-secret") pod "global-pull-secret-syncer-5z7kc" (UID: "4b569dfd-1a91-4dfd-a893-355d2a94681c") : object "kube-system"/"original-pull-secret" not registered
Sep 16 02:18:44.360055 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.358300    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-var-lib-kubelet\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.360055 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.358363    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-etc-sysconfig\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.360055 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.358526    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/02463170-036b-4e43-8335-bb6aff297805-env-overrides\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.360859 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.358558    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-run\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.360859 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.358639    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f343f46e-3e8c-4d87-a516-5e37eeb16035-hosts-file\") pod \"node-resolver-znbz8\" (UID: \"f343f46e-3e8c-4d87-a516-5e37eeb16035\") " pod="openshift-dns/node-resolver-znbz8"
Sep 16 02:18:44.360859 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.358711    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-host-cni-netd\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.360859 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.358811    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-etc-sysctl-conf\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.360859 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.358849    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.360859 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.358860    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-host-cni-bin\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.360859 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.358916    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02463170-036b-4e43-8335-bb6aff297805-host-slash\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.360859 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.359568    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/02463170-036b-4e43-8335-bb6aff297805-ovnkube-script-lib\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.361322 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.361186    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-etc-tuned\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.361515 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.361430    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/02463170-036b-4e43-8335-bb6aff297805-ovn-node-metrics-cert\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.362312 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.362271    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-tmp\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.363499 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:44.363274    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 02:18:44.363499 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:44.363298    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 02:18:44.363499 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:44.363312    2565 projected.go:196] Error preparing data for projected volume kube-api-access-d2s55 for pod openshift-network-diagnostics/network-check-target-2mmw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 02:18:44.363499 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:44.363468    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f05bbb56-ee96-4d5c-918d-18cddf968e87-kube-api-access-d2s55 podName:f05bbb56-ee96-4d5c-918d-18cddf968e87 nodeName:}" failed. No retries permitted until 2026-09-16 02:18:44.86345115 +0000 UTC m=+2.913795640 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-d2s55" (UniqueName: "kubernetes.io/projected/f05bbb56-ee96-4d5c-918d-18cddf968e87-kube-api-access-d2s55") pod "network-check-target-2mmw9" (UID: "f05bbb56-ee96-4d5c-918d-18cddf968e87") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 02:18:44.366110 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.365888    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txxz7\" (UniqueName: \"kubernetes.io/projected/57b965f8-cef0-417c-b3a8-8c5c1a0883bf-kube-api-access-txxz7\") pod \"network-metrics-daemon-p7rcn\" (UID: \"57b965f8-cef0-417c-b3a8-8c5c1a0883bf\") " pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:18:44.366219 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.366128    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xn4h\" (UniqueName: \"kubernetes.io/projected/e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9-kube-api-access-7xn4h\") pod \"tuned-vrb2j\" (UID: \"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.367125 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.367100    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxv5p\" (UniqueName: \"kubernetes.io/projected/02463170-036b-4e43-8335-bb6aff297805-kube-api-access-mxv5p\") pod \"ovnkube-node-8s2zg\" (UID: \"02463170-036b-4e43-8335-bb6aff297805\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.367549 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.367526    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9wk7\" (UniqueName: \"kubernetes.io/projected/f343f46e-3e8c-4d87-a516-5e37eeb16035-kube-api-access-f9wk7\") pod \"node-resolver-znbz8\" (UID: \"f343f46e-3e8c-4d87-a516-5e37eeb16035\") " pod="openshift-dns/node-resolver-znbz8"
Sep 16 02:18:44.368774 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.368752    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f68pv\" (UniqueName: \"kubernetes.io/projected/6a767a10-1fc2-4f3c-b655-74c71d814656-kube-api-access-f68pv\") pod \"node-ca-jhvrv\" (UID: \"6a767a10-1fc2-4f3c-b655-74c71d814656\") " pod="openshift-image-registry/node-ca-jhvrv"
Sep 16 02:18:44.459124 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.459088    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5ded3669-6a0b-4d56-8617-e0291ab7f5bd-iptables-alerter-script\") pod \"iptables-alerter-682bh\" (UID: \"5ded3669-6a0b-4d56-8617-e0291ab7f5bd\") " pod="openshift-network-operator/iptables-alerter-682bh"
Sep 16 02:18:44.459295 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.459132    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d-sys-fs\") pod \"aws-ebs-csi-driver-node-jhhqs\" (UID: \"d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhqs"
Sep 16 02:18:44.459295 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.459153    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-multus-conf-dir\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.459295 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.459255    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d-sys-fs\") pod \"aws-ebs-csi-driver-node-jhhqs\" (UID: \"d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhqs"
Sep 16 02:18:44.459490 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.459394    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e3d5667-b41e-4ff5-beb3-ebe791b48183-cnibin\") pod \"multus-additional-cni-plugins-5nl9d\" (UID: \"0e3d5667-b41e-4ff5-beb3-ebe791b48183\") " pod="openshift-multus/multus-additional-cni-plugins-5nl9d"
Sep 16 02:18:44.459490 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.459442    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0e3d5667-b41e-4ff5-beb3-ebe791b48183-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5nl9d\" (UID: \"0e3d5667-b41e-4ff5-beb3-ebe791b48183\") " pod="openshift-multus/multus-additional-cni-plugins-5nl9d"
Sep 16 02:18:44.459490 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.459443    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-multus-conf-dir\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.459490 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.459460    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e3d5667-b41e-4ff5-beb3-ebe791b48183-cnibin\") pod \"multus-additional-cni-plugins-5nl9d\" (UID: \"0e3d5667-b41e-4ff5-beb3-ebe791b48183\") " pod="openshift-multus/multus-additional-cni-plugins-5nl9d"
Sep 16 02:18:44.459699 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.459514    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e92efdb-9c85-4515-9195-1fdb836771ae-agent-certs\") pod \"konnectivity-agent-j8mcn\" (UID: \"7e92efdb-9c85-4515-9195-1fdb836771ae\") " pod="kube-system/konnectivity-agent-j8mcn"
Sep 16 02:18:44.459699 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.459562    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-multus-cni-dir\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.459699 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.459587    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-host-var-lib-cni-multus\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.459699 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.459613    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-hostroot\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.459699 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.459638    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xpv8\" (UniqueName: \"kubernetes.io/projected/f085f4b0-6a6b-4c05-b83e-45418e1df86b-kube-api-access-4xpv8\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.459699 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.459663    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d-registration-dir\") pod \"aws-ebs-csi-driver-node-jhhqs\" (UID: \"d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhqs"
Sep 16 02:18:44.460005 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.459715    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-multus-cni-dir\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.460005 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.459723    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-hostroot\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.460005 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.459768    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-host-var-lib-cni-multus\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.460005 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.459775    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64xv5\" (UniqueName: \"kubernetes.io/projected/d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d-kube-api-access-64xv5\") pod \"aws-ebs-csi-driver-node-jhhqs\" (UID: \"d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhqs"
Sep 16 02:18:44.460005 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.459779    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5ded3669-6a0b-4d56-8617-e0291ab7f5bd-iptables-alerter-script\") pod \"iptables-alerter-682bh\" (UID: \"5ded3669-6a0b-4d56-8617-e0291ab7f5bd\") " pod="openshift-network-operator/iptables-alerter-682bh"
Sep 16 02:18:44.460005 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.459826    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d-registration-dir\") pod \"aws-ebs-csi-driver-node-jhhqs\" (UID: \"d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhqs"
Sep 16 02:18:44.460005 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.459912    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-multus-socket-dir-parent\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.460005 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.459948    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-host-run-multus-certs\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.460005 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.459978    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e3d5667-b41e-4ff5-beb3-ebe791b48183-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5nl9d\" (UID: \"0e3d5667-b41e-4ff5-beb3-ebe791b48183\") " pod="openshift-multus/multus-additional-cni-plugins-5nl9d"
Sep 16 02:18:44.460005 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.459990    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-multus-socket-dir-parent\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.460005 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460006    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e3d5667-b41e-4ff5-beb3-ebe791b48183-cni-binary-copy\") pod \"multus-additional-cni-plugins-5nl9d\" (UID: \"0e3d5667-b41e-4ff5-beb3-ebe791b48183\") " pod="openshift-multus/multus-additional-cni-plugins-5nl9d"
Sep 16 02:18:44.460546 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460034    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0e3d5667-b41e-4ff5-beb3-ebe791b48183-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5nl9d\" (UID: \"0e3d5667-b41e-4ff5-beb3-ebe791b48183\") " pod="openshift-multus/multus-additional-cni-plugins-5nl9d"
Sep 16 02:18:44.460546 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460044    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-host-run-multus-certs\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.460546 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460043    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0e3d5667-b41e-4ff5-beb3-ebe791b48183-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5nl9d\" (UID: \"0e3d5667-b41e-4ff5-beb3-ebe791b48183\") " pod="openshift-multus/multus-additional-cni-plugins-5nl9d"
Sep 16 02:18:44.460546 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460167    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdpb8\" (UniqueName: \"kubernetes.io/projected/0e3d5667-b41e-4ff5-beb3-ebe791b48183-kube-api-access-fdpb8\") pod \"multus-additional-cni-plugins-5nl9d\" (UID: \"0e3d5667-b41e-4ff5-beb3-ebe791b48183\") " pod="openshift-multus/multus-additional-cni-plugins-5nl9d"
Sep 16 02:18:44.460546 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460201    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jhhqs\" (UID: \"d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhqs"
Sep 16 02:18:44.460546 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460202    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e3d5667-b41e-4ff5-beb3-ebe791b48183-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5nl9d\" (UID: \"0e3d5667-b41e-4ff5-beb3-ebe791b48183\") " pod="openshift-multus/multus-additional-cni-plugins-5nl9d"
Sep 16 02:18:44.460546 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460230    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f085f4b0-6a6b-4c05-b83e-45418e1df86b-cni-binary-copy\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.460546 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460262    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-cnibin\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.460546 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460268    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jhhqs\" (UID: \"d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhqs"
Sep 16 02:18:44.460546 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460293    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d-socket-dir\") pod \"aws-ebs-csi-driver-node-jhhqs\" (UID: \"d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhqs"
Sep 16 02:18:44.460546 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460455    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d-socket-dir\") pod \"aws-ebs-csi-driver-node-jhhqs\" (UID: \"d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhqs"
Sep 16 02:18:44.460546 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460510    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e3d5667-b41e-4ff5-beb3-ebe791b48183-system-cni-dir\") pod \"multus-additional-cni-plugins-5nl9d\" (UID: \"0e3d5667-b41e-4ff5-beb3-ebe791b48183\") " pod="openshift-multus/multus-additional-cni-plugins-5nl9d"
Sep 16 02:18:44.460546 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460525    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-cnibin\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.460546 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460539    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d-device-dir\") pod \"aws-ebs-csi-driver-node-jhhqs\" (UID: \"d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhqs"
Sep 16 02:18:44.461113 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460571    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-host-var-lib-cni-bin\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.461113 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460575    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e3d5667-b41e-4ff5-beb3-ebe791b48183-system-cni-dir\") pod \"multus-additional-cni-plugins-5nl9d\" (UID: \"0e3d5667-b41e-4ff5-beb3-ebe791b48183\") " pod="openshift-multus/multus-additional-cni-plugins-5nl9d"
Sep 16 02:18:44.461113 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460589    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e3d5667-b41e-4ff5-beb3-ebe791b48183-cni-binary-copy\") pod \"multus-additional-cni-plugins-5nl9d\" (UID: \"0e3d5667-b41e-4ff5-beb3-ebe791b48183\") " pod="openshift-multus/multus-additional-cni-plugins-5nl9d"
Sep 16 02:18:44.461113 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460598    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f085f4b0-6a6b-4c05-b83e-45418e1df86b-multus-daemon-config\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.461113 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460611    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0e3d5667-b41e-4ff5-beb3-ebe791b48183-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5nl9d\" (UID: \"0e3d5667-b41e-4ff5-beb3-ebe791b48183\") " pod="openshift-multus/multus-additional-cni-plugins-5nl9d"
Sep 16 02:18:44.461113 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460633    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d-device-dir\") pod \"aws-ebs-csi-driver-node-jhhqs\" (UID: \"d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhqs"
Sep 16 02:18:44.461113 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460649    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-host-run-k8s-cni-cncf-io\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.461113 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460680    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-host-var-lib-cni-bin\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.461113 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460677    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-host-var-lib-kubelet\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.461113 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460721    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5ded3669-6a0b-4d56-8617-e0291ab7f5bd-host-slash\") pod \"iptables-alerter-682bh\" (UID: \"5ded3669-6a0b-4d56-8617-e0291ab7f5bd\") " pod="openshift-network-operator/iptables-alerter-682bh"
Sep 16 02:18:44.461113 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460727    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-host-var-lib-kubelet\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.461113 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460748    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-host-run-k8s-cni-cncf-io\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.461113 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460754    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-etc-kubernetes\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.461113 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460777    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5ded3669-6a0b-4d56-8617-e0291ab7f5bd-host-slash\") pod \"iptables-alerter-682bh\" (UID: \"5ded3669-6a0b-4d56-8617-e0291ab7f5bd\") " pod="openshift-network-operator/iptables-alerter-682bh"
Sep 16 02:18:44.461113 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460783    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e92efdb-9c85-4515-9195-1fdb836771ae-konnectivity-ca\") pod \"konnectivity-agent-j8mcn\" (UID: \"7e92efdb-9c85-4515-9195-1fdb836771ae\") " pod="kube-system/konnectivity-agent-j8mcn"
Sep 16 02:18:44.461113 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460810    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d-etc-selinux\") pod \"aws-ebs-csi-driver-node-jhhqs\" (UID: \"d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhqs"
Sep 16 02:18:44.461113 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460819    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-etc-kubernetes\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.461754 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460838    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-system-cni-dir\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.461754 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460844    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f085f4b0-6a6b-4c05-b83e-45418e1df86b-cni-binary-copy\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.461754 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460863    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-host-run-netns\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.461754 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460889    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfgcj\" (UniqueName: \"kubernetes.io/projected/5ded3669-6a0b-4d56-8617-e0291ab7f5bd-kube-api-access-mfgcj\") pod \"iptables-alerter-682bh\" (UID: \"5ded3669-6a0b-4d56-8617-e0291ab7f5bd\") " pod="openshift-network-operator/iptables-alerter-682bh"
Sep 16 02:18:44.461754 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460905    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-system-cni-dir\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.461754 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460919    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d-etc-selinux\") pod \"aws-ebs-csi-driver-node-jhhqs\" (UID: \"d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhqs"
Sep 16 02:18:44.461754 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.460944    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f085f4b0-6a6b-4c05-b83e-45418e1df86b-host-run-netns\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.461754 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.461120    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f085f4b0-6a6b-4c05-b83e-45418e1df86b-multus-daemon-config\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.461754 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.461338    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e92efdb-9c85-4515-9195-1fdb836771ae-konnectivity-ca\") pod \"konnectivity-agent-j8mcn\" (UID: \"7e92efdb-9c85-4515-9195-1fdb836771ae\") " pod="kube-system/konnectivity-agent-j8mcn"
Sep 16 02:18:44.462380 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.462341    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e92efdb-9c85-4515-9195-1fdb836771ae-agent-certs\") pod \"konnectivity-agent-j8mcn\" (UID: \"7e92efdb-9c85-4515-9195-1fdb836771ae\") " pod="kube-system/konnectivity-agent-j8mcn"
Sep 16 02:18:44.467475 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.467421    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64xv5\" (UniqueName: \"kubernetes.io/projected/d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d-kube-api-access-64xv5\") pod \"aws-ebs-csi-driver-node-jhhqs\" (UID: \"d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhqs"
Sep 16 02:18:44.471948 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.471892    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdpb8\" (UniqueName: \"kubernetes.io/projected/0e3d5667-b41e-4ff5-beb3-ebe791b48183-kube-api-access-fdpb8\") pod \"multus-additional-cni-plugins-5nl9d\" (UID: \"0e3d5667-b41e-4ff5-beb3-ebe791b48183\") " pod="openshift-multus/multus-additional-cni-plugins-5nl9d"
Sep 16 02:18:44.472270 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.472246    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xpv8\" (UniqueName: \"kubernetes.io/projected/f085f4b0-6a6b-4c05-b83e-45418e1df86b-kube-api-access-4xpv8\") pod \"multus-4sw86\" (UID: \"f085f4b0-6a6b-4c05-b83e-45418e1df86b\") " pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.472743 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.472704    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfgcj\" (UniqueName: \"kubernetes.io/projected/5ded3669-6a0b-4d56-8617-e0291ab7f5bd-kube-api-access-mfgcj\") pod \"iptables-alerter-682bh\" (UID: \"5ded3669-6a0b-4d56-8617-e0291ab7f5bd\") " pod="openshift-network-operator/iptables-alerter-682bh"
Sep 16 02:18:44.543735 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.543712    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-znbz8"
Sep 16 02:18:44.554702 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.554683    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:18:44.563890 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.563867    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vrb2j"
Sep 16 02:18:44.570933 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.570911    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5nl9d"
Sep 16 02:18:44.579024 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.579001    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jhvrv"
Sep 16 02:18:44.585214 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.585194    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j8mcn"
Sep 16 02:18:44.590795 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.590776    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhqs"
Sep 16 02:18:44.599788 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.599762    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4sw86"
Sep 16 02:18:44.605519 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.605497    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-682bh"
Sep 16 02:18:44.697632 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.697552    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 02:18:44.864861 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.864794    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57b965f8-cef0-417c-b3a8-8c5c1a0883bf-metrics-certs\") pod \"network-metrics-daemon-p7rcn\" (UID: \"57b965f8-cef0-417c-b3a8-8c5c1a0883bf\") " pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:18:44.865017 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.864846    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2s55\" (UniqueName: \"kubernetes.io/projected/f05bbb56-ee96-4d5c-918d-18cddf968e87-kube-api-access-d2s55\") pod \"network-check-target-2mmw9\" (UID: \"f05bbb56-ee96-4d5c-918d-18cddf968e87\") " pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:18:44.865017 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:44.864906    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b569dfd-1a91-4dfd-a893-355d2a94681c-original-pull-secret\") pod \"global-pull-secret-syncer-5z7kc\" (UID: \"4b569dfd-1a91-4dfd-a893-355d2a94681c\") " pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:18:44.865017 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:44.864962    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 02:18:44.865017 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:44.864989    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 02:18:44.865242 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:44.865035    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57b965f8-cef0-417c-b3a8-8c5c1a0883bf-metrics-certs podName:57b965f8-cef0-417c-b3a8-8c5c1a0883bf nodeName:}" failed. No retries permitted until 2026-09-16 02:18:45.865011635 +0000 UTC m=+3.915356123 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/57b965f8-cef0-417c-b3a8-8c5c1a0883bf-metrics-certs") pod "network-metrics-daemon-p7rcn" (UID: "57b965f8-cef0-417c-b3a8-8c5c1a0883bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 02:18:44.865242 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:44.865051    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b569dfd-1a91-4dfd-a893-355d2a94681c-original-pull-secret podName:4b569dfd-1a91-4dfd-a893-355d2a94681c nodeName:}" failed. No retries permitted until 2026-09-16 02:18:45.865043866 +0000 UTC m=+3.915388339 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b569dfd-1a91-4dfd-a893-355d2a94681c-original-pull-secret") pod "global-pull-secret-syncer-5z7kc" (UID: "4b569dfd-1a91-4dfd-a893-355d2a94681c") : object "kube-system"/"original-pull-secret" not registered
Sep 16 02:18:44.865242 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:44.865061    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 02:18:44.865242 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:44.865089    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 02:18:44.865242 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:44.865102    2565 projected.go:196] Error preparing data for projected volume kube-api-access-d2s55 for pod openshift-network-diagnostics/network-check-target-2mmw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 02:18:44.865242 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:44.865167    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f05bbb56-ee96-4d5c-918d-18cddf968e87-kube-api-access-d2s55 podName:f05bbb56-ee96-4d5c-918d-18cddf968e87 nodeName:}" failed. No retries permitted until 2026-09-16 02:18:45.86514907 +0000 UTC m=+3.915493563 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-d2s55" (UniqueName: "kubernetes.io/projected/f05bbb56-ee96-4d5c-918d-18cddf968e87-kube-api-access-d2s55") pod "network-check-target-2mmw9" (UID: "f05bbb56-ee96-4d5c-918d-18cddf968e87") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 02:18:45.291376 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:45.291276    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 02:13:44 +0000 UTC" deadline="2028-05-20 05:42:21.957067138 +0000 UTC"
Sep 16 02:18:45.291376 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:45.291334    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14691h23m36.665742075s"
Sep 16 02:18:45.319233 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:45.319099    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ded3669_6a0b_4d56_8617_e0291ab7f5bd.slice/crio-2193cae2beb85004312efd09b7e85fb25391d818eb8b4bade39653a9b7c5812b WatchSource:0}: Error finding container 2193cae2beb85004312efd09b7e85fb25391d818eb8b4bade39653a9b7c5812b: Status 404 returned error can't find the container with id 2193cae2beb85004312efd09b7e85fb25391d818eb8b4bade39653a9b7c5812b
Sep 16 02:18:45.325711 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:45.325686    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a767a10_1fc2_4f3c_b655_74c71d814656.slice/crio-254db6ebdf1ea19801161d4e3dd77e112ba74f65a066248b3cb77a7ba2261482 WatchSource:0}: Error finding container 254db6ebdf1ea19801161d4e3dd77e112ba74f65a066248b3cb77a7ba2261482: Status 404 returned error can't find the container with id 254db6ebdf1ea19801161d4e3dd77e112ba74f65a066248b3cb77a7ba2261482
Sep 16 02:18:45.327352 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:45.327332    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf085f4b0_6a6b_4c05_b83e_45418e1df86b.slice/crio-d5696cf70102e76a8763033c8578c943996d3789a061e663024fecf407dac04f WatchSource:0}: Error finding container d5696cf70102e76a8763033c8578c943996d3789a061e663024fecf407dac04f: Status 404 returned error can't find the container with id d5696cf70102e76a8763033c8578c943996d3789a061e663024fecf407dac04f
Sep 16 02:18:45.328952 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:45.328927    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e92efdb_9c85_4515_9195_1fdb836771ae.slice/crio-bd678f82c0395051517984d2031d0fcec38af86e2901dd078b5deed02b342426 WatchSource:0}: Error finding container bd678f82c0395051517984d2031d0fcec38af86e2901dd078b5deed02b342426: Status 404 returned error can't find the container with id bd678f82c0395051517984d2031d0fcec38af86e2901dd078b5deed02b342426
Sep 16 02:18:45.329806 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:45.329660    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode92e9b0a_e42c_4c8e_9570_1e0e6c8da6f9.slice/crio-243414962f39bfe3373f30767b1e540c40404930c9577779dfa04c121e45d1dc WatchSource:0}: Error finding container 243414962f39bfe3373f30767b1e540c40404930c9577779dfa04c121e45d1dc: Status 404 returned error can't find the container with id 243414962f39bfe3373f30767b1e540c40404930c9577779dfa04c121e45d1dc
Sep 16 02:18:45.330510 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:45.330464    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf343f46e_3e8c_4d87_a516_5e37eeb16035.slice/crio-63403a5ca4bb05ccf78439cdd52aab69301b95e933db41775029458d4fa7d05b WatchSource:0}: Error finding container 63403a5ca4bb05ccf78439cdd52aab69301b95e933db41775029458d4fa7d05b: Status 404 returned error can't find the container with id 63403a5ca4bb05ccf78439cdd52aab69301b95e933db41775029458d4fa7d05b
Sep 16 02:18:45.332031 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:18:45.331931    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02463170_036b_4e43_8335_bb6aff297805.slice/crio-94caae069c57ba7f5e1ea2e27bbd882f6274703a5d7bdc92f57c77c4662119d4 WatchSource:0}: Error finding container 94caae069c57ba7f5e1ea2e27bbd882f6274703a5d7bdc92f57c77c4662119d4: Status 404 returned error can't find the container with id 94caae069c57ba7f5e1ea2e27bbd882f6274703a5d7bdc92f57c77c4662119d4
Sep 16 02:18:45.385565 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:45.385533    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:18:45.385565 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:45.385558    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:18:45.385709 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:45.385637    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5z7kc" podUID="4b569dfd-1a91-4dfd-a893-355d2a94681c"
Sep 16 02:18:45.385795 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:45.385771    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mmw9" podUID="f05bbb56-ee96-4d5c-918d-18cddf968e87"
Sep 16 02:18:45.394561 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:45.394533    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhqs" event={"ID":"d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d","Type":"ContainerStarted","Data":"2390b82a0cc2063eb9b6f1fc67bef9a8906893d4efb9330eaf5ebb5405c3aca2"}
Sep 16 02:18:45.396062 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:45.396029    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5nl9d" event={"ID":"0e3d5667-b41e-4ff5-beb3-ebe791b48183","Type":"ContainerStarted","Data":"045e2247f9dd70bb7d6e5515cccfb697be35554c713e43afddbf21bf1abff139"}
Sep 16 02:18:45.397263 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:45.397239    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-znbz8" event={"ID":"f343f46e-3e8c-4d87-a516-5e37eeb16035","Type":"ContainerStarted","Data":"63403a5ca4bb05ccf78439cdd52aab69301b95e933db41775029458d4fa7d05b"}
Sep 16 02:18:45.398481 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:45.398457    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4sw86" event={"ID":"f085f4b0-6a6b-4c05-b83e-45418e1df86b","Type":"ContainerStarted","Data":"d5696cf70102e76a8763033c8578c943996d3789a061e663024fecf407dac04f"}
Sep 16 02:18:45.399878 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:45.399855    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-682bh" event={"ID":"5ded3669-6a0b-4d56-8617-e0291ab7f5bd","Type":"ContainerStarted","Data":"2193cae2beb85004312efd09b7e85fb25391d818eb8b4bade39653a9b7c5812b"}
Sep 16 02:18:45.401065 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:45.401047    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg" event={"ID":"02463170-036b-4e43-8335-bb6aff297805","Type":"ContainerStarted","Data":"94caae069c57ba7f5e1ea2e27bbd882f6274703a5d7bdc92f57c77c4662119d4"}
Sep 16 02:18:45.402460 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:45.402436    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vrb2j" event={"ID":"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9","Type":"ContainerStarted","Data":"243414962f39bfe3373f30767b1e540c40404930c9577779dfa04c121e45d1dc"}
Sep 16 02:18:45.404703 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:45.404683    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j8mcn" event={"ID":"7e92efdb-9c85-4515-9195-1fdb836771ae","Type":"ContainerStarted","Data":"bd678f82c0395051517984d2031d0fcec38af86e2901dd078b5deed02b342426"}
Sep 16 02:18:45.408590 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:45.408570    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jhvrv" event={"ID":"6a767a10-1fc2-4f3c-b655-74c71d814656","Type":"ContainerStarted","Data":"254db6ebdf1ea19801161d4e3dd77e112ba74f65a066248b3cb77a7ba2261482"}
Sep 16 02:18:45.871514 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:45.871372    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57b965f8-cef0-417c-b3a8-8c5c1a0883bf-metrics-certs\") pod \"network-metrics-daemon-p7rcn\" (UID: \"57b965f8-cef0-417c-b3a8-8c5c1a0883bf\") " pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:18:45.871514 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:45.871459    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2s55\" (UniqueName: \"kubernetes.io/projected/f05bbb56-ee96-4d5c-918d-18cddf968e87-kube-api-access-d2s55\") pod \"network-check-target-2mmw9\" (UID: \"f05bbb56-ee96-4d5c-918d-18cddf968e87\") " pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:18:45.871514 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:45.871499    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b569dfd-1a91-4dfd-a893-355d2a94681c-original-pull-secret\") pod \"global-pull-secret-syncer-5z7kc\" (UID: \"4b569dfd-1a91-4dfd-a893-355d2a94681c\") " pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:18:45.871783 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:45.871627    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 02:18:45.871783 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:45.871692    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b569dfd-1a91-4dfd-a893-355d2a94681c-original-pull-secret podName:4b569dfd-1a91-4dfd-a893-355d2a94681c nodeName:}" failed. No retries permitted until 2026-09-16 02:18:47.871671188 +0000 UTC m=+5.922015678 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b569dfd-1a91-4dfd-a893-355d2a94681c-original-pull-secret") pod "global-pull-secret-syncer-5z7kc" (UID: "4b569dfd-1a91-4dfd-a893-355d2a94681c") : object "kube-system"/"original-pull-secret" not registered
Sep 16 02:18:45.872126 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:45.872106    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 02:18:45.872210 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:45.872162    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57b965f8-cef0-417c-b3a8-8c5c1a0883bf-metrics-certs podName:57b965f8-cef0-417c-b3a8-8c5c1a0883bf nodeName:}" failed. No retries permitted until 2026-09-16 02:18:47.872145565 +0000 UTC m=+5.922490052 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/57b965f8-cef0-417c-b3a8-8c5c1a0883bf-metrics-certs") pod "network-metrics-daemon-p7rcn" (UID: "57b965f8-cef0-417c-b3a8-8c5c1a0883bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 02:18:45.872271 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:45.872243    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 02:18:45.872271 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:45.872259    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 02:18:45.872371 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:45.872272    2565 projected.go:196] Error preparing data for projected volume kube-api-access-d2s55 for pod openshift-network-diagnostics/network-check-target-2mmw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 02:18:45.872371 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:45.872308    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f05bbb56-ee96-4d5c-918d-18cddf968e87-kube-api-access-d2s55 podName:f05bbb56-ee96-4d5c-918d-18cddf968e87 nodeName:}" failed. No retries permitted until 2026-09-16 02:18:47.872296408 +0000 UTC m=+5.922640887 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-d2s55" (UniqueName: "kubernetes.io/projected/f05bbb56-ee96-4d5c-918d-18cddf968e87-kube-api-access-d2s55") pod "network-check-target-2mmw9" (UID: "f05bbb56-ee96-4d5c-918d-18cddf968e87") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 02:18:46.292195 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:46.292082    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 02:13:44 +0000 UTC" deadline="2028-03-06 11:24:39.826887513 +0000 UTC"
Sep 16 02:18:46.292195 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:46.292146    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12897h5m53.534745628s"
Sep 16 02:18:46.387678 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:46.387143    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:18:46.387678 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:46.387288    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7rcn" podUID="57b965f8-cef0-417c-b3a8-8c5c1a0883bf"
Sep 16 02:18:46.423140 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:46.422544    2565 generic.go:356] "Generic (PLEG): container finished" podID="1b013639e5bdde50b7081afc18d07a1f" containerID="b3fcf3c90faa98cf0d1b58bac90ec6a440518ed3d7d92b3164dc99b26c821c9f" exitCode=0
Sep 16 02:18:46.423140 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:46.422822    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal" event={"ID":"1b013639e5bdde50b7081afc18d07a1f","Type":"ContainerDied","Data":"b3fcf3c90faa98cf0d1b58bac90ec6a440518ed3d7d92b3164dc99b26c821c9f"}
Sep 16 02:18:46.438193 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:46.438164    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal" event={"ID":"9119e0687bd7d52fed7d7ab65f2ce9e1","Type":"ContainerStarted","Data":"9af8dcdce96dbfe878c7d5b81026f2af593cd26f2303ac42be6be1f63cc5bfe7"}
Sep 16 02:18:47.385416 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:47.385325    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:18:47.385958 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:47.385465    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5z7kc" podUID="4b569dfd-1a91-4dfd-a893-355d2a94681c"
Sep 16 02:18:47.385958 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:47.385818    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:18:47.385958 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:47.385912    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mmw9" podUID="f05bbb56-ee96-4d5c-918d-18cddf968e87"
Sep 16 02:18:47.461770 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:47.461742    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal" event={"ID":"1b013639e5bdde50b7081afc18d07a1f","Type":"ContainerStarted","Data":"32b89903187384080a0156c706f1b3d3efc7c9f484e3a618832d08f34db5abc4"}
Sep 16 02:18:47.482384 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:47.481710    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal" podStartSLOduration=4.481665211 podStartE2EDuration="4.481665211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 02:18:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:18:46.452022677 +0000 UTC m=+4.502367176" watchObservedRunningTime="2026-09-16 02:18:47.481665211 +0000 UTC m=+5.532009704"
Sep 16 02:18:47.482384 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:47.481977    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal" podStartSLOduration=4.481966266 podStartE2EDuration="4.481966266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 02:18:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:18:47.48055267 +0000 UTC m=+5.530897191" watchObservedRunningTime="2026-09-16 02:18:47.481966266 +0000 UTC m=+5.532310774"
Sep 16 02:18:47.887428 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:47.887354    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57b965f8-cef0-417c-b3a8-8c5c1a0883bf-metrics-certs\") pod \"network-metrics-daemon-p7rcn\" (UID: \"57b965f8-cef0-417c-b3a8-8c5c1a0883bf\") " pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:18:47.887603 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:47.887440    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2s55\" (UniqueName: \"kubernetes.io/projected/f05bbb56-ee96-4d5c-918d-18cddf968e87-kube-api-access-d2s55\") pod \"network-check-target-2mmw9\" (UID: \"f05bbb56-ee96-4d5c-918d-18cddf968e87\") " pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:18:47.887603 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:47.887477    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b569dfd-1a91-4dfd-a893-355d2a94681c-original-pull-secret\") pod \"global-pull-secret-syncer-5z7kc\" (UID: \"4b569dfd-1a91-4dfd-a893-355d2a94681c\") " pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:18:47.887603 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:47.887588    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 02:18:47.887763 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:47.887645    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b569dfd-1a91-4dfd-a893-355d2a94681c-original-pull-secret podName:4b569dfd-1a91-4dfd-a893-355d2a94681c nodeName:}" failed. No retries permitted until 2026-09-16 02:18:51.887627578 +0000 UTC m=+9.937972062 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b569dfd-1a91-4dfd-a893-355d2a94681c-original-pull-secret") pod "global-pull-secret-syncer-5z7kc" (UID: "4b569dfd-1a91-4dfd-a893-355d2a94681c") : object "kube-system"/"original-pull-secret" not registered
Sep 16 02:18:47.888054 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:47.888035    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 02:18:47.888119 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:47.888091    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57b965f8-cef0-417c-b3a8-8c5c1a0883bf-metrics-certs podName:57b965f8-cef0-417c-b3a8-8c5c1a0883bf nodeName:}" failed. No retries permitted until 2026-09-16 02:18:51.888075833 +0000 UTC m=+9.938420320 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/57b965f8-cef0-417c-b3a8-8c5c1a0883bf-metrics-certs") pod "network-metrics-daemon-p7rcn" (UID: "57b965f8-cef0-417c-b3a8-8c5c1a0883bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 02:18:47.888184 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:47.888168    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 02:18:47.888238 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:47.888187    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 02:18:47.888238 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:47.888198    2565 projected.go:196] Error preparing data for projected volume kube-api-access-d2s55 for pod openshift-network-diagnostics/network-check-target-2mmw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 02:18:47.888238 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:47.888231    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f05bbb56-ee96-4d5c-918d-18cddf968e87-kube-api-access-d2s55 podName:f05bbb56-ee96-4d5c-918d-18cddf968e87 nodeName:}" failed. No retries permitted until 2026-09-16 02:18:51.888220539 +0000 UTC m=+9.938565023 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-d2s55" (UniqueName: "kubernetes.io/projected/f05bbb56-ee96-4d5c-918d-18cddf968e87-kube-api-access-d2s55") pod "network-check-target-2mmw9" (UID: "f05bbb56-ee96-4d5c-918d-18cddf968e87") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 02:18:48.387370 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:48.387278    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:18:48.387806 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:48.387436    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7rcn" podUID="57b965f8-cef0-417c-b3a8-8c5c1a0883bf"
Sep 16 02:18:49.385687 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:49.385041    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:18:49.385687 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:49.385164    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mmw9" podUID="f05bbb56-ee96-4d5c-918d-18cddf968e87"
Sep 16 02:18:49.385687 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:49.385542    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:18:49.385687 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:49.385640    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5z7kc" podUID="4b569dfd-1a91-4dfd-a893-355d2a94681c"
Sep 16 02:18:50.384741 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:50.384710    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:18:50.385189 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:50.384852    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7rcn" podUID="57b965f8-cef0-417c-b3a8-8c5c1a0883bf"
Sep 16 02:18:51.385955 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:51.385195    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:18:51.385955 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:51.385424    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:18:51.385955 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:51.385583    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5z7kc" podUID="4b569dfd-1a91-4dfd-a893-355d2a94681c"
Sep 16 02:18:51.385955 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:51.385888    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mmw9" podUID="f05bbb56-ee96-4d5c-918d-18cddf968e87"
Sep 16 02:18:51.921665 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:51.920864    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2s55\" (UniqueName: \"kubernetes.io/projected/f05bbb56-ee96-4d5c-918d-18cddf968e87-kube-api-access-d2s55\") pod \"network-check-target-2mmw9\" (UID: \"f05bbb56-ee96-4d5c-918d-18cddf968e87\") " pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:18:51.921665 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:51.920914    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b569dfd-1a91-4dfd-a893-355d2a94681c-original-pull-secret\") pod \"global-pull-secret-syncer-5z7kc\" (UID: \"4b569dfd-1a91-4dfd-a893-355d2a94681c\") " pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:18:51.921665 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:51.920956    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57b965f8-cef0-417c-b3a8-8c5c1a0883bf-metrics-certs\") pod \"network-metrics-daemon-p7rcn\" (UID: \"57b965f8-cef0-417c-b3a8-8c5c1a0883bf\") " pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:18:51.921665 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:51.921079    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 02:18:51.921665 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:51.921137    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57b965f8-cef0-417c-b3a8-8c5c1a0883bf-metrics-certs podName:57b965f8-cef0-417c-b3a8-8c5c1a0883bf nodeName:}" failed. No retries permitted until 2026-09-16 02:18:59.92111883 +0000 UTC m=+17.971463306 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/57b965f8-cef0-417c-b3a8-8c5c1a0883bf-metrics-certs") pod "network-metrics-daemon-p7rcn" (UID: "57b965f8-cef0-417c-b3a8-8c5c1a0883bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 02:18:51.921665 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:51.921497    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 02:18:51.921665 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:51.921515    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 02:18:51.921665 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:51.921528    2565 projected.go:196] Error preparing data for projected volume kube-api-access-d2s55 for pod openshift-network-diagnostics/network-check-target-2mmw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 02:18:51.921665 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:51.921567    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f05bbb56-ee96-4d5c-918d-18cddf968e87-kube-api-access-d2s55 podName:f05bbb56-ee96-4d5c-918d-18cddf968e87 nodeName:}" failed. No retries permitted until 2026-09-16 02:18:59.921555337 +0000 UTC m=+17.971899813 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-d2s55" (UniqueName: "kubernetes.io/projected/f05bbb56-ee96-4d5c-918d-18cddf968e87-kube-api-access-d2s55") pod "network-check-target-2mmw9" (UID: "f05bbb56-ee96-4d5c-918d-18cddf968e87") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 02:18:51.921665 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:51.921611    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 02:18:51.921665 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:51.921637    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b569dfd-1a91-4dfd-a893-355d2a94681c-original-pull-secret podName:4b569dfd-1a91-4dfd-a893-355d2a94681c nodeName:}" failed. No retries permitted until 2026-09-16 02:18:59.921627512 +0000 UTC m=+17.971971983 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b569dfd-1a91-4dfd-a893-355d2a94681c-original-pull-secret") pod "global-pull-secret-syncer-5z7kc" (UID: "4b569dfd-1a91-4dfd-a893-355d2a94681c") : object "kube-system"/"original-pull-secret" not registered
Sep 16 02:18:52.386113 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:52.386035    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:18:52.386536 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:52.386132    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7rcn" podUID="57b965f8-cef0-417c-b3a8-8c5c1a0883bf"
Sep 16 02:18:53.384896 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:53.384862    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:18:53.385059 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:53.384901    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:18:53.385059 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:53.384996    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5z7kc" podUID="4b569dfd-1a91-4dfd-a893-355d2a94681c"
Sep 16 02:18:53.385188 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:53.385148    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mmw9" podUID="f05bbb56-ee96-4d5c-918d-18cddf968e87"
Sep 16 02:18:54.384770 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:54.384681    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:18:54.385214 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:54.384825    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7rcn" podUID="57b965f8-cef0-417c-b3a8-8c5c1a0883bf"
Sep 16 02:18:55.384466 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:55.384430    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:18:55.384466 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:55.384459    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:18:55.384698 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:55.384551    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mmw9" podUID="f05bbb56-ee96-4d5c-918d-18cddf968e87"
Sep 16 02:18:55.384698 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:55.384680    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5z7kc" podUID="4b569dfd-1a91-4dfd-a893-355d2a94681c"
Sep 16 02:18:56.385490 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:56.385461    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:18:56.385899 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:56.385566    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7rcn" podUID="57b965f8-cef0-417c-b3a8-8c5c1a0883bf"
Sep 16 02:18:57.385425 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:57.385394    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:18:57.385575 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:57.385509    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mmw9" podUID="f05bbb56-ee96-4d5c-918d-18cddf968e87"
Sep 16 02:18:57.385575 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:57.385539    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:18:57.386005 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:57.385611    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5z7kc" podUID="4b569dfd-1a91-4dfd-a893-355d2a94681c"
Sep 16 02:18:58.385234 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:58.385203    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:18:58.385408 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:58.385330    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7rcn" podUID="57b965f8-cef0-417c-b3a8-8c5c1a0883bf"
Sep 16 02:18:59.384646 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:59.384617    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:18:59.385046 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:59.384719    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mmw9" podUID="f05bbb56-ee96-4d5c-918d-18cddf968e87"
Sep 16 02:18:59.385046 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:59.384776    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:18:59.385046 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:59.384882    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5z7kc" podUID="4b569dfd-1a91-4dfd-a893-355d2a94681c"
Sep 16 02:18:59.986286 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:59.986254    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2s55\" (UniqueName: \"kubernetes.io/projected/f05bbb56-ee96-4d5c-918d-18cddf968e87-kube-api-access-d2s55\") pod \"network-check-target-2mmw9\" (UID: \"f05bbb56-ee96-4d5c-918d-18cddf968e87\") " pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:18:59.986286 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:59.986300    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b569dfd-1a91-4dfd-a893-355d2a94681c-original-pull-secret\") pod \"global-pull-secret-syncer-5z7kc\" (UID: \"4b569dfd-1a91-4dfd-a893-355d2a94681c\") " pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:18:59.986562 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:18:59.986340    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57b965f8-cef0-417c-b3a8-8c5c1a0883bf-metrics-certs\") pod \"network-metrics-daemon-p7rcn\" (UID: \"57b965f8-cef0-417c-b3a8-8c5c1a0883bf\") " pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:18:59.986562 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:59.986450    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 02:18:59.986562 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:59.986460    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 02:18:59.986562 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:59.986480    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 02:18:59.986562 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:59.986478    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 02:18:59.986562 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:59.986491    2565 projected.go:196] Error preparing data for projected volume kube-api-access-d2s55 for pod openshift-network-diagnostics/network-check-target-2mmw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 02:18:59.986562 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:59.986512    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57b965f8-cef0-417c-b3a8-8c5c1a0883bf-metrics-certs podName:57b965f8-cef0-417c-b3a8-8c5c1a0883bf nodeName:}" failed. No retries permitted until 2026-09-16 02:19:15.986493957 +0000 UTC m=+34.036838428 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/57b965f8-cef0-417c-b3a8-8c5c1a0883bf-metrics-certs") pod "network-metrics-daemon-p7rcn" (UID: "57b965f8-cef0-417c-b3a8-8c5c1a0883bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 02:18:59.986562 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:59.986535    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f05bbb56-ee96-4d5c-918d-18cddf968e87-kube-api-access-d2s55 podName:f05bbb56-ee96-4d5c-918d-18cddf968e87 nodeName:}" failed. No retries permitted until 2026-09-16 02:19:15.986519851 +0000 UTC m=+34.036864323 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-d2s55" (UniqueName: "kubernetes.io/projected/f05bbb56-ee96-4d5c-918d-18cddf968e87-kube-api-access-d2s55") pod "network-check-target-2mmw9" (UID: "f05bbb56-ee96-4d5c-918d-18cddf968e87") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 02:18:59.986562 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:18:59.986550    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b569dfd-1a91-4dfd-a893-355d2a94681c-original-pull-secret podName:4b569dfd-1a91-4dfd-a893-355d2a94681c nodeName:}" failed. No retries permitted until 2026-09-16 02:19:15.986543911 +0000 UTC m=+34.036888382 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b569dfd-1a91-4dfd-a893-355d2a94681c-original-pull-secret") pod "global-pull-secret-syncer-5z7kc" (UID: "4b569dfd-1a91-4dfd-a893-355d2a94681c") : object "kube-system"/"original-pull-secret" not registered
Sep 16 02:19:00.384989 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:00.384911    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:19:00.385439 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:00.385043    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7rcn" podUID="57b965f8-cef0-417c-b3a8-8c5c1a0883bf"
Sep 16 02:19:01.384751 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:01.384711    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:19:01.384751 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:01.384752    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:19:01.384963 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:01.384843    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mmw9" podUID="f05bbb56-ee96-4d5c-918d-18cddf968e87"
Sep 16 02:19:01.385032 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:01.384978    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5z7kc" podUID="4b569dfd-1a91-4dfd-a893-355d2a94681c"
Sep 16 02:19:02.386048 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:02.386012    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:19:02.386501 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:02.386136    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7rcn" podUID="57b965f8-cef0-417c-b3a8-8c5c1a0883bf"
Sep 16 02:19:03.385274 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:03.385078    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:19:03.385404 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:03.385136    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:19:03.385404 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:03.385355    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mmw9" podUID="f05bbb56-ee96-4d5c-918d-18cddf968e87"
Sep 16 02:19:03.385523 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:03.385504    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5z7kc" podUID="4b569dfd-1a91-4dfd-a893-355d2a94681c"
Sep 16 02:19:03.494700 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:03.494637    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg" event={"ID":"02463170-036b-4e43-8335-bb6aff297805","Type":"ContainerStarted","Data":"bdb3dc35ae2f8051a85ce37313e9f0651c5e951b7da8944017d5e22165d1b3b5"}
Sep 16 02:19:03.495439 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:03.494753    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg" event={"ID":"02463170-036b-4e43-8335-bb6aff297805","Type":"ContainerStarted","Data":"3341f7ae56e8d14d5803891a5f72f5e289e5b4cff9bb49628326b6eaade94c39"}
Sep 16 02:19:03.495439 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:03.494797    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg" event={"ID":"02463170-036b-4e43-8335-bb6aff297805","Type":"ContainerStarted","Data":"27c9207a0959940b1cf96f0560389bb860b4eb00ee481b3462dc61d3d563dbd0"}
Sep 16 02:19:03.495439 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:03.494840    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg" event={"ID":"02463170-036b-4e43-8335-bb6aff297805","Type":"ContainerStarted","Data":"5baa9ba95c8ad1850b8961b7dbfe9ac961182e4b8105fcc393f92333a3778494"}
Sep 16 02:19:03.495439 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:03.494882    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg" event={"ID":"02463170-036b-4e43-8335-bb6aff297805","Type":"ContainerStarted","Data":"5dd5a859eac0e3ff20ae2a2f61c2ddd7fa6eddc2933c5b865b8c515e01c2680f"}
Sep 16 02:19:03.496099 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:03.496078    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vrb2j" event={"ID":"e92e9b0a-e42c-4c8e-9570-1e0e6c8da6f9","Type":"ContainerStarted","Data":"3629e3f877a383591d84f9f8e1af520612408a22c9db87d353362f3ac162f9e9"}
Sep 16 02:19:03.497462 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:03.497442    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j8mcn" event={"ID":"7e92efdb-9c85-4515-9195-1fdb836771ae","Type":"ContainerStarted","Data":"77f964c1768ac9ba17d7304dd17964bd4096b77ad0b47d965b016921f9088b5f"}
Sep 16 02:19:03.498916 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:03.498894    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jhvrv" event={"ID":"6a767a10-1fc2-4f3c-b655-74c71d814656","Type":"ContainerStarted","Data":"1b870420874218a06e6e25a7f4f02989e762c551a15bf7a574b941f7949bb54d"}
Sep 16 02:19:03.500409 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:03.500390    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhqs" event={"ID":"d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d","Type":"ContainerStarted","Data":"d2b6a2135e7767018a0b296d9aa2c91aab58fbf5f00b0e7c7f6261173f12d8a5"}
Sep 16 02:19:03.502105 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:03.502080    2565 generic.go:356] "Generic (PLEG): container finished" podID="0e3d5667-b41e-4ff5-beb3-ebe791b48183" containerID="20f72d53a3469f998af3d4e656d4b2c3a3478f6310171d8072c1d2b68f4eabd3" exitCode=0
Sep 16 02:19:03.502181 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:03.502116    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5nl9d" event={"ID":"0e3d5667-b41e-4ff5-beb3-ebe791b48183","Type":"ContainerDied","Data":"20f72d53a3469f998af3d4e656d4b2c3a3478f6310171d8072c1d2b68f4eabd3"}
Sep 16 02:19:03.503839 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:03.503816    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-znbz8" event={"ID":"f343f46e-3e8c-4d87-a516-5e37eeb16035","Type":"ContainerStarted","Data":"3df392dae85ec2a4a7add1a5dc972b860b907ea85d04954e439dca78f6408214"}
Sep 16 02:19:03.505380 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:03.505346    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4sw86" event={"ID":"f085f4b0-6a6b-4c05-b83e-45418e1df86b","Type":"ContainerStarted","Data":"f530ef984e42e889ba877ab9a04b9d1659e4887685d499547c9f8a18cda7cf74"}
Sep 16 02:19:03.510721 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:03.510685    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vrb2j" podStartSLOduration=3.873638751 podStartE2EDuration="21.510675264s" totalImagesPullingTime="17.637036513s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 02:18:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:19:03.510645284 +0000 UTC m=+21.560989777" watchObservedRunningTime="2026-09-16 02:19:03.510675264 +0000 UTC m=+21.561019757"
Sep 16 02:19:03.526515 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:03.526476    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4sw86" podStartSLOduration=3.828199101 podStartE2EDuration="21.526462655s" totalImagesPullingTime="17.698263554s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 02:18:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:19:03.525276173 +0000 UTC m=+21.575620681" watchObservedRunningTime="2026-09-16 02:19:03.526462655 +0000 UTC m=+21.576807147"
Sep 16 02:19:03.538429 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:03.538387    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jhvrv" podStartSLOduration=3.898454079 podStartE2EDuration="21.53834421s" totalImagesPullingTime="17.639890131s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 02:18:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:19:03.538149909 +0000 UTC m=+21.588494403" watchObservedRunningTime="2026-09-16 02:19:03.53834421 +0000 UTC m=+21.588688704"
Sep 16 02:19:03.551150 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:03.551115    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-j8mcn" podStartSLOduration=7.705119432 podStartE2EDuration="21.551104565s" totalImagesPullingTime="13.845985133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:18:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:19:03.550744952 +0000 UTC m=+21.601089464" watchObservedRunningTime="2026-09-16 02:19:03.551104565 +0000 UTC m=+21.601449058"
Sep 16 02:19:03.585956 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:03.585916    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-znbz8" podStartSLOduration=3.951508668 podStartE2EDuration="21.585906688s" totalImagesPullingTime="17.63439802s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 02:18:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:19:03.585629031 +0000 UTC m=+21.635973544" watchObservedRunningTime="2026-09-16 02:19:03.585906688 +0000 UTC m=+21.636251181"
Sep 16 02:19:03.667803 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:03.667782    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:03.750285 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:03.750226    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:04.385647 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:04.385473    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:19:04.385776 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:04.385742    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7rcn" podUID="57b965f8-cef0-417c-b3a8-8c5c1a0883bf"
Sep 16 02:19:04.460055 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:04.460035    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:04.510911 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:04.510818    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-682bh" event={"ID":"5ded3669-6a0b-4d56-8617-e0291ab7f5bd","Type":"ContainerStarted","Data":"4f086b309f44c6dce1303fa3bec97f025c7ec6f0902007762652a7bd11727fe1"}
Sep 16 02:19:04.515301 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:04.515267    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg" event={"ID":"02463170-036b-4e43-8335-bb6aff297805","Type":"ContainerStarted","Data":"b6a682814c63f7952ca5c17b222f1b30d2236d8e7cd126c576a74893574940f6"}
Sep 16 02:19:04.531128 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:04.531109    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:04.586465 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:04.586445    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 16 02:19:04.661456 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:04.661436    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:04.985626 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:04.985599    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:05.086722 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:05.086687    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:05.302287 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:05.302107    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-16T02:19:04.586461246Z","UUID":"0422b4a8-a301-4f61-bbae-092ffda384e7","Handler":null,"Name":"","Endpoint":""}
Sep 16 02:19:05.303779 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:05.303758    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 16 02:19:05.303894 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:05.303803    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 16 02:19:05.385372 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:05.385332    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:19:05.385372 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:05.385345    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:19:05.385575 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:05.385463    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mmw9" podUID="f05bbb56-ee96-4d5c-918d-18cddf968e87"
Sep 16 02:19:05.385575 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:05.385508    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5z7kc" podUID="4b569dfd-1a91-4dfd-a893-355d2a94681c"
Sep 16 02:19:05.519735 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:05.519701    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhqs" event={"ID":"d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d","Type":"ContainerStarted","Data":"60c1b80323e7b9daf8f1579df7afc4f7d9ee563ff0d12f3fc409e47576150830"}
Sep 16 02:19:05.791554 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:05.791524    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:06.189330 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:06.189298    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:06.289611 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:06.289582    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:06.388519 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:06.388494    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:19:06.388644 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:06.388622    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7rcn" podUID="57b965f8-cef0-417c-b3a8-8c5c1a0883bf"
Sep 16 02:19:06.525404 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:06.525331    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg" event={"ID":"02463170-036b-4e43-8335-bb6aff297805","Type":"ContainerStarted","Data":"8a8adb721aee94946b48e2342315236ff5dac854eb3364d2658bd81dc93db44d"}
Sep 16 02:19:06.527740 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:06.527711    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhqs" event={"ID":"d5d8ec06-3ce4-4bb1-9057-769dfaeeb54d","Type":"ContainerStarted","Data":"72dde54b916d58cb5080f4f8482bd03b451df890ecaa6bb2ae3414d9a240de32"}
Sep 16 02:19:06.543037 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:06.542996    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-682bh" podStartSLOduration=10.690424569 podStartE2EDuration="24.542979142s" totalImagesPullingTime="13.852554573s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 02:18:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:19:04.527129002 +0000 UTC m=+22.577473524" watchObservedRunningTime="2026-09-16 02:19:06.542979142 +0000 UTC m=+24.593323637"
Sep 16 02:19:06.940027 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:06.939994    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:07.005416 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:07.005389    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:07.340256 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:07.340184    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:07.384400 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:07.384369    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:19:07.384548 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:07.384369    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:19:07.384548 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:07.384497    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5z7kc" podUID="4b569dfd-1a91-4dfd-a893-355d2a94681c"
Sep 16 02:19:07.384548 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:07.384523    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mmw9" podUID="f05bbb56-ee96-4d5c-918d-18cddf968e87"
Sep 16 02:19:07.525536 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:07.525503    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-j8mcn"
Sep 16 02:19:07.526327 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:07.526300    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-j8mcn"
Sep 16 02:19:07.530337 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:07.530311    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-j8mcn"
Sep 16 02:19:07.530632 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:07.530608    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-j8mcn"
Sep 16 02:19:07.539513 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:07.539467    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:07.548900 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:07.548864    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhqs" podStartSLOduration=5.572017282 podStartE2EDuration="25.54884621s" totalImagesPullingTime="19.976828928s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 02:18:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:19:06.543496531 +0000 UTC m=+24.593841046" watchObservedRunningTime="2026-09-16 02:19:07.54884621 +0000 UTC m=+25.599190724"
Sep 16 02:19:07.611543 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:07.611477    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:07.724841 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:07.724803    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:07.811945 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:07.811911    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:08.007822 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:08.007796    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:08.063635 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:08.063605    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:08.385524 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:08.385445    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:19:08.385671 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:08.385588    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7rcn" podUID="57b965f8-cef0-417c-b3a8-8c5c1a0883bf"
Sep 16 02:19:08.536731 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:08.536401    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg" event={"ID":"02463170-036b-4e43-8335-bb6aff297805","Type":"ContainerStarted","Data":"23c54f3420e58c2ffd222d08a75d3d38d32c96cde0285c28888b839c0a27bd01"}
Sep 16 02:19:08.537917 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:08.537270    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:19:08.537917 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:08.537393    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:19:08.537917 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:08.537458    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:19:08.542877 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:08.542399    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:08.554594 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:08.554256    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:19:08.557502 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:08.557263    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:19:08.561701 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:08.561541    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg" podStartSLOduration=8.87021674 podStartE2EDuration="26.561528536s" totalImagesPullingTime="17.691311796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 02:18:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:19:08.560238139 +0000 UTC m=+26.610582652" watchObservedRunningTime="2026-09-16 02:19:08.561528536 +0000 UTC m=+26.611873028"
Sep 16 02:19:08.602064 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:08.602042    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:08.990667 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:08.990612    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:09.085930 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:09.085907    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:09.245892 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:09.245841    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:09.315336 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:09.315315    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:09.385336 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:09.385316    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:19:09.385440 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:09.385316    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:19:09.385492 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:09.385440    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5z7kc" podUID="4b569dfd-1a91-4dfd-a893-355d2a94681c"
Sep 16 02:19:09.385524 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:09.385499    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mmw9" podUID="f05bbb56-ee96-4d5c-918d-18cddf968e87"
Sep 16 02:19:09.540107 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:09.540052    2565 generic.go:356] "Generic (PLEG): container finished" podID="0e3d5667-b41e-4ff5-beb3-ebe791b48183" containerID="459bedd7b2784353f88790e3ddd7c593150fa95c09305eb50a8e32530faf3ec0" exitCode=0
Sep 16 02:19:09.540691 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:09.540121    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5nl9d" event={"ID":"0e3d5667-b41e-4ff5-beb3-ebe791b48183","Type":"ContainerDied","Data":"459bedd7b2784353f88790e3ddd7c593150fa95c09305eb50a8e32530faf3ec0"}
Sep 16 02:19:09.627787 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:09.627758    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:09.726735 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:09.726671    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:10.178959 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:10.178932    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-znbz8_f343f46e-3e8c-4d87-a516-5e37eeb16035/dns-node-resolver/0.log"
Sep 16 02:19:10.385161 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:10.385021    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:19:10.385282 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:10.385243    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7rcn" podUID="57b965f8-cef0-417c-b3a8-8c5c1a0883bf"
Sep 16 02:19:10.523266 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:10.523241    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5z7kc"]
Sep 16 02:19:10.523393 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:10.523330    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:19:10.523446 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:10.523434    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5z7kc" podUID="4b569dfd-1a91-4dfd-a893-355d2a94681c"
Sep 16 02:19:10.526848 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:10.524001    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2mmw9"]
Sep 16 02:19:10.526848 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:10.524099    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:19:10.526848 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:10.524234    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mmw9" podUID="f05bbb56-ee96-4d5c-918d-18cddf968e87"
Sep 16 02:19:10.535558 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:10.535492    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p7rcn"]
Sep 16 02:19:10.543069 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:10.543041    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:19:10.543551 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:10.543161    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7rcn" podUID="57b965f8-cef0-417c-b3a8-8c5c1a0883bf"
Sep 16 02:19:10.576596 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:10.576567    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:10.677667 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:10.677645    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:10.880385 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:10.880322    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:10.930544 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:10.930521    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:10.983054 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:10.983032    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:11.179246 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:11.179226    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jhvrv_6a767a10-1fc2-4f3c-b655-74c71d814656/node-ca/0.log"
Sep 16 02:19:11.547392 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:11.547318    2565 generic.go:356] "Generic (PLEG): container finished" podID="0e3d5667-b41e-4ff5-beb3-ebe791b48183" containerID="71fbf675c3f2186abd07dbe1c4922e88654829a0de9fadf0ffe83c63474289aa" exitCode=0
Sep 16 02:19:11.547392 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:11.547352    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5nl9d" event={"ID":"0e3d5667-b41e-4ff5-beb3-ebe791b48183","Type":"ContainerDied","Data":"71fbf675c3f2186abd07dbe1c4922e88654829a0de9fadf0ffe83c63474289aa"}
Sep 16 02:19:11.689346 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:11.689327    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:12.385454 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:12.385423    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:19:12.385454 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:12.385456    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:19:12.385715 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:12.385427    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:19:12.385715 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:12.385528    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7rcn" podUID="57b965f8-cef0-417c-b3a8-8c5c1a0883bf"
Sep 16 02:19:12.385715 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:12.385598    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5z7kc" podUID="4b569dfd-1a91-4dfd-a893-355d2a94681c"
Sep 16 02:19:12.385715 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:12.385677    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mmw9" podUID="f05bbb56-ee96-4d5c-918d-18cddf968e87"
Sep 16 02:19:12.886288 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:12.886259    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:12.986864 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:12.986838    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:13.349333 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:13.349279    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:13.437427 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:13.437403    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:13.553048 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:13.553023    2565 generic.go:356] "Generic (PLEG): container finished" podID="0e3d5667-b41e-4ff5-beb3-ebe791b48183" containerID="afd39d6189934311aa4dcb40d064d0a70c07910383d74c58b947d0a36eece5d8" exitCode=0
Sep 16 02:19:13.553143 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:13.553062    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5nl9d" event={"ID":"0e3d5667-b41e-4ff5-beb3-ebe791b48183","Type":"ContainerDied","Data":"afd39d6189934311aa4dcb40d064d0a70c07910383d74c58b947d0a36eece5d8"}
Sep 16 02:19:13.609756 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:13.609692    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:13.709455 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:13.709436    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:13.889028 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:13.888971    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:14.385651 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:14.385261    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:19:14.385651 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:14.385310    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:19:14.385651 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:14.385261    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:19:14.385651 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:14.385435    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7rcn" podUID="57b965f8-cef0-417c-b3a8-8c5c1a0883bf"
Sep 16 02:19:14.385651 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:14.385526    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mmw9" podUID="f05bbb56-ee96-4d5c-918d-18cddf968e87"
Sep 16 02:19:14.385651 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:14.385611    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5z7kc" podUID="4b569dfd-1a91-4dfd-a893-355d2a94681c"
Sep 16 02:19:14.420286 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:14.420227    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:14.793772 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:14.793686    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:15.189953 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:15.189918    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:15.594769 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:15.594697    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:15.784678 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:15.784646    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:16.013772 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:16.013741    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2s55\" (UniqueName: \"kubernetes.io/projected/f05bbb56-ee96-4d5c-918d-18cddf968e87-kube-api-access-d2s55\") pod \"network-check-target-2mmw9\" (UID: \"f05bbb56-ee96-4d5c-918d-18cddf968e87\") " pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:19:16.013936 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:16.013789    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b569dfd-1a91-4dfd-a893-355d2a94681c-original-pull-secret\") pod \"global-pull-secret-syncer-5z7kc\" (UID: \"4b569dfd-1a91-4dfd-a893-355d2a94681c\") " pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:19:16.013936 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:16.013828    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57b965f8-cef0-417c-b3a8-8c5c1a0883bf-metrics-certs\") pod \"network-metrics-daemon-p7rcn\" (UID: \"57b965f8-cef0-417c-b3a8-8c5c1a0883bf\") " pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:19:16.013936 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:16.013924    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 02:19:16.014053 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:16.013943    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 02:19:16.014053 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:16.013994    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b569dfd-1a91-4dfd-a893-355d2a94681c-original-pull-secret podName:4b569dfd-1a91-4dfd-a893-355d2a94681c nodeName:}" failed. No retries permitted until 2026-09-16 02:19:48.013981825 +0000 UTC m=+66.064326299 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b569dfd-1a91-4dfd-a893-355d2a94681c-original-pull-secret") pod "global-pull-secret-syncer-5z7kc" (UID: "4b569dfd-1a91-4dfd-a893-355d2a94681c") : object "kube-system"/"original-pull-secret" not registered
Sep 16 02:19:16.014053 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:16.013949    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 02:19:16.014053 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:16.014037    2565 projected.go:196] Error preparing data for projected volume kube-api-access-d2s55 for pod openshift-network-diagnostics/network-check-target-2mmw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 02:19:16.014224 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:16.014085    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f05bbb56-ee96-4d5c-918d-18cddf968e87-kube-api-access-d2s55 podName:f05bbb56-ee96-4d5c-918d-18cddf968e87 nodeName:}" failed. No retries permitted until 2026-09-16 02:19:48.014069424 +0000 UTC m=+66.064413906 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-d2s55" (UniqueName: "kubernetes.io/projected/f05bbb56-ee96-4d5c-918d-18cddf968e87-kube-api-access-d2s55") pod "network-check-target-2mmw9" (UID: "f05bbb56-ee96-4d5c-918d-18cddf968e87") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 02:19:16.014224 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:16.013925    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 02:19:16.014224 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:16.014123    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57b965f8-cef0-417c-b3a8-8c5c1a0883bf-metrics-certs podName:57b965f8-cef0-417c-b3a8-8c5c1a0883bf nodeName:}" failed. No retries permitted until 2026-09-16 02:19:48.014116402 +0000 UTC m=+66.064460872 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/57b965f8-cef0-417c-b3a8-8c5c1a0883bf-metrics-certs") pod "network-metrics-daemon-p7rcn" (UID: "57b965f8-cef0-417c-b3a8-8c5c1a0883bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 02:19:16.185834 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:16.185806    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:16.385553 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:16.385518    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:19:16.385553 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:16.385543    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:19:16.386049 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:16.385658    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7rcn" podUID="57b965f8-cef0-417c-b3a8-8c5c1a0883bf"
Sep 16 02:19:16.386049 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:16.385708    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:19:16.386049 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:16.385815    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5z7kc" podUID="4b569dfd-1a91-4dfd-a893-355d2a94681c"
Sep 16 02:19:16.386049 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:16.385937    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mmw9" podUID="f05bbb56-ee96-4d5c-918d-18cddf968e87"
Sep 16 02:19:16.589422 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:16.589335    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:16.784892 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:16.784851    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:16.831660 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:16.831633    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:17.384096 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:17.384054    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:17.587219 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:17.587189    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:17.637318 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:17.637238    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:17.982879 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:17.982703    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:18.181375 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:18.181327    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:18.281863 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:18.281791    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:18.385032 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:18.385015    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:19:18.385032 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:18.385031    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:19:18.385154 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:18.385037    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:19:18.385154 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:18.385120    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7rcn" podUID="57b965f8-cef0-417c-b3a8-8c5c1a0883bf"
Sep 16 02:19:18.385241 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:18.385190    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5z7kc" podUID="4b569dfd-1a91-4dfd-a893-355d2a94681c"
Sep 16 02:19:18.385282 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:18.385268    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mmw9" podUID="f05bbb56-ee96-4d5c-918d-18cddf968e87"
Sep 16 02:19:18.565777 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:18.565730    2565 generic.go:356] "Generic (PLEG): container finished" podID="0e3d5667-b41e-4ff5-beb3-ebe791b48183" containerID="fb4cd46e7526ae2c18a5c784c6ab8dfb99b8711ce51d2f312a56a1e13324d586" exitCode=0
Sep 16 02:19:18.565857 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:18.565778    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5nl9d" event={"ID":"0e3d5667-b41e-4ff5-beb3-ebe791b48183","Type":"ContainerDied","Data":"fb4cd46e7526ae2c18a5c784c6ab8dfb99b8711ce51d2f312a56a1e13324d586"}
Sep 16 02:19:18.586320 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:18.586295    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:19.123151 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:19.123123    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:19.380131 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:19.380079    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:19.570725 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:19.570698    2565 generic.go:356] "Generic (PLEG): container finished" podID="0e3d5667-b41e-4ff5-beb3-ebe791b48183" containerID="0db13269b866898621aeabf0c8928121ab515d8cfacefac3cdf28b6efc007a14" exitCode=0
Sep 16 02:19:19.570863 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:19.570744    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5nl9d" event={"ID":"0e3d5667-b41e-4ff5-beb3-ebe791b48183","Type":"ContainerDied","Data":"0db13269b866898621aeabf0c8928121ab515d8cfacefac3cdf28b6efc007a14"}
Sep 16 02:19:19.781255 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:19.781222    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:19.984522 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:19.984499    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:20.178928 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:20.178898    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:20.384962 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:20.384894    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:19:20.385078 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:20.384894    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:19:20.385078 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:20.385005    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5z7kc" podUID="4b569dfd-1a91-4dfd-a893-355d2a94681c"
Sep 16 02:19:20.385148 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:20.385105    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mmw9" podUID="f05bbb56-ee96-4d5c-918d-18cddf968e87"
Sep 16 02:19:20.385148 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:20.384905    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:19:20.385244 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:20.385223    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7rcn" podUID="57b965f8-cef0-417c-b3a8-8c5c1a0883bf"
Sep 16 02:19:20.577199 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:20.577170    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5nl9d" event={"ID":"0e3d5667-b41e-4ff5-beb3-ebe791b48183","Type":"ContainerStarted","Data":"fd4d0e89b7458abc24d80c47c7771dca5fbdf52656d3998feea8e40216968c82"}
Sep 16 02:19:20.587250 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:20.587211    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:20.596226 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:20.596186    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5nl9d" podStartSLOduration=9.546765123 podStartE2EDuration="38.596173763s" totalImagesPullingTime="29.04940864s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 02:18:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:19:20.595186366 +0000 UTC m=+38.645530877" watchObservedRunningTime="2026-09-16 02:19:20.596173763 +0000 UTC m=+38.646518256"
Sep 16 02:19:21.184432 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:21.184407    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:21.284945 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:21.284919    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:21.336314 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:21.336288    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:21.781538 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:21.781511    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:21.907424 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:21.907397    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:22.007858 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:22.007831    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:22.064448 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:22.064381    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:22.184225 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:22.184200    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:22.386012 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:22.385953    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:19:22.386338 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:22.386039    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7rcn" podUID="57b965f8-cef0-417c-b3a8-8c5c1a0883bf"
Sep 16 02:19:22.386338 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:22.386154    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:19:22.386338 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:22.386301    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mmw9" podUID="f05bbb56-ee96-4d5c-918d-18cddf968e87"
Sep 16 02:19:22.386478 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:22.386350    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:19:22.386478 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:22.386439    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5z7kc" podUID="4b569dfd-1a91-4dfd-a893-355d2a94681c"
Sep 16 02:19:22.587575 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:22.587550    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:23.031773 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:23.031745    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:23.082851 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:23.082821    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:23.178829 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:23.178807    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:23.385074 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:23.385017    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:23.580334 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:23.580312    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:24.384699 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:24.384664    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:19:24.384699 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:24.384694    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:19:24.384941 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:24.384664    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:19:24.384941 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:24.384798    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5z7kc" podUID="4b569dfd-1a91-4dfd-a893-355d2a94681c"
Sep 16 02:19:24.384941 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:24.384857    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mmw9" podUID="f05bbb56-ee96-4d5c-918d-18cddf968e87"
Sep 16 02:19:24.385099 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:24.384972    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7rcn" podUID="57b965f8-cef0-417c-b3a8-8c5c1a0883bf"
Sep 16 02:19:26.384481 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:26.384445    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:19:26.384986 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:26.384445    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:19:26.384986 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:26.384445    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:19:26.384986 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:26.384635    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7rcn" podUID="57b965f8-cef0-417c-b3a8-8c5c1a0883bf"
Sep 16 02:19:26.384986 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:26.384539    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mmw9" podUID="f05bbb56-ee96-4d5c-918d-18cddf968e87"
Sep 16 02:19:26.384986 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:26.384702    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5z7kc" podUID="4b569dfd-1a91-4dfd-a893-355d2a94681c"
Sep 16 02:19:28.385342 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:28.385316    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:19:28.385759 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:28.385327    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:19:28.385759 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:28.385450    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7rcn" podUID="57b965f8-cef0-417c-b3a8-8c5c1a0883bf"
Sep 16 02:19:28.385759 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:28.385511    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5z7kc" podUID="4b569dfd-1a91-4dfd-a893-355d2a94681c"
Sep 16 02:19:28.385759 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:28.385550    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:19:28.385759 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:28.385651    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mmw9" podUID="f05bbb56-ee96-4d5c-918d-18cddf968e87"
Sep 16 02:19:30.384891 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:30.384851    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:19:30.385446 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:30.384866    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:19:30.385852 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:30.385813    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5z7kc" podUID="4b569dfd-1a91-4dfd-a893-355d2a94681c"
Sep 16 02:19:30.386180 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:30.384937    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:19:30.386430 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:30.386408    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mmw9" podUID="f05bbb56-ee96-4d5c-918d-18cddf968e87"
Sep 16 02:19:30.386974 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:30.386950    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7rcn" podUID="57b965f8-cef0-417c-b3a8-8c5c1a0883bf"
Sep 16 02:19:32.387264 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:32.387237    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:19:32.387687 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:32.387333    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5z7kc" podUID="4b569dfd-1a91-4dfd-a893-355d2a94681c"
Sep 16 02:19:32.387687 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:32.387388    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:19:32.387687 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:32.387459    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mmw9" podUID="f05bbb56-ee96-4d5c-918d-18cddf968e87"
Sep 16 02:19:32.387687 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:32.387482    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:19:32.387687 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:32.387563    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7rcn" podUID="57b965f8-cef0-417c-b3a8-8c5c1a0883bf"
Sep 16 02:19:33.166922 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.166891    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:33.248383 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.248316    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:33.348551 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.348528    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:33.447530 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.447475    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:33.651218 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.651195    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeReady"
Sep 16 02:19:33.651329 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.651306    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 16 02:19:33.685904 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.685885    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64594f967d-5d94c"]
Sep 16 02:19:33.694310 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.694292    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64594f967d-5d94c"
Sep 16 02:19:33.695913 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.695887    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gmh95"]
Sep 16 02:19:33.697068 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.697025    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 16 02:19:33.697068 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.697039    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 16 02:19:33.697218 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.697183    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-p4mjd\""
Sep 16 02:19:33.697282 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.697216    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 16 02:19:33.702323 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.702300    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 16 02:19:33.703260 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.703241    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kgfsm"]
Sep 16 02:19:33.703396 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.703380    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gmh95"
Sep 16 02:19:33.705562 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.705547    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 16 02:19:33.705654 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.705593    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 16 02:19:33.705860 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.705838    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p58tv\""
Sep 16 02:19:33.705860 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.705858    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 16 02:19:33.721049 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.721031    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64594f967d-5d94c"]
Sep 16 02:19:33.721135 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.721057    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gmh95"]
Sep 16 02:19:33.721135 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.721069    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kgfsm"]
Sep 16 02:19:33.721211 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.721146    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kgfsm"
Sep 16 02:19:33.723440 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.723418    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-74plt\""
Sep 16 02:19:33.723527 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.723419    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 16 02:19:33.723614 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.723599    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 16 02:19:33.723656 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.723626    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 16 02:19:33.723656 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.723607    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 16 02:19:33.741062 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.741043    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4e7c13f3-f878-4c05-93e5-b2939da20191-crio-socket\") pod \"insights-runtime-extractor-kgfsm\" (UID: \"4e7c13f3-f878-4c05-93e5-b2939da20191\") " pod="openshift-insights/insights-runtime-extractor-kgfsm"
Sep 16 02:19:33.741170 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.741076    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e7c13f3-f878-4c05-93e5-b2939da20191-data-volume\") pod \"insights-runtime-extractor-kgfsm\" (UID: \"4e7c13f3-f878-4c05-93e5-b2939da20191\") " pod="openshift-insights/insights-runtime-extractor-kgfsm"
Sep 16 02:19:33.741170 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.741106    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d0a3b230-68f1-4b0e-bd12-7958e83505b5-ca-trust-extracted\") pod \"image-registry-64594f967d-5d94c\" (UID: \"d0a3b230-68f1-4b0e-bd12-7958e83505b5\") " pod="openshift-image-registry/image-registry-64594f967d-5d94c"
Sep 16 02:19:33.741170 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.741148    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e7c13f3-f878-4c05-93e5-b2939da20191-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kgfsm\" (UID: \"4e7c13f3-f878-4c05-93e5-b2939da20191\") " pod="openshift-insights/insights-runtime-extractor-kgfsm"
Sep 16 02:19:33.741302 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.741175    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d0a3b230-68f1-4b0e-bd12-7958e83505b5-registry-certificates\") pod \"image-registry-64594f967d-5d94c\" (UID: \"d0a3b230-68f1-4b0e-bd12-7958e83505b5\") " pod="openshift-image-registry/image-registry-64594f967d-5d94c"
Sep 16 02:19:33.741302 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.741198    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0a3b230-68f1-4b0e-bd12-7958e83505b5-bound-sa-token\") pod \"image-registry-64594f967d-5d94c\" (UID: \"d0a3b230-68f1-4b0e-bd12-7958e83505b5\") " pod="openshift-image-registry/image-registry-64594f967d-5d94c"
Sep 16 02:19:33.741302 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.741239    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d0a3b230-68f1-4b0e-bd12-7958e83505b5-installation-pull-secrets\") pod \"image-registry-64594f967d-5d94c\" (UID: \"d0a3b230-68f1-4b0e-bd12-7958e83505b5\") " pod="openshift-image-registry/image-registry-64594f967d-5d94c"
Sep 16 02:19:33.741302 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.741277    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4rsj\" (UniqueName: \"kubernetes.io/projected/d0a3b230-68f1-4b0e-bd12-7958e83505b5-kube-api-access-w4rsj\") pod \"image-registry-64594f967d-5d94c\" (UID: \"d0a3b230-68f1-4b0e-bd12-7958e83505b5\") " pod="openshift-image-registry/image-registry-64594f967d-5d94c"
Sep 16 02:19:33.741486 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.741301    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6md4v\" (UniqueName: \"kubernetes.io/projected/3514ea95-b101-4089-b26a-d663d7865dd9-kube-api-access-6md4v\") pod \"ingress-canary-gmh95\" (UID: \"3514ea95-b101-4089-b26a-d663d7865dd9\") " pod="openshift-ingress-canary/ingress-canary-gmh95"
Sep 16 02:19:33.741486 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.741330    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e7c13f3-f878-4c05-93e5-b2939da20191-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kgfsm\" (UID: \"4e7c13f3-f878-4c05-93e5-b2939da20191\") " pod="openshift-insights/insights-runtime-extractor-kgfsm"
Sep 16 02:19:33.741486 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.741386    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0a3b230-68f1-4b0e-bd12-7958e83505b5-registry-tls\") pod \"image-registry-64594f967d-5d94c\" (UID: \"d0a3b230-68f1-4b0e-bd12-7958e83505b5\") " pod="openshift-image-registry/image-registry-64594f967d-5d94c"
Sep 16 02:19:33.741486 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.741408    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3514ea95-b101-4089-b26a-d663d7865dd9-cert\") pod \"ingress-canary-gmh95\" (UID: \"3514ea95-b101-4089-b26a-d663d7865dd9\") " pod="openshift-ingress-canary/ingress-canary-gmh95"
Sep 16 02:19:33.741486 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.741438    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d0a3b230-68f1-4b0e-bd12-7958e83505b5-image-registry-private-configuration\") pod \"image-registry-64594f967d-5d94c\" (UID: \"d0a3b230-68f1-4b0e-bd12-7958e83505b5\") " pod="openshift-image-registry/image-registry-64594f967d-5d94c"
Sep 16 02:19:33.741486 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.741464    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d0a3b230-68f1-4b0e-bd12-7958e83505b5-trusted-ca\") pod \"image-registry-64594f967d-5d94c\" (UID: \"d0a3b230-68f1-4b0e-bd12-7958e83505b5\") " pod="openshift-image-registry/image-registry-64594f967d-5d94c"
Sep 16 02:19:33.741486 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.741480    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7nsf\" (UniqueName: \"kubernetes.io/projected/4e7c13f3-f878-4c05-93e5-b2939da20191-kube-api-access-m7nsf\") pod \"insights-runtime-extractor-kgfsm\" (UID: \"4e7c13f3-f878-4c05-93e5-b2939da20191\") " pod="openshift-insights/insights-runtime-extractor-kgfsm"
Sep 16 02:19:33.798133 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.798116    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gz9mz"]
Sep 16 02:19:33.799799 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.799786    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gz9mz"
Sep 16 02:19:33.801984 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.801969    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 16 02:19:33.802152 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.802140    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w4x8g\""
Sep 16 02:19:33.802191 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.802173    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 16 02:19:33.809730 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.809700    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gz9mz"]
Sep 16 02:19:33.841818 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.841799    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d0a3b230-68f1-4b0e-bd12-7958e83505b5-ca-trust-extracted\") pod \"image-registry-64594f967d-5d94c\" (UID: \"d0a3b230-68f1-4b0e-bd12-7958e83505b5\") " pod="openshift-image-registry/image-registry-64594f967d-5d94c"
Sep 16 02:19:33.841917 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.841833    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e7c13f3-f878-4c05-93e5-b2939da20191-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kgfsm\" (UID: \"4e7c13f3-f878-4c05-93e5-b2939da20191\") " pod="openshift-insights/insights-runtime-extractor-kgfsm"
Sep 16 02:19:33.841917 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.841851    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d0a3b230-68f1-4b0e-bd12-7958e83505b5-registry-certificates\") pod \"image-registry-64594f967d-5d94c\" (UID: \"d0a3b230-68f1-4b0e-bd12-7958e83505b5\") " pod="openshift-image-registry/image-registry-64594f967d-5d94c"
Sep 16 02:19:33.841917 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.841866    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0a3b230-68f1-4b0e-bd12-7958e83505b5-bound-sa-token\") pod \"image-registry-64594f967d-5d94c\" (UID: \"d0a3b230-68f1-4b0e-bd12-7958e83505b5\") " pod="openshift-image-registry/image-registry-64594f967d-5d94c"
Sep 16 02:19:33.841917 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.841882    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d0a3b230-68f1-4b0e-bd12-7958e83505b5-installation-pull-secrets\") pod \"image-registry-64594f967d-5d94c\" (UID: \"d0a3b230-68f1-4b0e-bd12-7958e83505b5\") " pod="openshift-image-registry/image-registry-64594f967d-5d94c"
Sep 16 02:19:33.841917 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.841896    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4rsj\" (UniqueName: \"kubernetes.io/projected/d0a3b230-68f1-4b0e-bd12-7958e83505b5-kube-api-access-w4rsj\") pod \"image-registry-64594f967d-5d94c\" (UID: \"d0a3b230-68f1-4b0e-bd12-7958e83505b5\") " pod="openshift-image-registry/image-registry-64594f967d-5d94c"
Sep 16 02:19:33.841917 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.841911    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6md4v\" (UniqueName: \"kubernetes.io/projected/3514ea95-b101-4089-b26a-d663d7865dd9-kube-api-access-6md4v\") pod \"ingress-canary-gmh95\" (UID: \"3514ea95-b101-4089-b26a-d663d7865dd9\") " pod="openshift-ingress-canary/ingress-canary-gmh95"
Sep 16 02:19:33.842219 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.841929    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e7c13f3-f878-4c05-93e5-b2939da20191-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kgfsm\" (UID: \"4e7c13f3-f878-4c05-93e5-b2939da20191\") " pod="openshift-insights/insights-runtime-extractor-kgfsm"
Sep 16 02:19:33.842219 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.842078    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62b1f3ce-a76e-4c6d-8108-ffe145dd98a3-metrics-tls\") pod \"dns-default-gz9mz\" (UID: \"62b1f3ce-a76e-4c6d-8108-ffe145dd98a3\") " pod="openshift-dns/dns-default-gz9mz"
Sep 16 02:19:33.842219 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.842115    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnqhq\" (UniqueName: \"kubernetes.io/projected/62b1f3ce-a76e-4c6d-8108-ffe145dd98a3-kube-api-access-qnqhq\") pod \"dns-default-gz9mz\" (UID: \"62b1f3ce-a76e-4c6d-8108-ffe145dd98a3\") " pod="openshift-dns/dns-default-gz9mz"
Sep 16 02:19:33.842219 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.842158    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0a3b230-68f1-4b0e-bd12-7958e83505b5-registry-tls\") pod \"image-registry-64594f967d-5d94c\" (UID: \"d0a3b230-68f1-4b0e-bd12-7958e83505b5\") " pod="openshift-image-registry/image-registry-64594f967d-5d94c"
Sep 16 02:19:33.842219 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.842179    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3514ea95-b101-4089-b26a-d663d7865dd9-cert\") pod \"ingress-canary-gmh95\" (UID: \"3514ea95-b101-4089-b26a-d663d7865dd9\") " pod="openshift-ingress-canary/ingress-canary-gmh95"
Sep 16 02:19:33.842219 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.842205    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d0a3b230-68f1-4b0e-bd12-7958e83505b5-ca-trust-extracted\") pod \"image-registry-64594f967d-5d94c\" (UID: \"d0a3b230-68f1-4b0e-bd12-7958e83505b5\") " pod="openshift-image-registry/image-registry-64594f967d-5d94c"
Sep 16 02:19:33.842547 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.842208    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62b1f3ce-a76e-4c6d-8108-ffe145dd98a3-tmp-dir\") pod \"dns-default-gz9mz\" (UID: \"62b1f3ce-a76e-4c6d-8108-ffe145dd98a3\") " pod="openshift-dns/dns-default-gz9mz"
Sep 16 02:19:33.842547 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.842333    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d0a3b230-68f1-4b0e-bd12-7958e83505b5-image-registry-private-configuration\") pod \"image-registry-64594f967d-5d94c\" (UID: \"d0a3b230-68f1-4b0e-bd12-7958e83505b5\") " pod="openshift-image-registry/image-registry-64594f967d-5d94c"
Sep 16 02:19:33.842547 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.842355    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/62b1f3ce-a76e-4c6d-8108-ffe145dd98a3-config-volume\") pod \"dns-default-gz9mz\" (UID: \"62b1f3ce-a76e-4c6d-8108-ffe145dd98a3\") " pod="openshift-dns/dns-default-gz9mz"
Sep 16 02:19:33.842547 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.842482    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d0a3b230-68f1-4b0e-bd12-7958e83505b5-trusted-ca\") pod \"image-registry-64594f967d-5d94c\" (UID: \"d0a3b230-68f1-4b0e-bd12-7958e83505b5\") " pod="openshift-image-registry/image-registry-64594f967d-5d94c"
Sep 16 02:19:33.842547 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.842510    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7nsf\" (UniqueName: \"kubernetes.io/projected/4e7c13f3-f878-4c05-93e5-b2939da20191-kube-api-access-m7nsf\") pod \"insights-runtime-extractor-kgfsm\" (UID: \"4e7c13f3-f878-4c05-93e5-b2939da20191\") " pod="openshift-insights/insights-runtime-extractor-kgfsm"
Sep 16 02:19:33.842547 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.842534    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e7c13f3-f878-4c05-93e5-b2939da20191-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kgfsm\" (UID: \"4e7c13f3-f878-4c05-93e5-b2939da20191\") " pod="openshift-insights/insights-runtime-extractor-kgfsm"
Sep 16 02:19:33.842849 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.842559    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4e7c13f3-f878-4c05-93e5-b2939da20191-crio-socket\") pod \"insights-runtime-extractor-kgfsm\" (UID: \"4e7c13f3-f878-4c05-93e5-b2939da20191\") " pod="openshift-insights/insights-runtime-extractor-kgfsm"
Sep 16 02:19:33.842849 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.842604    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e7c13f3-f878-4c05-93e5-b2939da20191-data-volume\") pod \"insights-runtime-extractor-kgfsm\" (UID: \"4e7c13f3-f878-4c05-93e5-b2939da20191\") " pod="openshift-insights/insights-runtime-extractor-kgfsm"
Sep 16 02:19:33.842849 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.842820    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d0a3b230-68f1-4b0e-bd12-7958e83505b5-registry-certificates\") pod \"image-registry-64594f967d-5d94c\" (UID: \"d0a3b230-68f1-4b0e-bd12-7958e83505b5\") " pod="openshift-image-registry/image-registry-64594f967d-5d94c"
Sep 16 02:19:33.842993 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.842875    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e7c13f3-f878-4c05-93e5-b2939da20191-data-volume\") pod \"insights-runtime-extractor-kgfsm\" (UID: \"4e7c13f3-f878-4c05-93e5-b2939da20191\") " pod="openshift-insights/insights-runtime-extractor-kgfsm"
Sep 16 02:19:33.843115 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.843048    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4e7c13f3-f878-4c05-93e5-b2939da20191-crio-socket\") pod \"insights-runtime-extractor-kgfsm\" (UID: \"4e7c13f3-f878-4c05-93e5-b2939da20191\") " pod="openshift-insights/insights-runtime-extractor-kgfsm"
Sep 16 02:19:33.843970 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.843948    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d0a3b230-68f1-4b0e-bd12-7958e83505b5-trusted-ca\") pod \"image-registry-64594f967d-5d94c\" (UID: \"d0a3b230-68f1-4b0e-bd12-7958e83505b5\") " pod="openshift-image-registry/image-registry-64594f967d-5d94c"
Sep 16 02:19:33.846060 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.846033    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e7c13f3-f878-4c05-93e5-b2939da20191-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kgfsm\" (UID: \"4e7c13f3-f878-4c05-93e5-b2939da20191\") " pod="openshift-insights/insights-runtime-extractor-kgfsm"
Sep 16 02:19:33.846166 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.846147    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d0a3b230-68f1-4b0e-bd12-7958e83505b5-installation-pull-secrets\") pod \"image-registry-64594f967d-5d94c\" (UID: \"d0a3b230-68f1-4b0e-bd12-7958e83505b5\") " pod="openshift-image-registry/image-registry-64594f967d-5d94c"
Sep 16 02:19:33.846206 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.846156    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0a3b230-68f1-4b0e-bd12-7958e83505b5-registry-tls\") pod \"image-registry-64594f967d-5d94c\" (UID: \"d0a3b230-68f1-4b0e-bd12-7958e83505b5\") " pod="openshift-image-registry/image-registry-64594f967d-5d94c"
Sep 16 02:19:33.846206 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.846193    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3514ea95-b101-4089-b26a-d663d7865dd9-cert\") pod \"ingress-canary-gmh95\" (UID: \"3514ea95-b101-4089-b26a-d663d7865dd9\") " pod="openshift-ingress-canary/ingress-canary-gmh95"
Sep 16 02:19:33.846300 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.846231    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d0a3b230-68f1-4b0e-bd12-7958e83505b5-image-registry-private-configuration\") pod \"image-registry-64594f967d-5d94c\" (UID: \"d0a3b230-68f1-4b0e-bd12-7958e83505b5\") " pod="openshift-image-registry/image-registry-64594f967d-5d94c"
Sep 16 02:19:33.850645 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.850613    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6md4v\" (UniqueName: \"kubernetes.io/projected/3514ea95-b101-4089-b26a-d663d7865dd9-kube-api-access-6md4v\") pod \"ingress-canary-gmh95\" (UID: \"3514ea95-b101-4089-b26a-d663d7865dd9\") " pod="openshift-ingress-canary/ingress-canary-gmh95"
Sep 16 02:19:33.851173 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.851148    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0a3b230-68f1-4b0e-bd12-7958e83505b5-bound-sa-token\") pod \"image-registry-64594f967d-5d94c\" (UID: \"d0a3b230-68f1-4b0e-bd12-7958e83505b5\") " pod="openshift-image-registry/image-registry-64594f967d-5d94c"
Sep 16 02:19:33.851406 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.851389    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4rsj\" (UniqueName: \"kubernetes.io/projected/d0a3b230-68f1-4b0e-bd12-7958e83505b5-kube-api-access-w4rsj\") pod \"image-registry-64594f967d-5d94c\" (UID: \"d0a3b230-68f1-4b0e-bd12-7958e83505b5\") " pod="openshift-image-registry/image-registry-64594f967d-5d94c"
Sep 16 02:19:33.851463 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.851405    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7nsf\" (UniqueName: \"kubernetes.io/projected/4e7c13f3-f878-4c05-93e5-b2939da20191-kube-api-access-m7nsf\") pod \"insights-runtime-extractor-kgfsm\" (UID: \"4e7c13f3-f878-4c05-93e5-b2939da20191\") " pod="openshift-insights/insights-runtime-extractor-kgfsm"
Sep 16 02:19:33.891829 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.891805    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:33.943536 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.943509    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62b1f3ce-a76e-4c6d-8108-ffe145dd98a3-tmp-dir\") pod \"dns-default-gz9mz\" (UID: \"62b1f3ce-a76e-4c6d-8108-ffe145dd98a3\") " pod="openshift-dns/dns-default-gz9mz"
Sep 16 02:19:33.943628 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.943557    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/62b1f3ce-a76e-4c6d-8108-ffe145dd98a3-config-volume\") pod \"dns-default-gz9mz\" (UID: \"62b1f3ce-a76e-4c6d-8108-ffe145dd98a3\") " pod="openshift-dns/dns-default-gz9mz"
Sep 16 02:19:33.943706 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.943688    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62b1f3ce-a76e-4c6d-8108-ffe145dd98a3-metrics-tls\") pod \"dns-default-gz9mz\" (UID: \"62b1f3ce-a76e-4c6d-8108-ffe145dd98a3\") " pod="openshift-dns/dns-default-gz9mz"
Sep 16 02:19:33.943766 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.943730    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnqhq\" (UniqueName: \"kubernetes.io/projected/62b1f3ce-a76e-4c6d-8108-ffe145dd98a3-kube-api-access-qnqhq\") pod \"dns-default-gz9mz\" (UID: \"62b1f3ce-a76e-4c6d-8108-ffe145dd98a3\") " pod="openshift-dns/dns-default-gz9mz"
Sep 16 02:19:33.944319 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.944293    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62b1f3ce-a76e-4c6d-8108-ffe145dd98a3-tmp-dir\") pod \"dns-default-gz9mz\" (UID: \"62b1f3ce-a76e-4c6d-8108-ffe145dd98a3\") " pod="openshift-dns/dns-default-gz9mz"
Sep 16 02:19:33.944815 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.944790    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/62b1f3ce-a76e-4c6d-8108-ffe145dd98a3-config-volume\") pod \"dns-default-gz9mz\" (UID: \"62b1f3ce-a76e-4c6d-8108-ffe145dd98a3\") " pod="openshift-dns/dns-default-gz9mz"
Sep 16 02:19:33.946823 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.946803    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62b1f3ce-a76e-4c6d-8108-ffe145dd98a3-metrics-tls\") pod \"dns-default-gz9mz\" (UID: \"62b1f3ce-a76e-4c6d-8108-ffe145dd98a3\") " pod="openshift-dns/dns-default-gz9mz"
Sep 16 02:19:33.951875 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:33.951831    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnqhq\" (UniqueName: \"kubernetes.io/projected/62b1f3ce-a76e-4c6d-8108-ffe145dd98a3-kube-api-access-qnqhq\") pod \"dns-default-gz9mz\" (UID: \"62b1f3ce-a76e-4c6d-8108-ffe145dd98a3\") " pod="openshift-dns/dns-default-gz9mz"
Sep 16 02:19:34.003829 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:34.003805    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64594f967d-5d94c"
Sep 16 02:19:34.013211 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:34.013191    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gmh95"
Sep 16 02:19:34.029326 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:34.029306    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kgfsm"
Sep 16 02:19:34.107793 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:34.107737    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gz9mz"
Sep 16 02:19:34.286298 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:34.286174    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gmh95"]
Sep 16 02:19:34.289661 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:34.289639    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64594f967d-5d94c"]
Sep 16 02:19:34.289813 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:19:34.289781    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3514ea95_b101_4089_b26a_d663d7865dd9.slice/crio-dc5331e696c364a1446ffcda6f091851c8695f5b12b78464d572d0eae8defa7e WatchSource:0}: Error finding container dc5331e696c364a1446ffcda6f091851c8695f5b12b78464d572d0eae8defa7e: Status 404 returned error can't find the container with id dc5331e696c364a1446ffcda6f091851c8695f5b12b78464d572d0eae8defa7e
Sep 16 02:19:34.292502 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:19:34.292477    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0a3b230_68f1_4b0e_bd12_7958e83505b5.slice/crio-89c97ea1fa118aff15af860ff30eadd292045ea1dabc38305809a88c87f1106b WatchSource:0}: Error finding container 89c97ea1fa118aff15af860ff30eadd292045ea1dabc38305809a88c87f1106b: Status 404 returned error can't find the container with id 89c97ea1fa118aff15af860ff30eadd292045ea1dabc38305809a88c87f1106b
Sep 16 02:19:34.325953 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:34.325933    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kgfsm"]
Sep 16 02:19:34.332212 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:19:34.332190    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e7c13f3_f878_4c05_93e5_b2939da20191.slice/crio-5825f6fb1ba0dc205e6cb1fd523adbfa27713ae9b8bf1db16119454c5de10291 WatchSource:0}: Error finding container 5825f6fb1ba0dc205e6cb1fd523adbfa27713ae9b8bf1db16119454c5de10291: Status 404 returned error can't find the container with id 5825f6fb1ba0dc205e6cb1fd523adbfa27713ae9b8bf1db16119454c5de10291
Sep 16 02:19:34.388669 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:34.388647    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:19:34.388778 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:34.388679    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:19:34.388778 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:34.388746    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:19:34.391213 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:34.391002    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 02:19:34.392653 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:34.392240    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gz9mz"]
Sep 16 02:19:34.392653 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:34.392304    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 02:19:34.392653 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:34.392309    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 02:19:34.392653 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:34.392477    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ss74q\""
Sep 16 02:19:34.392653 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:34.392556    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7ktl5\""
Sep 16 02:19:34.392931 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:34.392738    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 02:19:34.395538 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:19:34.395514    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62b1f3ce_a76e_4c6d_8108_ffe145dd98a3.slice/crio-9fae1734baa91562f0e4f14d7f7de3c2765fee40f3032356593b3ced76275d7a WatchSource:0}: Error finding container 9fae1734baa91562f0e4f14d7f7de3c2765fee40f3032356593b3ced76275d7a: Status 404 returned error can't find the container with id 9fae1734baa91562f0e4f14d7f7de3c2765fee40f3032356593b3ced76275d7a
Sep 16 02:19:34.409913 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:34.409890    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:34.510292 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:34.510266    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:34.584009 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:34.583938    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:34.608113 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:34.608079    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kgfsm" event={"ID":"4e7c13f3-f878-4c05-93e5-b2939da20191","Type":"ContainerStarted","Data":"f470045f9ba1853224b06751ba588af3950bea2cdc76094d9214180f9065e58d"}
Sep 16 02:19:34.608256 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:34.608137    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kgfsm" event={"ID":"4e7c13f3-f878-4c05-93e5-b2939da20191","Type":"ContainerStarted","Data":"5825f6fb1ba0dc205e6cb1fd523adbfa27713ae9b8bf1db16119454c5de10291"}
Sep 16 02:19:34.609707 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:34.609683    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64594f967d-5d94c" event={"ID":"d0a3b230-68f1-4b0e-bd12-7958e83505b5","Type":"ContainerStarted","Data":"70381ae6a56ee00324ad5343f349c42ed1bf0ce2f1006a93889409968598cdf9"}
Sep 16 02:19:34.609795 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:34.609733    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64594f967d-5d94c" event={"ID":"d0a3b230-68f1-4b0e-bd12-7958e83505b5","Type":"ContainerStarted","Data":"89c97ea1fa118aff15af860ff30eadd292045ea1dabc38305809a88c87f1106b"}
Sep 16 02:19:34.609795 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:34.609766    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64594f967d-5d94c"
Sep 16 02:19:34.610895 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:34.610874    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gz9mz" event={"ID":"62b1f3ce-a76e-4c6d-8108-ffe145dd98a3","Type":"ContainerStarted","Data":"9fae1734baa91562f0e4f14d7f7de3c2765fee40f3032356593b3ced76275d7a"}
Sep 16 02:19:34.612074 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:34.612037    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gmh95" event={"ID":"3514ea95-b101-4089-b26a-d663d7865dd9","Type":"ContainerStarted","Data":"dc5331e696c364a1446ffcda6f091851c8695f5b12b78464d572d0eae8defa7e"}
Sep 16 02:19:34.632174 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:34.632123    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64594f967d-5d94c" podStartSLOduration=1.632104306 podStartE2EDuration="1.632104306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:19:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:19:34.630765374 +0000 UTC m=+52.681109887" watchObservedRunningTime="2026-09-16 02:19:34.632104306 +0000 UTC m=+52.682448803"
Sep 16 02:19:34.781940 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:34.781907    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:34.843877 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:34.843808    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:34.919894 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:34.919801    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:35.141629 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:35.141554    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-28zx4"]
Sep 16 02:19:35.143474 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:35.143447    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-28zx4"
Sep 16 02:19:35.146237 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:35.146207    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 16 02:19:35.146395 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:35.146344    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 16 02:19:35.146534 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:35.146516    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-jntlh\""
Sep 16 02:19:35.154612 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:35.154586    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnz7b\" (UniqueName: \"kubernetes.io/projected/e97c2084-e633-418b-a513-a1ea5875e1ba-kube-api-access-xnz7b\") pod \"downloads-76f99584f4-28zx4\" (UID: \"e97c2084-e633-418b-a513-a1ea5875e1ba\") " pod="openshift-console/downloads-76f99584f4-28zx4"
Sep 16 02:19:35.155433 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:35.155405    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-28zx4"]
Sep 16 02:19:35.161411 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:35.161386    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:35.213740 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:35.213711    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:35.255448 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:35.255427    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnz7b\" (UniqueName: \"kubernetes.io/projected/e97c2084-e633-418b-a513-a1ea5875e1ba-kube-api-access-xnz7b\") pod \"downloads-76f99584f4-28zx4\" (UID: \"e97c2084-e633-418b-a513-a1ea5875e1ba\") " pod="openshift-console/downloads-76f99584f4-28zx4"
Sep 16 02:19:35.263490 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:35.263466    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnz7b\" (UniqueName: \"kubernetes.io/projected/e97c2084-e633-418b-a513-a1ea5875e1ba-kube-api-access-xnz7b\") pod \"downloads-76f99584f4-28zx4\" (UID: \"e97c2084-e633-418b-a513-a1ea5875e1ba\") " pod="openshift-console/downloads-76f99584f4-28zx4"
Sep 16 02:19:35.265574 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:35.265546    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:35.450609 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:35.450572    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:35.455009 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:35.454985    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-28zx4"
Sep 16 02:19:35.617920 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:35.617884    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kgfsm" event={"ID":"4e7c13f3-f878-4c05-93e5-b2939da20191","Type":"ContainerStarted","Data":"d348effcf4ec7c07a0e4860d84ee4e0a30b18e07fd43d1072863479e9de2bb69"}
Sep 16 02:19:35.746717 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:35.746634    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-28zx4"]
Sep 16 02:19:35.828417 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:35.828382    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:35.880153 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:35.880116    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:36.025412 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:36.025296    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:36.077814 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:36.077765    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:36.151725 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:19:36.151685    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode97c2084_e633_418b_a513_a1ea5875e1ba.slice/crio-0061a856c06056b19e00d9b1142ad1a47a3c606408ae106b03d81d0e1098373f WatchSource:0}: Error finding container 0061a856c06056b19e00d9b1142ad1a47a3c606408ae106b03d81d0e1098373f: Status 404 returned error can't find the container with id 0061a856c06056b19e00d9b1142ad1a47a3c606408ae106b03d81d0e1098373f
Sep 16 02:19:36.622542 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:36.622495    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-28zx4" event={"ID":"e97c2084-e633-418b-a513-a1ea5875e1ba","Type":"ContainerStarted","Data":"0061a856c06056b19e00d9b1142ad1a47a3c606408ae106b03d81d0e1098373f"}
Sep 16 02:19:36.633886 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:36.633857    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:36.836315 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:36.836284    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:36.937309 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:36.937274    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:36.989437 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:36.989404    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:37.182083 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:37.182031    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:37.283528 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:37.283500    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:37.627941 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:37.627859    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gz9mz" event={"ID":"62b1f3ce-a76e-4c6d-8108-ffe145dd98a3","Type":"ContainerStarted","Data":"90ab4dacd8ea2cac40f4bd80e154eed5c6f85a4d00725d4a6f1f18bcadad2925"}
Sep 16 02:19:37.627941 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:37.627913    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gz9mz" event={"ID":"62b1f3ce-a76e-4c6d-8108-ffe145dd98a3","Type":"ContainerStarted","Data":"e5af6f6e832a327496f565f770b5a2b006ca85ef162f821149177090ba87b6a0"}
Sep 16 02:19:37.627941 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:37.627942    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gz9mz"
Sep 16 02:19:37.629377 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:37.629339    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gmh95" event={"ID":"3514ea95-b101-4089-b26a-d663d7865dd9","Type":"ContainerStarted","Data":"d1ddf13731344c69ac9fc5d3e2797c40d1cd83272973ca47f74cb517eed65970"}
Sep 16 02:19:37.631426 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:37.631406    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kgfsm" event={"ID":"4e7c13f3-f878-4c05-93e5-b2939da20191","Type":"ContainerStarted","Data":"5d3d328e45038fb83bc867e020badf7b5ed44fe3a61cbe271b9e9a72145c69b8"}
Sep 16 02:19:37.642732 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:37.642685    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gz9mz" podStartSLOduration=1.805165194 podStartE2EDuration="4.642666278s" totalImagesPullingTime="2.837501084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:19:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:19:37.641883284 +0000 UTC m=+55.692227807" watchObservedRunningTime="2026-09-16 02:19:37.642666278 +0000 UTC m=+55.693010772"
Sep 16 02:19:37.654727 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:37.654683    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gmh95" podStartSLOduration=1.704433504 podStartE2EDuration="4.654666442s" totalImagesPullingTime="2.950232938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:19:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:19:37.654297184 +0000 UTC m=+55.704641705" watchObservedRunningTime="2026-09-16 02:19:37.654666442 +0000 UTC m=+55.705010937"
Sep 16 02:19:37.670540 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:37.670468    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kgfsm" podStartSLOduration=1.886680522 podStartE2EDuration="4.670450709s" totalImagesPullingTime="2.783770187s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 02:19:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:19:37.669200736 +0000 UTC m=+55.719545252" watchObservedRunningTime="2026-09-16 02:19:37.670450709 +0000 UTC m=+55.720795204"
Sep 16 02:19:37.854561 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:37.854530    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:38.598962 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:38.598925    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:38.679351 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:38.679307    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:38.912636 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:38.912602    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:40.563085 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:40.563053    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8s2zg"
Sep 16 02:19:40.712922 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:40.712888    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:40.762462 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:40.762428    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:41.931704 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:41.931673    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:42.420971 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:42.420939    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:42.522270 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:42.522234    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:43.733513 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:43.733478    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:43.944296 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:43.944266    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:43.974971 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:43.974941    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-tdd7g"]
Sep 16 02:19:43.978118 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:43.978097    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tdd7g"
Sep 16 02:19:43.981046 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:43.980850    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-dqpt4\""
Sep 16 02:19:43.981046 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:43.980850    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 16 02:19:43.981046 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:43.980888    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 16 02:19:43.981046 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:43.980911    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 16 02:19:43.981439 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:43.981355    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 16 02:19:43.981500 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:43.981463    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 16 02:19:43.993633 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:43.993592    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-tdd7g"]
Sep 16 02:19:44.001666 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.001646    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fmr8r"]
Sep 16 02:19:44.003352 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.003333    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fmr8r"
Sep 16 02:19:44.005554 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.005530    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 16 02:19:44.005806 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.005786    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fkjtp\""
Sep 16 02:19:44.005988 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.005536    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 16 02:19:44.006492 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.006472    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 16 02:19:44.026336 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.026314    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ec7313b-82d8-4c4c-8bf7-5dcdf2387851-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-tdd7g\" (UID: \"2ec7313b-82d8-4c4c-8bf7-5dcdf2387851\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tdd7g"
Sep 16 02:19:44.026464 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.026345    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2ec7313b-82d8-4c4c-8bf7-5dcdf2387851-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-tdd7g\" (UID: \"2ec7313b-82d8-4c4c-8bf7-5dcdf2387851\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tdd7g"
Sep 16 02:19:44.026464 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.026441    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b94m\" (UniqueName: \"kubernetes.io/projected/2ec7313b-82d8-4c4c-8bf7-5dcdf2387851-kube-api-access-8b94m\") pod \"openshift-state-metrics-67dcf8c979-tdd7g\" (UID: \"2ec7313b-82d8-4c4c-8bf7-5dcdf2387851\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tdd7g"
Sep 16 02:19:44.026594 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.026476    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ec7313b-82d8-4c4c-8bf7-5dcdf2387851-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-tdd7g\" (UID: \"2ec7313b-82d8-4c4c-8bf7-5dcdf2387851\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tdd7g"
Sep 16 02:19:44.030045 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.030026    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:44.103548 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.103519    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:44.127712 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.127682    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6-node-exporter-tls\") pod \"node-exporter-fmr8r\" (UID: \"ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6\") " pod="openshift-monitoring/node-exporter-fmr8r"
Sep 16 02:19:44.127828 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.127723    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6-metrics-client-ca\") pod \"node-exporter-fmr8r\" (UID: \"ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6\") " pod="openshift-monitoring/node-exporter-fmr8r"
Sep 16 02:19:44.127828 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.127754    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ec7313b-82d8-4c4c-8bf7-5dcdf2387851-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-tdd7g\" (UID: \"2ec7313b-82d8-4c4c-8bf7-5dcdf2387851\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tdd7g"
Sep 16 02:19:44.127828 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.127812    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6-root\") pod \"node-exporter-fmr8r\" (UID: \"ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6\") " pod="openshift-monitoring/node-exporter-fmr8r"
Sep 16 02:19:44.127962 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.127860    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2ec7313b-82d8-4c4c-8bf7-5dcdf2387851-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-tdd7g\" (UID: \"2ec7313b-82d8-4c4c-8bf7-5dcdf2387851\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tdd7g"
Sep 16 02:19:44.127962 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.127882    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6-node-exporter-wtmp\") pod \"node-exporter-fmr8r\" (UID: \"ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6\") " pod="openshift-monitoring/node-exporter-fmr8r"
Sep 16 02:19:44.127962 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.127911    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ec7313b-82d8-4c4c-8bf7-5dcdf2387851-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-tdd7g\" (UID: \"2ec7313b-82d8-4c4c-8bf7-5dcdf2387851\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tdd7g"
Sep 16 02:19:44.128099 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.127980    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6-node-exporter-accelerators-collector-config\") pod \"node-exporter-fmr8r\" (UID: \"ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6\") " pod="openshift-monitoring/node-exporter-fmr8r"
Sep 16 02:19:44.128099 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.128018    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k8g8\" (UniqueName: \"kubernetes.io/projected/ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6-kube-api-access-8k8g8\") pod \"node-exporter-fmr8r\" (UID: \"ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6\") " pod="openshift-monitoring/node-exporter-fmr8r"
Sep 16 02:19:44.128099 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.128068    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6-sys\") pod \"node-exporter-fmr8r\" (UID: \"ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6\") " pod="openshift-monitoring/node-exporter-fmr8r"
Sep 16 02:19:44.128232 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.128106    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b94m\" (UniqueName: \"kubernetes.io/projected/2ec7313b-82d8-4c4c-8bf7-5dcdf2387851-kube-api-access-8b94m\") pod \"openshift-state-metrics-67dcf8c979-tdd7g\" (UID: \"2ec7313b-82d8-4c4c-8bf7-5dcdf2387851\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tdd7g"
Sep 16 02:19:44.128232 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.128207    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6-node-exporter-textfile\") pod \"node-exporter-fmr8r\" (UID: \"ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6\") " pod="openshift-monitoring/node-exporter-fmr8r"
Sep 16 02:19:44.128338 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.128239    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fmr8r\" (UID: \"ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6\") " pod="openshift-monitoring/node-exporter-fmr8r"
Sep 16 02:19:44.128535 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.128509    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ec7313b-82d8-4c4c-8bf7-5dcdf2387851-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-tdd7g\" (UID: \"2ec7313b-82d8-4c4c-8bf7-5dcdf2387851\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tdd7g"
Sep 16 02:19:44.130544 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.130524    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2ec7313b-82d8-4c4c-8bf7-5dcdf2387851-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-tdd7g\" (UID: \"2ec7313b-82d8-4c4c-8bf7-5dcdf2387851\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tdd7g"
Sep 16 02:19:44.130806 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.130785    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ec7313b-82d8-4c4c-8bf7-5dcdf2387851-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-tdd7g\" (UID: \"2ec7313b-82d8-4c4c-8bf7-5dcdf2387851\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tdd7g"
Sep 16 02:19:44.139106 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.139078    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b94m\" (UniqueName: \"kubernetes.io/projected/2ec7313b-82d8-4c4c-8bf7-5dcdf2387851-kube-api-access-8b94m\") pod \"openshift-state-metrics-67dcf8c979-tdd7g\" (UID: \"2ec7313b-82d8-4c4c-8bf7-5dcdf2387851\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tdd7g"
Sep 16 02:19:44.207731 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.207700    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:44.228834 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.228807    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6-node-exporter-tls\") pod \"node-exporter-fmr8r\" (UID: \"ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6\") " pod="openshift-monitoring/node-exporter-fmr8r"
Sep 16 02:19:44.228938 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.228835    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6-metrics-client-ca\") pod \"node-exporter-fmr8r\" (UID: \"ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6\") " pod="openshift-monitoring/node-exporter-fmr8r"
Sep 16 02:19:44.228938 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.228873    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6-root\") pod \"node-exporter-fmr8r\" (UID: \"ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6\") " pod="openshift-monitoring/node-exporter-fmr8r"
Sep 16 02:19:44.228938 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.228892    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6-node-exporter-wtmp\") pod \"node-exporter-fmr8r\" (UID: \"ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6\") " pod="openshift-monitoring/node-exporter-fmr8r"
Sep 16 02:19:44.228938 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.228927    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6-node-exporter-accelerators-collector-config\") pod \"node-exporter-fmr8r\" (UID: \"ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6\") " pod="openshift-monitoring/node-exporter-fmr8r"
Sep 16 02:19:44.229157 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.228952    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k8g8\" (UniqueName: \"kubernetes.io/projected/ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6-kube-api-access-8k8g8\") pod \"node-exporter-fmr8r\" (UID: \"ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6\") " pod="openshift-monitoring/node-exporter-fmr8r"
Sep 16 02:19:44.229507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.229443    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6-node-exporter-wtmp\") pod \"node-exporter-fmr8r\" (UID: \"ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6\") " pod="openshift-monitoring/node-exporter-fmr8r"
Sep 16 02:19:44.229507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.229487    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6-root\") pod \"node-exporter-fmr8r\" (UID: \"ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6\") " pod="openshift-monitoring/node-exporter-fmr8r"
Sep 16 02:19:44.229648 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.229523    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6-sys\") pod \"node-exporter-fmr8r\" (UID: \"ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6\") " pod="openshift-monitoring/node-exporter-fmr8r"
Sep 16 02:19:44.229648 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.229598    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6-node-exporter-textfile\") pod \"node-exporter-fmr8r\" (UID: \"ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6\") " pod="openshift-monitoring/node-exporter-fmr8r"
Sep 16 02:19:44.229648 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.229631    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fmr8r\" (UID: \"ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6\") " pod="openshift-monitoring/node-exporter-fmr8r"
Sep 16 02:19:44.230158 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.229951    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6-metrics-client-ca\") pod \"node-exporter-fmr8r\" (UID: \"ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6\") " pod="openshift-monitoring/node-exporter-fmr8r"
Sep 16 02:19:44.230158 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.230025    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6-node-exporter-accelerators-collector-config\") pod \"node-exporter-fmr8r\" (UID: \"ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6\") " pod="openshift-monitoring/node-exporter-fmr8r"
Sep 16 02:19:44.230158 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.230110    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6-sys\") pod \"node-exporter-fmr8r\" (UID: \"ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6\") " pod="openshift-monitoring/node-exporter-fmr8r"
Sep 16 02:19:44.230404 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.230321    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6-node-exporter-textfile\") pod \"node-exporter-fmr8r\" (UID: \"ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6\") " pod="openshift-monitoring/node-exporter-fmr8r"
Sep 16 02:19:44.232390 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.232106    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6-node-exporter-tls\") pod \"node-exporter-fmr8r\" (UID: \"ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6\") " pod="openshift-monitoring/node-exporter-fmr8r"
Sep 16 02:19:44.234036 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.233420    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fmr8r\" (UID: \"ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6\") " pod="openshift-monitoring/node-exporter-fmr8r"
Sep 16 02:19:44.237815 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.237754    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k8g8\" (UniqueName: \"kubernetes.io/projected/ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6-kube-api-access-8k8g8\") pod \"node-exporter-fmr8r\" (UID: \"ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6\") " pod="openshift-monitoring/node-exporter-fmr8r"
Sep 16 02:19:44.261577 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.261546    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:44.289244 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.289221    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tdd7g"
Sep 16 02:19:44.314950 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.314876    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fmr8r"
Sep 16 02:19:44.324995 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:19:44.324964    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac8eda9d_aeda_41a5_96ce_c1734ae0b1b6.slice/crio-3087a90eb9c2612fa282ba5d2302f942e6f0a34b660fa0c4ad501baad92187f7 WatchSource:0}: Error finding container 3087a90eb9c2612fa282ba5d2302f942e6f0a34b660fa0c4ad501baad92187f7: Status 404 returned error can't find the container with id 3087a90eb9c2612fa282ba5d2302f942e6f0a34b660fa0c4ad501baad92187f7
Sep 16 02:19:44.328749 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.328568    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:44.432466 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.432436    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:44.568556 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.568478    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-tdd7g"]
Sep 16 02:19:44.572316 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:19:44.572287    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ec7313b_82d8_4c4c_8bf7_5dcdf2387851.slice/crio-b48c0f15f04bcf825deee0caed9b10d38d462840bd84f2c43690c586a7cb9a26 WatchSource:0}: Error finding container b48c0f15f04bcf825deee0caed9b10d38d462840bd84f2c43690c586a7cb9a26: Status 404 returned error can't find the container with id b48c0f15f04bcf825deee0caed9b10d38d462840bd84f2c43690c586a7cb9a26
Sep 16 02:19:44.646646 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.646571    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:44.659141 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.659070    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fmr8r" event={"ID":"ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6","Type":"ContainerStarted","Data":"3087a90eb9c2612fa282ba5d2302f942e6f0a34b660fa0c4ad501baad92187f7"}
Sep 16 02:19:44.661027 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.660999    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tdd7g" event={"ID":"2ec7313b-82d8-4c4c-8bf7-5dcdf2387851","Type":"ContainerStarted","Data":"b720fbbb4f7ec51f01bf9394c8a5cdf7292c51062db5bcbee7d2e27370fac80d"}
Sep 16 02:19:44.661138 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.661059    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tdd7g" event={"ID":"2ec7313b-82d8-4c4c-8bf7-5dcdf2387851","Type":"ContainerStarted","Data":"b48c0f15f04bcf825deee0caed9b10d38d462840bd84f2c43690c586a7cb9a26"}
Sep 16 02:19:44.955749 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:44.955684    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:45.024986 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.024953    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:45.089099 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.089057    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:45.388890 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.388858    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-845b9d967d-mt58v"]
Sep 16 02:19:45.391048 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.391026    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-845b9d967d-mt58v"
Sep 16 02:19:45.393543 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.393201    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 16 02:19:45.393543 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.393436    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 16 02:19:45.393707 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.393555    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 16 02:19:45.393707 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.393635    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 16 02:19:45.393707 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.393680    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gkq4l\""
Sep 16 02:19:45.394168 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.394009    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 16 02:19:45.402260 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.402237    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-845b9d967d-mt58v"]
Sep 16 02:19:45.440516 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.440466    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b33bde5f-ae41-4273-8746-3c06939ab8c7-console-oauth-config\") pod \"console-845b9d967d-mt58v\" (UID: \"b33bde5f-ae41-4273-8746-3c06939ab8c7\") " pod="openshift-console/console-845b9d967d-mt58v"
Sep 16 02:19:45.440697 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.440519    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b33bde5f-ae41-4273-8746-3c06939ab8c7-console-serving-cert\") pod \"console-845b9d967d-mt58v\" (UID: \"b33bde5f-ae41-4273-8746-3c06939ab8c7\") " pod="openshift-console/console-845b9d967d-mt58v"
Sep 16 02:19:45.440697 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.440613    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhb5z\" (UniqueName: \"kubernetes.io/projected/b33bde5f-ae41-4273-8746-3c06939ab8c7-kube-api-access-fhb5z\") pod \"console-845b9d967d-mt58v\" (UID: \"b33bde5f-ae41-4273-8746-3c06939ab8c7\") " pod="openshift-console/console-845b9d967d-mt58v"
Sep 16 02:19:45.440697 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.440649    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b33bde5f-ae41-4273-8746-3c06939ab8c7-service-ca\") pod \"console-845b9d967d-mt58v\" (UID: \"b33bde5f-ae41-4273-8746-3c06939ab8c7\") " pod="openshift-console/console-845b9d967d-mt58v"
Sep 16 02:19:45.440697 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.440673    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b33bde5f-ae41-4273-8746-3c06939ab8c7-console-config\") pod \"console-845b9d967d-mt58v\" (UID: \"b33bde5f-ae41-4273-8746-3c06939ab8c7\") " pod="openshift-console/console-845b9d967d-mt58v"
Sep 16 02:19:45.440697 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.440688    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b33bde5f-ae41-4273-8746-3c06939ab8c7-oauth-serving-cert\") pod \"console-845b9d967d-mt58v\" (UID: \"b33bde5f-ae41-4273-8746-3c06939ab8c7\") " pod="openshift-console/console-845b9d967d-mt58v"
Sep 16 02:19:45.541943 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.541860    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b33bde5f-ae41-4273-8746-3c06939ab8c7-console-config\") pod \"console-845b9d967d-mt58v\" (UID: \"b33bde5f-ae41-4273-8746-3c06939ab8c7\") " pod="openshift-console/console-845b9d967d-mt58v"
Sep 16 02:19:45.541943 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.541910    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b33bde5f-ae41-4273-8746-3c06939ab8c7-oauth-serving-cert\") pod \"console-845b9d967d-mt58v\" (UID: \"b33bde5f-ae41-4273-8746-3c06939ab8c7\") " pod="openshift-console/console-845b9d967d-mt58v"
Sep 16 02:19:45.542156 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.541993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b33bde5f-ae41-4273-8746-3c06939ab8c7-console-oauth-config\") pod \"console-845b9d967d-mt58v\" (UID: \"b33bde5f-ae41-4273-8746-3c06939ab8c7\") " pod="openshift-console/console-845b9d967d-mt58v"
Sep 16 02:19:45.542156 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.542027    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b33bde5f-ae41-4273-8746-3c06939ab8c7-console-serving-cert\") pod \"console-845b9d967d-mt58v\" (UID: \"b33bde5f-ae41-4273-8746-3c06939ab8c7\") " pod="openshift-console/console-845b9d967d-mt58v"
Sep 16 02:19:45.542156 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.542072    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhb5z\" (UniqueName: \"kubernetes.io/projected/b33bde5f-ae41-4273-8746-3c06939ab8c7-kube-api-access-fhb5z\") pod \"console-845b9d967d-mt58v\" (UID: \"b33bde5f-ae41-4273-8746-3c06939ab8c7\") " pod="openshift-console/console-845b9d967d-mt58v"
Sep 16 02:19:45.542156 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.542098    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b33bde5f-ae41-4273-8746-3c06939ab8c7-service-ca\") pod \"console-845b9d967d-mt58v\" (UID: \"b33bde5f-ae41-4273-8746-3c06939ab8c7\") " pod="openshift-console/console-845b9d967d-mt58v"
Sep 16 02:19:45.542692 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.542667    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b33bde5f-ae41-4273-8746-3c06939ab8c7-console-config\") pod \"console-845b9d967d-mt58v\" (UID: \"b33bde5f-ae41-4273-8746-3c06939ab8c7\") " pod="openshift-console/console-845b9d967d-mt58v"
Sep 16 02:19:45.543243 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.543198    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b33bde5f-ae41-4273-8746-3c06939ab8c7-service-ca\") pod \"console-845b9d967d-mt58v\" (UID: \"b33bde5f-ae41-4273-8746-3c06939ab8c7\") " pod="openshift-console/console-845b9d967d-mt58v"
Sep 16 02:19:45.543243 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.543237    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b33bde5f-ae41-4273-8746-3c06939ab8c7-oauth-serving-cert\") pod \"console-845b9d967d-mt58v\" (UID: \"b33bde5f-ae41-4273-8746-3c06939ab8c7\") " pod="openshift-console/console-845b9d967d-mt58v"
Sep 16 02:19:45.545521 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.545499    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b33bde5f-ae41-4273-8746-3c06939ab8c7-console-oauth-config\") pod \"console-845b9d967d-mt58v\" (UID: \"b33bde5f-ae41-4273-8746-3c06939ab8c7\") " pod="openshift-console/console-845b9d967d-mt58v"
Sep 16 02:19:45.545972 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.545942    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b33bde5f-ae41-4273-8746-3c06939ab8c7-console-serving-cert\") pod \"console-845b9d967d-mt58v\" (UID: \"b33bde5f-ae41-4273-8746-3c06939ab8c7\") " pod="openshift-console/console-845b9d967d-mt58v"
Sep 16 02:19:45.550374 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.550327    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhb5z\" (UniqueName: \"kubernetes.io/projected/b33bde5f-ae41-4273-8746-3c06939ab8c7-kube-api-access-fhb5z\") pod \"console-845b9d967d-mt58v\" (UID: \"b33bde5f-ae41-4273-8746-3c06939ab8c7\") " pod="openshift-console/console-845b9d967d-mt58v"
Sep 16 02:19:45.666803 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.666768    2565 generic.go:356] "Generic (PLEG): container finished" podID="ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6" containerID="be27aee0c06d73337f8002f8f400606e77867a2f70184259e129cbdbf7974d09" exitCode=0
Sep 16 02:19:45.666982 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.666863    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fmr8r" event={"ID":"ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6","Type":"ContainerDied","Data":"be27aee0c06d73337f8002f8f400606e77867a2f70184259e129cbdbf7974d09"}
Sep 16 02:19:45.669062 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.669039    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tdd7g" event={"ID":"2ec7313b-82d8-4c4c-8bf7-5dcdf2387851","Type":"ContainerStarted","Data":"da8fd67f888addc906cc6cc3f09bf632eb80e0fda197cd089297ccdb88bcfeac"}
Sep 16 02:19:45.702220 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:45.702191    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-845b9d967d-mt58v"
Sep 16 02:19:46.151697 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:46.151629    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-845b9d967d-mt58v"]
Sep 16 02:19:46.675609 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:46.675578    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fmr8r" event={"ID":"ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6","Type":"ContainerStarted","Data":"67127974e5de6527aed65a7961fe2efef8aca9c0ebb6f25f707f40be63e439af"}
Sep 16 02:19:46.675806 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:46.675638    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fmr8r" event={"ID":"ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6","Type":"ContainerStarted","Data":"ed06d93276741d547d52a0c1f98a4bc5493a0f045fc1bcf7d92c2cb0f330f4ee"}
Sep 16 02:19:46.678002 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:46.677940    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tdd7g" event={"ID":"2ec7313b-82d8-4c4c-8bf7-5dcdf2387851","Type":"ContainerStarted","Data":"a6aae87b14053c54f58e5cce13a1528ab0533f87e45fdbaf35f28f6a10997405"}
Sep 16 02:19:46.695472 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:46.695424    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fmr8r" podStartSLOduration=2.670015416 podStartE2EDuration="3.695411102s" totalImagesPullingTime="950.094901ms" totalInitContainerRuntime="75.300785ms" isStatefulPod=true podCreationTimestamp="2026-09-16 02:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:19:46.693997555 +0000 UTC m=+64.744342120" watchObservedRunningTime="2026-09-16 02:19:46.695411102 +0000 UTC m=+64.745755587"
Sep 16 02:19:46.713686 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:46.713631    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tdd7g" podStartSLOduration=2.501441578 podStartE2EDuration="3.713613649s" totalImagesPullingTime="1.212172071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:19:46.712109273 +0000 UTC m=+64.762453784" watchObservedRunningTime="2026-09-16 02:19:46.713613649 +0000 UTC m=+64.763958144"
Sep 16 02:19:46.895380 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:46.895314    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:46.949454 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:46.949354    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:47.171861 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:47.171827    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:47.487269 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:47.487232    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:47.637188 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:47.637154    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gz9mz"
Sep 16 02:19:48.063697 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:48.063670    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b569dfd-1a91-4dfd-a893-355d2a94681c-original-pull-secret\") pod \"global-pull-secret-syncer-5z7kc\" (UID: \"4b569dfd-1a91-4dfd-a893-355d2a94681c\") " pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:19:48.063876 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:48.063742    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2s55\" (UniqueName: \"kubernetes.io/projected/f05bbb56-ee96-4d5c-918d-18cddf968e87-kube-api-access-d2s55\") pod \"network-check-target-2mmw9\" (UID: \"f05bbb56-ee96-4d5c-918d-18cddf968e87\") " pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:19:48.063876 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:48.063778    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57b965f8-cef0-417c-b3a8-8c5c1a0883bf-metrics-certs\") pod \"network-metrics-daemon-p7rcn\" (UID: \"57b965f8-cef0-417c-b3a8-8c5c1a0883bf\") " pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:19:48.066205 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:48.066177    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 02:19:48.066350 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:48.066269    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 02:19:48.066502 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:48.066488    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 02:19:48.075945 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:48.075921    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 02:19:48.076830 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:48.076807    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b569dfd-1a91-4dfd-a893-355d2a94681c-original-pull-secret\") pod \"global-pull-secret-syncer-5z7kc\" (UID: \"4b569dfd-1a91-4dfd-a893-355d2a94681c\") " pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:19:48.076921 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:48.076890    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57b965f8-cef0-417c-b3a8-8c5c1a0883bf-metrics-certs\") pod \"network-metrics-daemon-p7rcn\" (UID: \"57b965f8-cef0-417c-b3a8-8c5c1a0883bf\") " pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:19:48.087766 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:48.087745    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2s55\" (UniqueName: \"kubernetes.io/projected/f05bbb56-ee96-4d5c-918d-18cddf968e87-kube-api-access-d2s55\") pod \"network-check-target-2mmw9\" (UID: \"f05bbb56-ee96-4d5c-918d-18cddf968e87\") " pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:19:48.203855 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:48.203824    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7ktl5\""
Sep 16 02:19:48.211709 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:48.211679    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ss74q\""
Sep 16 02:19:48.211887 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:48.211858    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:19:48.215445 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:48.215423    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5z7kc"
Sep 16 02:19:48.219608 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:48.219593    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7rcn"
Sep 16 02:19:48.751671 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:48.751642    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:48.754636 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:48.754606    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-plzgf"]
Sep 16 02:19:48.758320 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:48.758299    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-plzgf"
Sep 16 02:19:48.760565 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:48.760545    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 16 02:19:48.760662 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:48.760574    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hcblh\""
Sep 16 02:19:48.764596 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:48.764572    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-plzgf"]
Sep 16 02:19:48.851666 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:48.851629    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:48.870720 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:48.870686    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwrpb\" (UniqueName: \"kubernetes.io/projected/597f5055-e714-4c18-8217-c33dc5b785e6-kube-api-access-kwrpb\") pod \"monitoring-plugin-5d85778b9d-plzgf\" (UID: \"597f5055-e714-4c18-8217-c33dc5b785e6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-plzgf"
Sep 16 02:19:48.870876 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:48.870735    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/597f5055-e714-4c18-8217-c33dc5b785e6-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-plzgf\" (UID: \"597f5055-e714-4c18-8217-c33dc5b785e6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-plzgf"
Sep 16 02:19:48.972159 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:48.972110    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwrpb\" (UniqueName: \"kubernetes.io/projected/597f5055-e714-4c18-8217-c33dc5b785e6-kube-api-access-kwrpb\") pod \"monitoring-plugin-5d85778b9d-plzgf\" (UID: \"597f5055-e714-4c18-8217-c33dc5b785e6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-plzgf"
Sep 16 02:19:48.972159 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:48.972158    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/597f5055-e714-4c18-8217-c33dc5b785e6-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-plzgf\" (UID: \"597f5055-e714-4c18-8217-c33dc5b785e6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-plzgf"
Sep 16 02:19:48.972412 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:48.972260    2565 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 16 02:19:48.972412 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:19:48.972325    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/597f5055-e714-4c18-8217-c33dc5b785e6-monitoring-plugin-cert podName:597f5055-e714-4c18-8217-c33dc5b785e6 nodeName:}" failed. No retries permitted until 2026-09-16 02:19:49.472305715 +0000 UTC m=+67.522650188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/597f5055-e714-4c18-8217-c33dc5b785e6-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-plzgf" (UID: "597f5055-e714-4c18-8217-c33dc5b785e6") : secret "monitoring-plugin-cert" not found
Sep 16 02:19:48.980387 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:48.980341    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwrpb\" (UniqueName: \"kubernetes.io/projected/597f5055-e714-4c18-8217-c33dc5b785e6-kube-api-access-kwrpb\") pod \"monitoring-plugin-5d85778b9d-plzgf\" (UID: \"597f5055-e714-4c18-8217-c33dc5b785e6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-plzgf"
Sep 16 02:19:49.171938 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.171901    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-56d69fd86-k7t96"]
Sep 16 02:19:49.176214 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.176193    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-56d69fd86-k7t96"
Sep 16 02:19:49.178515 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.178493    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 16 02:19:49.178623 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.178579    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 16 02:19:49.178623 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.178611    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 16 02:19:49.178716 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.178643    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qrbqs\""
Sep 16 02:19:49.179008 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.178959    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 16 02:19:49.179089 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.179047    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 16 02:19:49.184799 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.184778    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 16 02:19:49.190620 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.188465    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-56d69fd86-k7t96"]
Sep 16 02:19:49.274771 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.274737    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/182043a0-fc81-4e3f-857a-b663267ef5cb-telemeter-client-tls\") pod \"telemeter-client-56d69fd86-k7t96\" (UID: \"182043a0-fc81-4e3f-857a-b663267ef5cb\") " pod="openshift-monitoring/telemeter-client-56d69fd86-k7t96"
Sep 16 02:19:49.275198 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.274788    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/182043a0-fc81-4e3f-857a-b663267ef5cb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56d69fd86-k7t96\" (UID: \"182043a0-fc81-4e3f-857a-b663267ef5cb\") " pod="openshift-monitoring/telemeter-client-56d69fd86-k7t96"
Sep 16 02:19:49.275198 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.274875    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/182043a0-fc81-4e3f-857a-b663267ef5cb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56d69fd86-k7t96\" (UID: \"182043a0-fc81-4e3f-857a-b663267ef5cb\") " pod="openshift-monitoring/telemeter-client-56d69fd86-k7t96"
Sep 16 02:19:49.275198 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.274914    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/182043a0-fc81-4e3f-857a-b663267ef5cb-federate-client-tls\") pod \"telemeter-client-56d69fd86-k7t96\" (UID: \"182043a0-fc81-4e3f-857a-b663267ef5cb\") " pod="openshift-monitoring/telemeter-client-56d69fd86-k7t96"
Sep 16 02:19:49.275198 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.274968    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/182043a0-fc81-4e3f-857a-b663267ef5cb-serving-certs-ca-bundle\") pod \"telemeter-client-56d69fd86-k7t96\" (UID: \"182043a0-fc81-4e3f-857a-b663267ef5cb\") " pod="openshift-monitoring/telemeter-client-56d69fd86-k7t96"
Sep 16 02:19:49.275198 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.274997    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/182043a0-fc81-4e3f-857a-b663267ef5cb-secret-telemeter-client\") pod \"telemeter-client-56d69fd86-k7t96\" (UID: \"182043a0-fc81-4e3f-857a-b663267ef5cb\") " pod="openshift-monitoring/telemeter-client-56d69fd86-k7t96"
Sep 16 02:19:49.275198 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.275026    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/182043a0-fc81-4e3f-857a-b663267ef5cb-metrics-client-ca\") pod \"telemeter-client-56d69fd86-k7t96\" (UID: \"182043a0-fc81-4e3f-857a-b663267ef5cb\") " pod="openshift-monitoring/telemeter-client-56d69fd86-k7t96"
Sep 16 02:19:49.275198 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.275163    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9rnh\" (UniqueName: \"kubernetes.io/projected/182043a0-fc81-4e3f-857a-b663267ef5cb-kube-api-access-c9rnh\") pod \"telemeter-client-56d69fd86-k7t96\" (UID: \"182043a0-fc81-4e3f-857a-b663267ef5cb\") " pod="openshift-monitoring/telemeter-client-56d69fd86-k7t96"
Sep 16 02:19:49.294237 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.294199    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:49.376206 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.376173    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/182043a0-fc81-4e3f-857a-b663267ef5cb-telemeter-client-tls\") pod \"telemeter-client-56d69fd86-k7t96\" (UID: \"182043a0-fc81-4e3f-857a-b663267ef5cb\") " pod="openshift-monitoring/telemeter-client-56d69fd86-k7t96"
Sep 16 02:19:49.376402 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.376220    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/182043a0-fc81-4e3f-857a-b663267ef5cb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56d69fd86-k7t96\" (UID: \"182043a0-fc81-4e3f-857a-b663267ef5cb\") " pod="openshift-monitoring/telemeter-client-56d69fd86-k7t96"
Sep 16 02:19:49.376402 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.376251    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/182043a0-fc81-4e3f-857a-b663267ef5cb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56d69fd86-k7t96\" (UID: \"182043a0-fc81-4e3f-857a-b663267ef5cb\") " pod="openshift-monitoring/telemeter-client-56d69fd86-k7t96"
Sep 16 02:19:49.376402 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.376270    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/182043a0-fc81-4e3f-857a-b663267ef5cb-federate-client-tls\") pod \"telemeter-client-56d69fd86-k7t96\" (UID: \"182043a0-fc81-4e3f-857a-b663267ef5cb\") " pod="openshift-monitoring/telemeter-client-56d69fd86-k7t96"
Sep 16 02:19:49.376402 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.376313    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/182043a0-fc81-4e3f-857a-b663267ef5cb-serving-certs-ca-bundle\") pod \"telemeter-client-56d69fd86-k7t96\" (UID: \"182043a0-fc81-4e3f-857a-b663267ef5cb\") " pod="openshift-monitoring/telemeter-client-56d69fd86-k7t96"
Sep 16 02:19:49.376402 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.376339    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/182043a0-fc81-4e3f-857a-b663267ef5cb-secret-telemeter-client\") pod \"telemeter-client-56d69fd86-k7t96\" (UID: \"182043a0-fc81-4e3f-857a-b663267ef5cb\") " pod="openshift-monitoring/telemeter-client-56d69fd86-k7t96"
Sep 16 02:19:49.376402 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.376381    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/182043a0-fc81-4e3f-857a-b663267ef5cb-metrics-client-ca\") pod \"telemeter-client-56d69fd86-k7t96\" (UID: \"182043a0-fc81-4e3f-857a-b663267ef5cb\") " pod="openshift-monitoring/telemeter-client-56d69fd86-k7t96"
Sep 16 02:19:49.376789 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.376430    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9rnh\" (UniqueName: \"kubernetes.io/projected/182043a0-fc81-4e3f-857a-b663267ef5cb-kube-api-access-c9rnh\") pod \"telemeter-client-56d69fd86-k7t96\" (UID: \"182043a0-fc81-4e3f-857a-b663267ef5cb\") " pod="openshift-monitoring/telemeter-client-56d69fd86-k7t96"
Sep 16 02:19:49.377353 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.377322    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/182043a0-fc81-4e3f-857a-b663267ef5cb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56d69fd86-k7t96\" (UID: \"182043a0-fc81-4e3f-857a-b663267ef5cb\") " pod="openshift-monitoring/telemeter-client-56d69fd86-k7t96"
Sep 16 02:19:49.377656 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.377634    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/182043a0-fc81-4e3f-857a-b663267ef5cb-serving-certs-ca-bundle\") pod \"telemeter-client-56d69fd86-k7t96\" (UID: \"182043a0-fc81-4e3f-857a-b663267ef5cb\") " pod="openshift-monitoring/telemeter-client-56d69fd86-k7t96"
Sep 16 02:19:49.378041 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.378020    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/182043a0-fc81-4e3f-857a-b663267ef5cb-metrics-client-ca\") pod \"telemeter-client-56d69fd86-k7t96\" (UID: \"182043a0-fc81-4e3f-857a-b663267ef5cb\") " pod="openshift-monitoring/telemeter-client-56d69fd86-k7t96"
Sep 16 02:19:49.379093 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.379071    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/182043a0-fc81-4e3f-857a-b663267ef5cb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56d69fd86-k7t96\" (UID: \"182043a0-fc81-4e3f-857a-b663267ef5cb\") " pod="openshift-monitoring/telemeter-client-56d69fd86-k7t96"
Sep 16 02:19:49.379270 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.379244    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/182043a0-fc81-4e3f-857a-b663267ef5cb-secret-telemeter-client\") pod \"telemeter-client-56d69fd86-k7t96\" (UID: \"182043a0-fc81-4e3f-857a-b663267ef5cb\") " pod="openshift-monitoring/telemeter-client-56d69fd86-k7t96"
Sep 16 02:19:49.379348 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.379318    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/182043a0-fc81-4e3f-857a-b663267ef5cb-federate-client-tls\") pod \"telemeter-client-56d69fd86-k7t96\" (UID: \"182043a0-fc81-4e3f-857a-b663267ef5cb\") " pod="openshift-monitoring/telemeter-client-56d69fd86-k7t96"
Sep 16 02:19:49.379639 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.379619    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/182043a0-fc81-4e3f-857a-b663267ef5cb-telemeter-client-tls\") pod \"telemeter-client-56d69fd86-k7t96\" (UID: \"182043a0-fc81-4e3f-857a-b663267ef5cb\") " pod="openshift-monitoring/telemeter-client-56d69fd86-k7t96"
Sep 16 02:19:49.383963 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.383942    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9rnh\" (UniqueName: \"kubernetes.io/projected/182043a0-fc81-4e3f-857a-b663267ef5cb-kube-api-access-c9rnh\") pod \"telemeter-client-56d69fd86-k7t96\" (UID: \"182043a0-fc81-4e3f-857a-b663267ef5cb\") " pod="openshift-monitoring/telemeter-client-56d69fd86-k7t96"
Sep 16 02:19:49.477338 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.477223    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/597f5055-e714-4c18-8217-c33dc5b785e6-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-plzgf\" (UID: \"597f5055-e714-4c18-8217-c33dc5b785e6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-plzgf"
Sep 16 02:19:49.479982 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.479945    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/597f5055-e714-4c18-8217-c33dc5b785e6-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-plzgf\" (UID: \"597f5055-e714-4c18-8217-c33dc5b785e6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-plzgf"
Sep 16 02:19:49.492790 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.492759    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-56d69fd86-k7t96"
Sep 16 02:19:49.669829 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.669797    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-plzgf"
Sep 16 02:19:49.734231 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.734149    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:49.788102 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:49.788067    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:50.052859 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:50.052773    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:50.107408 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:50.107376    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:50.218286 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:50.218251    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:51.630344 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:51.630302    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:51.730864 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:51.730835    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:53.003964 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:19:53.003930    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb33bde5f_ae41_4273_8746_3c06939ab8c7.slice/crio-0afd11f6957793520178571a6938215e1bffc2e8ca4f00f84eb844f9a419e007 WatchSource:0}: Error finding container 0afd11f6957793520178571a6938215e1bffc2e8ca4f00f84eb844f9a419e007: Status 404 returned error can't find the container with id 0afd11f6957793520178571a6938215e1bffc2e8ca4f00f84eb844f9a419e007
Sep 16 02:19:53.286900 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.286822    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2mmw9"]
Sep 16 02:19:53.289923 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:19:53.289889    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf05bbb56_ee96_4d5c_918d_18cddf968e87.slice/crio-e4fcd876b314e219456726377f8d860b30c121c4de28bf7cdd9a6121b62867c3 WatchSource:0}: Error finding container e4fcd876b314e219456726377f8d860b30c121c4de28bf7cdd9a6121b62867c3: Status 404 returned error can't find the container with id e4fcd876b314e219456726377f8d860b30c121c4de28bf7cdd9a6121b62867c3
Sep 16 02:19:53.296608 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.296584    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-plzgf"]
Sep 16 02:19:53.300555 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:19:53.300229    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod597f5055_e714_4c18_8217_c33dc5b785e6.slice/crio-14b63214ef2ab8589736f2dde894a7445d23c1c60d6918818615ae5179bb70fe WatchSource:0}: Error finding container 14b63214ef2ab8589736f2dde894a7445d23c1c60d6918818615ae5179bb70fe: Status 404 returned error can't find the container with id 14b63214ef2ab8589736f2dde894a7445d23c1c60d6918818615ae5179bb70fe
Sep 16 02:19:53.300555 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.300293    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p7rcn"]
Sep 16 02:19:53.303463 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:19:53.303440    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57b965f8_cef0_417c_b3a8_8c5c1a0883bf.slice/crio-bec99755801e0305266009709bdd044d0753c46fde0eccc73018d237278de27f WatchSource:0}: Error finding container bec99755801e0305266009709bdd044d0753c46fde0eccc73018d237278de27f: Status 404 returned error can't find the container with id bec99755801e0305266009709bdd044d0753c46fde0eccc73018d237278de27f
Sep 16 02:19:53.306970 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.306948    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5z7kc"]
Sep 16 02:19:53.309149 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:19:53.309130    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b569dfd_1a91_4dfd_a893_355d2a94681c.slice/crio-64af11a95ba69f7ff4287d7e99bca555ee64187486ced0ac41a5cfba54d15068 WatchSource:0}: Error finding container 64af11a95ba69f7ff4287d7e99bca555ee64187486ced0ac41a5cfba54d15068: Status 404 returned error can't find the container with id 64af11a95ba69f7ff4287d7e99bca555ee64187486ced0ac41a5cfba54d15068
Sep 16 02:19:53.312470 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.312407    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-56d69fd86-k7t96"]
Sep 16 02:19:53.314065 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:19:53.314044    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod182043a0_fc81_4e3f_857a_b663267ef5cb.slice/crio-c1a6a632b769379136e789544e36c4eea2039d3c1dabf8573561ac8bcba2c624 WatchSource:0}: Error finding container c1a6a632b769379136e789544e36c4eea2039d3c1dabf8573561ac8bcba2c624: Status 404 returned error can't find the container with id c1a6a632b769379136e789544e36c4eea2039d3c1dabf8573561ac8bcba2c624
Sep 16 02:19:53.658698 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.658664    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c8fbc86d5-kdlf6"]
Sep 16 02:19:53.661073 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.661047    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8fbc86d5-kdlf6"
Sep 16 02:19:53.672097 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.671762    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c8fbc86d5-kdlf6"]
Sep 16 02:19:53.672276 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.672253    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 16 02:19:53.706512 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.706469    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-plzgf" event={"ID":"597f5055-e714-4c18-8217-c33dc5b785e6","Type":"ContainerStarted","Data":"14b63214ef2ab8589736f2dde894a7445d23c1c60d6918818615ae5179bb70fe"}
Sep 16 02:19:53.708237 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.708185    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5z7kc" event={"ID":"4b569dfd-1a91-4dfd-a893-355d2a94681c","Type":"ContainerStarted","Data":"64af11a95ba69f7ff4287d7e99bca555ee64187486ced0ac41a5cfba54d15068"}
Sep 16 02:19:53.710244 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.710218    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2mmw9" event={"ID":"f05bbb56-ee96-4d5c-918d-18cddf968e87","Type":"ContainerStarted","Data":"e4fcd876b314e219456726377f8d860b30c121c4de28bf7cdd9a6121b62867c3"}
Sep 16 02:19:53.712140 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.712101    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-845b9d967d-mt58v" event={"ID":"b33bde5f-ae41-4273-8746-3c06939ab8c7","Type":"ContainerStarted","Data":"0afd11f6957793520178571a6938215e1bffc2e8ca4f00f84eb844f9a419e007"}
Sep 16 02:19:53.713847 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.713787    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p7rcn" event={"ID":"57b965f8-cef0-417c-b3a8-8c5c1a0883bf","Type":"ContainerStarted","Data":"bec99755801e0305266009709bdd044d0753c46fde0eccc73018d237278de27f"}
Sep 16 02:19:53.715675 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.715645    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-28zx4" event={"ID":"e97c2084-e633-418b-a513-a1ea5875e1ba","Type":"ContainerStarted","Data":"8e8b7b24afd703ee25811538b33ab297c685a5ee74c7254ddfe7ba173e7b6062"}
Sep 16 02:19:53.716438 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.716398    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-28zx4"
Sep 16 02:19:53.717052 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.716964    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9758d76e-bdce-40aa-a4e6-9b34f9f29958-console-config\") pod \"console-5c8fbc86d5-kdlf6\" (UID: \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\") " pod="openshift-console/console-5c8fbc86d5-kdlf6"
Sep 16 02:19:53.717052 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.716998    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9758d76e-bdce-40aa-a4e6-9b34f9f29958-service-ca\") pod \"console-5c8fbc86d5-kdlf6\" (UID: \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\") " pod="openshift-console/console-5c8fbc86d5-kdlf6"
Sep 16 02:19:53.717052 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.717027    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-978qk\" (UniqueName: \"kubernetes.io/projected/9758d76e-bdce-40aa-a4e6-9b34f9f29958-kube-api-access-978qk\") pod \"console-5c8fbc86d5-kdlf6\" (UID: \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\") " pod="openshift-console/console-5c8fbc86d5-kdlf6"
Sep 16 02:19:53.717352 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.717069    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9758d76e-bdce-40aa-a4e6-9b34f9f29958-trusted-ca-bundle\") pod \"console-5c8fbc86d5-kdlf6\" (UID: \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\") " pod="openshift-console/console-5c8fbc86d5-kdlf6"
Sep 16 02:19:53.717352 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.717121    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9758d76e-bdce-40aa-a4e6-9b34f9f29958-console-oauth-config\") pod \"console-5c8fbc86d5-kdlf6\" (UID: \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\") " pod="openshift-console/console-5c8fbc86d5-kdlf6"
Sep 16 02:19:53.717352 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.717155    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9758d76e-bdce-40aa-a4e6-9b34f9f29958-oauth-serving-cert\") pod \"console-5c8fbc86d5-kdlf6\" (UID: \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\") " pod="openshift-console/console-5c8fbc86d5-kdlf6"
Sep 16 02:19:53.717352 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.717185    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9758d76e-bdce-40aa-a4e6-9b34f9f29958-console-serving-cert\") pod \"console-5c8fbc86d5-kdlf6\" (UID: \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\") " pod="openshift-console/console-5c8fbc86d5-kdlf6"
Sep 16 02:19:53.719346 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.719319    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56d69fd86-k7t96" event={"ID":"182043a0-fc81-4e3f-857a-b663267ef5cb","Type":"ContainerStarted","Data":"c1a6a632b769379136e789544e36c4eea2039d3c1dabf8573561ac8bcba2c624"}
Sep 16 02:19:53.729562 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.729535    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-28zx4"
Sep 16 02:19:53.733053 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.732824    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-28zx4" podStartSLOduration=1.6893230639999999 podStartE2EDuration="18.732806646s" totalImagesPullingTime="17.043483582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:19:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:19:53.731022904 +0000 UTC m=+71.781367426" watchObservedRunningTime="2026-09-16 02:19:53.732806646 +0000 UTC m=+71.783151140"
Sep 16 02:19:53.770895 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.770838    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:53.817976 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.817924    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9758d76e-bdce-40aa-a4e6-9b34f9f29958-console-config\") pod \"console-5c8fbc86d5-kdlf6\" (UID: \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\") " pod="openshift-console/console-5c8fbc86d5-kdlf6"
Sep 16 02:19:53.817976 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.817969    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9758d76e-bdce-40aa-a4e6-9b34f9f29958-service-ca\") pod \"console-5c8fbc86d5-kdlf6\" (UID: \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\") " pod="openshift-console/console-5c8fbc86d5-kdlf6"
Sep 16 02:19:53.818212 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.817992    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-978qk\" (UniqueName: \"kubernetes.io/projected/9758d76e-bdce-40aa-a4e6-9b34f9f29958-kube-api-access-978qk\") pod \"console-5c8fbc86d5-kdlf6\" (UID: \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\") " pod="openshift-console/console-5c8fbc86d5-kdlf6"
Sep 16 02:19:53.818212 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.818028    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9758d76e-bdce-40aa-a4e6-9b34f9f29958-trusted-ca-bundle\") pod \"console-5c8fbc86d5-kdlf6\" (UID: \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\") " pod="openshift-console/console-5c8fbc86d5-kdlf6"
Sep 16 02:19:53.818212 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.818089    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9758d76e-bdce-40aa-a4e6-9b34f9f29958-console-oauth-config\") pod \"console-5c8fbc86d5-kdlf6\" (UID: \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\") " pod="openshift-console/console-5c8fbc86d5-kdlf6"
Sep 16 02:19:53.818212 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.818122    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9758d76e-bdce-40aa-a4e6-9b34f9f29958-oauth-serving-cert\") pod \"console-5c8fbc86d5-kdlf6\" (UID: \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\") " pod="openshift-console/console-5c8fbc86d5-kdlf6"
Sep 16 02:19:53.818212 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.818154    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9758d76e-bdce-40aa-a4e6-9b34f9f29958-console-serving-cert\") pod \"console-5c8fbc86d5-kdlf6\" (UID: \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\") " pod="openshift-console/console-5c8fbc86d5-kdlf6"
Sep 16 02:19:53.819514 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.819487    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9758d76e-bdce-40aa-a4e6-9b34f9f29958-trusted-ca-bundle\") pod \"console-5c8fbc86d5-kdlf6\" (UID: \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\") " pod="openshift-console/console-5c8fbc86d5-kdlf6"
Sep 16 02:19:53.820106 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.820082    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9758d76e-bdce-40aa-a4e6-9b34f9f29958-console-config\") pod \"console-5c8fbc86d5-kdlf6\" (UID: \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\") " pod="openshift-console/console-5c8fbc86d5-kdlf6"
Sep 16 02:19:53.820686 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.820663    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9758d76e-bdce-40aa-a4e6-9b34f9f29958-service-ca\") pod \"console-5c8fbc86d5-kdlf6\" (UID: \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\") " pod="openshift-console/console-5c8fbc86d5-kdlf6"
Sep 16 02:19:53.822788 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.822659    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9758d76e-bdce-40aa-a4e6-9b34f9f29958-oauth-serving-cert\") pod \"console-5c8fbc86d5-kdlf6\" (UID: \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\") " pod="openshift-console/console-5c8fbc86d5-kdlf6"
Sep 16 02:19:53.825017 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.824973    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9758d76e-bdce-40aa-a4e6-9b34f9f29958-console-serving-cert\") pod \"console-5c8fbc86d5-kdlf6\" (UID: \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\") " pod="openshift-console/console-5c8fbc86d5-kdlf6"
Sep 16 02:19:53.827182 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.826809    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9758d76e-bdce-40aa-a4e6-9b34f9f29958-console-oauth-config\") pod \"console-5c8fbc86d5-kdlf6\" (UID: \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\") " pod="openshift-console/console-5c8fbc86d5-kdlf6"
Sep 16 02:19:53.828810 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.828731    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-978qk\" (UniqueName: \"kubernetes.io/projected/9758d76e-bdce-40aa-a4e6-9b34f9f29958-kube-api-access-978qk\") pod \"console-5c8fbc86d5-kdlf6\" (UID: \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\") " pod="openshift-console/console-5c8fbc86d5-kdlf6"
Sep 16 02:19:53.871493 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.871457    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:53.972706 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.972567    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:53.978488 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:53.978455    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8fbc86d5-kdlf6"
Sep 16 02:19:54.317354 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:54.317271    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c8fbc86d5-kdlf6"]
Sep 16 02:19:54.745309 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:54.745227    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8fbc86d5-kdlf6" event={"ID":"9758d76e-bdce-40aa-a4e6-9b34f9f29958","Type":"ContainerStarted","Data":"e6f4e02f73e8d98a0f44022f67f90317ac49efddf2e10309020d84302dd3dc7c"}
Sep 16 02:19:55.627600 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:55.626925    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64594f967d-5d94c"
Sep 16 02:19:55.749778 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:55.749747    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:55.802972 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:55.802907    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:55.862792 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:55.862723    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:55.963473 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:55.963412    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:57.490144 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:57.490085    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:57.591264 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:57.591144    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:59.657321 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:59.657225    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:19:59.706910 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:19:59.706874    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:20:00.102898 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:00.102821    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:20:00.152349 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:00.152305    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:20:02.774099 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:02.774063    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:20:02.874370 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:02.874325    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:20:03.166341 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:03.166307    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:20:03.269268 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:03.269235    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:20:03.790595 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:03.789976    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2mmw9" event={"ID":"f05bbb56-ee96-4d5c-918d-18cddf968e87","Type":"ContainerStarted","Data":"a07750f6d3b1e167cf1a6c68968a31a548141f2d0e357ff46b179fa22e7f4d00"}
Sep 16 02:20:03.790595 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:03.790519    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:20:03.792733 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:03.792588    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-845b9d967d-mt58v" event={"ID":"b33bde5f-ae41-4273-8746-3c06939ab8c7","Type":"ContainerStarted","Data":"c944976476bab2aee63ae119d7e1e6d22b7d6295704b584d67ec4a81b5d040e1"}
Sep 16 02:20:03.795819 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:03.795732    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p7rcn" event={"ID":"57b965f8-cef0-417c-b3a8-8c5c1a0883bf","Type":"ContainerStarted","Data":"3fcf01f2c98ee45bc7e34186fd1a8f4e58f99d7d979fd1b62daf36f1d1e017d7"}
Sep 16 02:20:03.798163 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:03.798096    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56d69fd86-k7t96" event={"ID":"182043a0-fc81-4e3f-857a-b663267ef5cb","Type":"ContainerStarted","Data":"06a420735d0944f351f1bfb57667361e8c235abc6c83b71864e7dacec98edab6"}
Sep 16 02:20:03.810040 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:03.806897    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-plzgf" event={"ID":"597f5055-e714-4c18-8217-c33dc5b785e6","Type":"ContainerStarted","Data":"a36abf9c013720b39b67a6d6d9259454caac2cef095c120f634886ea9856a737"}
Sep 16 02:20:03.810040 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:03.808783    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-plzgf"
Sep 16 02:20:03.810040 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:03.809220    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2mmw9" podStartSLOduration=71.551906086 podStartE2EDuration="1m21.809203848s" totalImagesPullingTime="10.257297762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:18:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:20:03.808920136 +0000 UTC m=+81.859264647" watchObservedRunningTime="2026-09-16 02:20:03.809203848 +0000 UTC m=+81.859548342"
Sep 16 02:20:03.811341 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:03.810983    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8fbc86d5-kdlf6" event={"ID":"9758d76e-bdce-40aa-a4e6-9b34f9f29958","Type":"ContainerStarted","Data":"f70d33d83484034d6e19db9daa40b139ff04d33bf7de700341b569c9368969b0"}
Sep 16 02:20:03.817218 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:03.817145    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5z7kc" event={"ID":"4b569dfd-1a91-4dfd-a893-355d2a94681c","Type":"ContainerStarted","Data":"3aa6436af350b3f3cdd61bc5a36796de2ae7efe02bc921fee4175452d2eeaf64"}
Sep 16 02:20:03.818393 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:03.818327    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-plzgf"
Sep 16 02:20:03.826121 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:03.825897    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-845b9d967d-mt58v" podStartSLOduration=8.283788244 podStartE2EDuration="18.8258828s" totalImagesPullingTime="10.542094556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:19:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:20:03.824533065 +0000 UTC m=+81.874877582" watchObservedRunningTime="2026-09-16 02:20:03.8258828 +0000 UTC m=+81.876227293"
Sep 16 02:20:03.839842 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:03.839800    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-plzgf" podStartSLOduration=5.610848019 podStartE2EDuration="15.839786096s" totalImagesPullingTime="10.228938077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:19:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:20:03.838588838 +0000 UTC m=+81.888933344" watchObservedRunningTime="2026-09-16 02:20:03.839786096 +0000 UTC m=+81.890130589"
Sep 16 02:20:03.876523 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:03.876469    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c8fbc86d5-kdlf6" podStartSLOduration=1.659503548 podStartE2EDuration="10.876447354s" totalImagesPullingTime="9.216943806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:19:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:20:03.874587945 +0000 UTC m=+81.924932441" watchObservedRunningTime="2026-09-16 02:20:03.876447354 +0000 UTC m=+81.926791847"
Sep 16 02:20:03.888317 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:03.888269    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5z7kc" podStartSLOduration=71.6485864 podStartE2EDuration="1m21.888249771s" totalImagesPullingTime="10.239663371s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 02:18:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:20:03.887245483 +0000 UTC m=+81.937589973" watchObservedRunningTime="2026-09-16 02:20:03.888249771 +0000 UTC m=+81.938594264"
Sep 16 02:20:03.979196 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:03.979126    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c8fbc86d5-kdlf6"
Sep 16 02:20:03.979196 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:03.979170    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c8fbc86d5-kdlf6"
Sep 16 02:20:03.983845 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:03.983824    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c8fbc86d5-kdlf6"
Sep 16 02:20:04.823948 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:04.823907    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p7rcn" event={"ID":"57b965f8-cef0-417c-b3a8-8c5c1a0883bf","Type":"ContainerStarted","Data":"b640fea30fc78fab67a289277b4290e928b6c6a7c342629988c2b7e980eafb5f"}
Sep 16 02:20:04.829183 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:04.829159    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c8fbc86d5-kdlf6"
Sep 16 02:20:04.839903 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:04.839834    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-p7rcn" podStartSLOduration=72.708862838 podStartE2EDuration="1m22.839814748s" totalImagesPullingTime="10.13095191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:18:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:20:04.838694292 +0000 UTC m=+82.889038805" watchObservedRunningTime="2026-09-16 02:20:04.839814748 +0000 UTC m=+82.890159261"
Sep 16 02:20:04.878331 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:04.878305    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-845b9d967d-mt58v"]
Sep 16 02:20:04.930174 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:04.930150    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:20:05.030869 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:05.030781    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:20:05.131867 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:05.131806    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:20:05.232415 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:05.232387    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:20:05.703134 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:05.703107    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-845b9d967d-mt58v"
Sep 16 02:20:05.703352 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:05.703155    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-845b9d967d-mt58v"
Sep 16 02:20:05.707797 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:05.707780    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-845b9d967d-mt58v"
Sep 16 02:20:05.733391 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:05.733350    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:20:05.811642 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:05.811607    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:20:05.829553 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:05.829532    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56d69fd86-k7t96" event={"ID":"182043a0-fc81-4e3f-857a-b663267ef5cb","Type":"ContainerStarted","Data":"0e3bea9c5ed5b3a145ed3a09d3f9cea420ea89357bcaaeb22e20b33146874723"}
Sep 16 02:20:05.829911 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:05.829582    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56d69fd86-k7t96" event={"ID":"182043a0-fc81-4e3f-857a-b663267ef5cb","Type":"ContainerStarted","Data":"efd24f4c39e3c0d721cec7d04c3eb87cb4ee5994feac0627f2d0e18b1aae7e0b"}
Sep 16 02:20:05.833766 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:05.833746    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-845b9d967d-mt58v"
Sep 16 02:20:05.862311 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:05.862271    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-56d69fd86-k7t96" podStartSLOduration=5.104406808 podStartE2EDuration="16.86225672s" totalImagesPullingTime="11.757849912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:19:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:20:05.860429847 +0000 UTC m=+83.910774351" watchObservedRunningTime="2026-09-16 02:20:05.86225672 +0000 UTC m=+83.912601214"
Sep 16 02:20:06.637805 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:06.637766    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:20:06.696563 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:06.696528    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:20:06.857783 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:06.857756    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d88ff674d-vzrz2"]
Sep 16 02:20:06.873773 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:06.873750    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d88ff674d-vzrz2"]
Sep 16 02:20:06.873913 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:06.873842    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d88ff674d-vzrz2"
Sep 16 02:20:06.934783 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:06.934756    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:20:06.987934 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:06.987908    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:20:07.055081 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:07.055055    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-console-config\") pod \"console-6d88ff674d-vzrz2\" (UID: \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\") " pod="openshift-console/console-6d88ff674d-vzrz2"
Sep 16 02:20:07.055081 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:07.055081    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj6rf\" (UniqueName: \"kubernetes.io/projected/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-kube-api-access-kj6rf\") pod \"console-6d88ff674d-vzrz2\" (UID: \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\") " pod="openshift-console/console-6d88ff674d-vzrz2"
Sep 16 02:20:07.055222 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:07.055102    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-console-serving-cert\") pod \"console-6d88ff674d-vzrz2\" (UID: \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\") " pod="openshift-console/console-6d88ff674d-vzrz2"
Sep 16 02:20:07.055222 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:07.055142    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-trusted-ca-bundle\") pod \"console-6d88ff674d-vzrz2\" (UID: \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\") " pod="openshift-console/console-6d88ff674d-vzrz2"
Sep 16 02:20:07.055222 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:07.055201    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-console-oauth-config\") pod \"console-6d88ff674d-vzrz2\" (UID: \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\") " pod="openshift-console/console-6d88ff674d-vzrz2"
Sep 16 02:20:07.055323 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:07.055230    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-service-ca\") pod \"console-6d88ff674d-vzrz2\" (UID: \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\") " pod="openshift-console/console-6d88ff674d-vzrz2"
Sep 16 02:20:07.055323 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:07.055268    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-oauth-serving-cert\") pod \"console-6d88ff674d-vzrz2\" (UID: \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\") " pod="openshift-console/console-6d88ff674d-vzrz2"
Sep 16 02:20:07.156473 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:07.156437    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-oauth-serving-cert\") pod \"console-6d88ff674d-vzrz2\" (UID: \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\") " pod="openshift-console/console-6d88ff674d-vzrz2"
Sep 16 02:20:07.156626 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:07.156479    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-console-config\") pod \"console-6d88ff674d-vzrz2\" (UID: \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\") " pod="openshift-console/console-6d88ff674d-vzrz2"
Sep 16 02:20:07.156626 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:07.156507    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj6rf\" (UniqueName: \"kubernetes.io/projected/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-kube-api-access-kj6rf\") pod \"console-6d88ff674d-vzrz2\" (UID: \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\") " pod="openshift-console/console-6d88ff674d-vzrz2"
Sep 16 02:20:07.156626 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:07.156538    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-console-serving-cert\") pod \"console-6d88ff674d-vzrz2\" (UID: \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\") " pod="openshift-console/console-6d88ff674d-vzrz2"
Sep 16 02:20:07.156626 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:07.156570    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-trusted-ca-bundle\") pod \"console-6d88ff674d-vzrz2\" (UID: \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\") " pod="openshift-console/console-6d88ff674d-vzrz2"
Sep 16 02:20:07.156626 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:07.156599    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-console-oauth-config\") pod \"console-6d88ff674d-vzrz2\" (UID: \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\") " pod="openshift-console/console-6d88ff674d-vzrz2"
Sep 16 02:20:07.156884 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:07.156635    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-service-ca\") pod \"console-6d88ff674d-vzrz2\" (UID: \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\") " pod="openshift-console/console-6d88ff674d-vzrz2"
Sep 16 02:20:07.157348 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:07.157312    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-service-ca\") pod \"console-6d88ff674d-vzrz2\" (UID: \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\") " pod="openshift-console/console-6d88ff674d-vzrz2"
Sep 16 02:20:07.157348 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:07.157312    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-oauth-serving-cert\") pod \"console-6d88ff674d-vzrz2\" (UID: \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\") " pod="openshift-console/console-6d88ff674d-vzrz2"
Sep 16 02:20:07.157544 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:07.157480    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-console-config\") pod \"console-6d88ff674d-vzrz2\" (UID: \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\") " pod="openshift-console/console-6d88ff674d-vzrz2"
Sep 16 02:20:07.157544 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:07.157533    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-trusted-ca-bundle\") pod \"console-6d88ff674d-vzrz2\" (UID: \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\") " pod="openshift-console/console-6d88ff674d-vzrz2"
Sep 16 02:20:07.159211 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:07.159187    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-console-oauth-config\") pod \"console-6d88ff674d-vzrz2\" (UID: \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\") " pod="openshift-console/console-6d88ff674d-vzrz2"
Sep 16 02:20:07.159308 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:07.159187    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-console-serving-cert\") pod \"console-6d88ff674d-vzrz2\" (UID: \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\") " pod="openshift-console/console-6d88ff674d-vzrz2"
Sep 16 02:20:07.163654 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:07.163637    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj6rf\" (UniqueName: \"kubernetes.io/projected/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-kube-api-access-kj6rf\") pod \"console-6d88ff674d-vzrz2\" (UID: \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\") " pod="openshift-console/console-6d88ff674d-vzrz2"
Sep 16 02:20:07.185868 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:07.185810    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d88ff674d-vzrz2"
Sep 16 02:20:07.326221 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:07.326191    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:20:07.379279 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:07.379247    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:20:07.478621 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:07.478595    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d88ff674d-vzrz2"]
Sep 16 02:20:07.481154 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:20:07.481124    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86d33b9c_7de2_42fb_8c0a_bd8465f9acc2.slice/crio-c8b062dec45d27ecab331679a0364434bf2283d27cc94a05ff2422a50e6fcc6c WatchSource:0}: Error finding container c8b062dec45d27ecab331679a0364434bf2283d27cc94a05ff2422a50e6fcc6c: Status 404 returned error can't find the container with id c8b062dec45d27ecab331679a0364434bf2283d27cc94a05ff2422a50e6fcc6c
Sep 16 02:20:07.838222 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:07.838140    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d88ff674d-vzrz2" event={"ID":"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2","Type":"ContainerStarted","Data":"36491c16febc9a83833aab229e25c76bdb5f8b48030fbf57cefa601a55862bf7"}
Sep 16 02:20:07.838222 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:07.838196    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d88ff674d-vzrz2" event={"ID":"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2","Type":"ContainerStarted","Data":"c8b062dec45d27ecab331679a0364434bf2283d27cc94a05ff2422a50e6fcc6c"}
Sep 16 02:20:07.854142 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:07.854094    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d88ff674d-vzrz2" podStartSLOduration=1.854077253 podStartE2EDuration="1.854077253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:20:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:20:07.853259523 +0000 UTC m=+85.903604035" watchObservedRunningTime="2026-09-16 02:20:07.854077253 +0000 UTC m=+85.904421746"
Sep 16 02:20:17.186484 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:17.186443    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d88ff674d-vzrz2"
Sep 16 02:20:17.187022 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:17.186511    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d88ff674d-vzrz2"
Sep 16 02:20:17.191446 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:17.191423    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d88ff674d-vzrz2"
Sep 16 02:20:17.879086 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:17.879060    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d88ff674d-vzrz2"
Sep 16 02:20:17.920463 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:17.920433    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c8fbc86d5-kdlf6"]
Sep 16 02:20:18.031311 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:18.031278    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:20:18.130718 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:18.130631    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:20:18.229348 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:18.229316    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:20:21.933629 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:21.933590    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:20:22.034129 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:22.034094    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:20:29.342355 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:29.342315    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:20:29.444738 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:29.444711    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:20:29.544567 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:29.544545    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:20:30.848248 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:30.848208    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-845b9d967d-mt58v" podUID="b33bde5f-ae41-4273-8746-3c06939ab8c7" containerName="console" containerID="cri-o://c944976476bab2aee63ae119d7e1e6d22b7d6295704b584d67ec4a81b5d040e1" gracePeriod=15
Sep 16 02:20:31.122454 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:31.122396    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-845b9d967d-mt58v"
Sep 16 02:20:31.230741 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:31.230710    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b33bde5f-ae41-4273-8746-3c06939ab8c7-console-serving-cert\") pod \"b33bde5f-ae41-4273-8746-3c06939ab8c7\" (UID: \"b33bde5f-ae41-4273-8746-3c06939ab8c7\") "
Sep 16 02:20:31.230883 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:31.230754    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b33bde5f-ae41-4273-8746-3c06939ab8c7-console-config\") pod \"b33bde5f-ae41-4273-8746-3c06939ab8c7\" (UID: \"b33bde5f-ae41-4273-8746-3c06939ab8c7\") "
Sep 16 02:20:31.230883 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:31.230791    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b33bde5f-ae41-4273-8746-3c06939ab8c7-service-ca\") pod \"b33bde5f-ae41-4273-8746-3c06939ab8c7\" (UID: \"b33bde5f-ae41-4273-8746-3c06939ab8c7\") "
Sep 16 02:20:31.230953 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:31.230898    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhb5z\" (UniqueName: \"kubernetes.io/projected/b33bde5f-ae41-4273-8746-3c06939ab8c7-kube-api-access-fhb5z\") pod \"b33bde5f-ae41-4273-8746-3c06939ab8c7\" (UID: \"b33bde5f-ae41-4273-8746-3c06939ab8c7\") "
Sep 16 02:20:31.230993 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:31.230949    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b33bde5f-ae41-4273-8746-3c06939ab8c7-oauth-serving-cert\") pod \"b33bde5f-ae41-4273-8746-3c06939ab8c7\" (UID: \"b33bde5f-ae41-4273-8746-3c06939ab8c7\") "
Sep 16 02:20:31.231042 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:31.230989    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b33bde5f-ae41-4273-8746-3c06939ab8c7-console-oauth-config\") pod \"b33bde5f-ae41-4273-8746-3c06939ab8c7\" (UID: \"b33bde5f-ae41-4273-8746-3c06939ab8c7\") "
Sep 16 02:20:31.231133 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:31.231110    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b33bde5f-ae41-4273-8746-3c06939ab8c7-service-ca" (OuterVolumeSpecName: "service-ca") pod "b33bde5f-ae41-4273-8746-3c06939ab8c7" (UID: "b33bde5f-ae41-4273-8746-3c06939ab8c7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:20:31.231253 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:31.231235    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b33bde5f-ae41-4273-8746-3c06939ab8c7-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:20:31.231597 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:31.231164    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b33bde5f-ae41-4273-8746-3c06939ab8c7-console-config" (OuterVolumeSpecName: "console-config") pod "b33bde5f-ae41-4273-8746-3c06939ab8c7" (UID: "b33bde5f-ae41-4273-8746-3c06939ab8c7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:20:31.233434 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:31.231746    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b33bde5f-ae41-4273-8746-3c06939ab8c7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b33bde5f-ae41-4273-8746-3c06939ab8c7" (UID: "b33bde5f-ae41-4273-8746-3c06939ab8c7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:20:31.236807 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:31.236779    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b33bde5f-ae41-4273-8746-3c06939ab8c7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b33bde5f-ae41-4273-8746-3c06939ab8c7" (UID: "b33bde5f-ae41-4273-8746-3c06939ab8c7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:20:31.236897 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:31.236833    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b33bde5f-ae41-4273-8746-3c06939ab8c7-kube-api-access-fhb5z" (OuterVolumeSpecName: "kube-api-access-fhb5z") pod "b33bde5f-ae41-4273-8746-3c06939ab8c7" (UID: "b33bde5f-ae41-4273-8746-3c06939ab8c7"). InnerVolumeSpecName "kube-api-access-fhb5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:20:31.236897 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:31.236841    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b33bde5f-ae41-4273-8746-3c06939ab8c7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b33bde5f-ae41-4273-8746-3c06939ab8c7" (UID: "b33bde5f-ae41-4273-8746-3c06939ab8c7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:20:31.332211 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:31.332186    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhb5z\" (UniqueName: \"kubernetes.io/projected/b33bde5f-ae41-4273-8746-3c06939ab8c7-kube-api-access-fhb5z\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:20:31.332211 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:31.332209    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b33bde5f-ae41-4273-8746-3c06939ab8c7-oauth-serving-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:20:31.332330 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:31.332219    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b33bde5f-ae41-4273-8746-3c06939ab8c7-console-oauth-config\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:20:31.332330 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:31.332227    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b33bde5f-ae41-4273-8746-3c06939ab8c7-console-serving-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:20:31.332330 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:31.332236    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b33bde5f-ae41-4273-8746-3c06939ab8c7-console-config\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:20:31.925978 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:31.925940    2565 generic.go:356] "Generic (PLEG): container finished" podID="b33bde5f-ae41-4273-8746-3c06939ab8c7" containerID="c944976476bab2aee63ae119d7e1e6d22b7d6295704b584d67ec4a81b5d040e1" exitCode=0
Sep 16 02:20:31.926415 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:31.926003    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-845b9d967d-mt58v"
Sep 16 02:20:31.926415 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:31.926002    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-845b9d967d-mt58v" event={"ID":"b33bde5f-ae41-4273-8746-3c06939ab8c7","Type":"ContainerDied","Data":"c944976476bab2aee63ae119d7e1e6d22b7d6295704b584d67ec4a81b5d040e1"}
Sep 16 02:20:31.926415 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:31.926117    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-845b9d967d-mt58v" event={"ID":"b33bde5f-ae41-4273-8746-3c06939ab8c7","Type":"ContainerDied","Data":"0afd11f6957793520178571a6938215e1bffc2e8ca4f00f84eb844f9a419e007"}
Sep 16 02:20:31.926415 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:31.926144    2565 scope.go:117] "RemoveContainer" containerID="c944976476bab2aee63ae119d7e1e6d22b7d6295704b584d67ec4a81b5d040e1"
Sep 16 02:20:31.941745 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:31.941726    2565 scope.go:117] "RemoveContainer" containerID="c944976476bab2aee63ae119d7e1e6d22b7d6295704b584d67ec4a81b5d040e1"
Sep 16 02:20:31.942068 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:20:31.942047    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c944976476bab2aee63ae119d7e1e6d22b7d6295704b584d67ec4a81b5d040e1\": container with ID starting with c944976476bab2aee63ae119d7e1e6d22b7d6295704b584d67ec4a81b5d040e1 not found: ID does not exist" containerID="c944976476bab2aee63ae119d7e1e6d22b7d6295704b584d67ec4a81b5d040e1"
Sep 16 02:20:31.942118 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:31.942078    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c944976476bab2aee63ae119d7e1e6d22b7d6295704b584d67ec4a81b5d040e1"} err="failed to get container status \"c944976476bab2aee63ae119d7e1e6d22b7d6295704b584d67ec4a81b5d040e1\": rpc error: code = NotFound desc = could not find container \"c944976476bab2aee63ae119d7e1e6d22b7d6295704b584d67ec4a81b5d040e1\": container with ID starting with c944976476bab2aee63ae119d7e1e6d22b7d6295704b584d67ec4a81b5d040e1 not found: ID does not exist"
Sep 16 02:20:31.945107 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:31.945085    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-845b9d967d-mt58v"]
Sep 16 02:20:31.947736 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:31.947715    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-845b9d967d-mt58v"]
Sep 16 02:20:32.389056 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:32.388996    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b33bde5f-ae41-4273-8746-3c06939ab8c7" path="/var/lib/kubelet/pods/b33bde5f-ae41-4273-8746-3c06939ab8c7/volumes"
Sep 16 02:20:35.832005 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:35.831975    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2mmw9"
Sep 16 02:20:42.939565 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:42.939517    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c8fbc86d5-kdlf6" podUID="9758d76e-bdce-40aa-a4e6-9b34f9f29958" containerName="console" containerID="cri-o://f70d33d83484034d6e19db9daa40b139ff04d33bf7de700341b569c9368969b0" gracePeriod=15
Sep 16 02:20:43.208018 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:43.207966    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8fbc86d5-kdlf6"
Sep 16 02:20:43.313947 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:43.313926    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9758d76e-bdce-40aa-a4e6-9b34f9f29958-console-serving-cert\") pod \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\" (UID: \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\") "
Sep 16 02:20:43.314061 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:43.313956    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9758d76e-bdce-40aa-a4e6-9b34f9f29958-console-config\") pod \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\" (UID: \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\") "
Sep 16 02:20:43.314061 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:43.313984    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9758d76e-bdce-40aa-a4e6-9b34f9f29958-console-oauth-config\") pod \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\" (UID: \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\") "
Sep 16 02:20:43.314061 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:43.314006    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9758d76e-bdce-40aa-a4e6-9b34f9f29958-trusted-ca-bundle\") pod \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\" (UID: \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\") "
Sep 16 02:20:43.314061 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:43.314036    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9758d76e-bdce-40aa-a4e6-9b34f9f29958-service-ca\") pod \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\" (UID: \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\") "
Sep 16 02:20:43.314061 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:43.314052    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9758d76e-bdce-40aa-a4e6-9b34f9f29958-oauth-serving-cert\") pod \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\" (UID: \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\") "
Sep 16 02:20:43.314287 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:43.314093    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-978qk\" (UniqueName: \"kubernetes.io/projected/9758d76e-bdce-40aa-a4e6-9b34f9f29958-kube-api-access-978qk\") pod \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\" (UID: \"9758d76e-bdce-40aa-a4e6-9b34f9f29958\") "
Sep 16 02:20:43.314515 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:43.314466    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9758d76e-bdce-40aa-a4e6-9b34f9f29958-console-config" (OuterVolumeSpecName: "console-config") pod "9758d76e-bdce-40aa-a4e6-9b34f9f29958" (UID: "9758d76e-bdce-40aa-a4e6-9b34f9f29958"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:20:43.314515 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:43.314499    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9758d76e-bdce-40aa-a4e6-9b34f9f29958-service-ca" (OuterVolumeSpecName: "service-ca") pod "9758d76e-bdce-40aa-a4e6-9b34f9f29958" (UID: "9758d76e-bdce-40aa-a4e6-9b34f9f29958"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:20:43.314715 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:43.314535    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9758d76e-bdce-40aa-a4e6-9b34f9f29958-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9758d76e-bdce-40aa-a4e6-9b34f9f29958" (UID: "9758d76e-bdce-40aa-a4e6-9b34f9f29958"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:20:43.314715 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:43.314582    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9758d76e-bdce-40aa-a4e6-9b34f9f29958-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9758d76e-bdce-40aa-a4e6-9b34f9f29958" (UID: "9758d76e-bdce-40aa-a4e6-9b34f9f29958"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:20:43.316180 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:43.316152    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9758d76e-bdce-40aa-a4e6-9b34f9f29958-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9758d76e-bdce-40aa-a4e6-9b34f9f29958" (UID: "9758d76e-bdce-40aa-a4e6-9b34f9f29958"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:20:43.316282 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:43.316253    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9758d76e-bdce-40aa-a4e6-9b34f9f29958-kube-api-access-978qk" (OuterVolumeSpecName: "kube-api-access-978qk") pod "9758d76e-bdce-40aa-a4e6-9b34f9f29958" (UID: "9758d76e-bdce-40aa-a4e6-9b34f9f29958"). InnerVolumeSpecName "kube-api-access-978qk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:20:43.316282 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:43.316259    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9758d76e-bdce-40aa-a4e6-9b34f9f29958-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9758d76e-bdce-40aa-a4e6-9b34f9f29958" (UID: "9758d76e-bdce-40aa-a4e6-9b34f9f29958"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:20:43.414531 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:43.414507    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-978qk\" (UniqueName: \"kubernetes.io/projected/9758d76e-bdce-40aa-a4e6-9b34f9f29958-kube-api-access-978qk\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:20:43.414531 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:43.414528    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9758d76e-bdce-40aa-a4e6-9b34f9f29958-console-serving-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:20:43.414658 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:43.414537    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9758d76e-bdce-40aa-a4e6-9b34f9f29958-console-config\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:20:43.414658 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:43.414546    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9758d76e-bdce-40aa-a4e6-9b34f9f29958-console-oauth-config\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:20:43.414658 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:43.414554    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9758d76e-bdce-40aa-a4e6-9b34f9f29958-trusted-ca-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:20:43.414658 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:43.414563    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9758d76e-bdce-40aa-a4e6-9b34f9f29958-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:20:43.414658 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:43.414572    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9758d76e-bdce-40aa-a4e6-9b34f9f29958-oauth-serving-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:20:43.969906 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:43.969873    2565 generic.go:356] "Generic (PLEG): container finished" podID="9758d76e-bdce-40aa-a4e6-9b34f9f29958" containerID="f70d33d83484034d6e19db9daa40b139ff04d33bf7de700341b569c9368969b0" exitCode=0
Sep 16 02:20:43.970371 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:43.969947    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8fbc86d5-kdlf6"
Sep 16 02:20:43.970371 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:43.969942    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8fbc86d5-kdlf6" event={"ID":"9758d76e-bdce-40aa-a4e6-9b34f9f29958","Type":"ContainerDied","Data":"f70d33d83484034d6e19db9daa40b139ff04d33bf7de700341b569c9368969b0"}
Sep 16 02:20:43.970371 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:43.970016    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8fbc86d5-kdlf6" event={"ID":"9758d76e-bdce-40aa-a4e6-9b34f9f29958","Type":"ContainerDied","Data":"e6f4e02f73e8d98a0f44022f67f90317ac49efddf2e10309020d84302dd3dc7c"}
Sep 16 02:20:43.970371 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:43.970049    2565 scope.go:117] "RemoveContainer" containerID="f70d33d83484034d6e19db9daa40b139ff04d33bf7de700341b569c9368969b0"
Sep 16 02:20:43.977815 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:43.977796    2565 scope.go:117] "RemoveContainer" containerID="f70d33d83484034d6e19db9daa40b139ff04d33bf7de700341b569c9368969b0"
Sep 16 02:20:43.978100 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:20:43.978073    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f70d33d83484034d6e19db9daa40b139ff04d33bf7de700341b569c9368969b0\": container with ID starting with f70d33d83484034d6e19db9daa40b139ff04d33bf7de700341b569c9368969b0 not found: ID does not exist" containerID="f70d33d83484034d6e19db9daa40b139ff04d33bf7de700341b569c9368969b0"
Sep 16 02:20:43.978167 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:43.978114    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f70d33d83484034d6e19db9daa40b139ff04d33bf7de700341b569c9368969b0"} err="failed to get container status \"f70d33d83484034d6e19db9daa40b139ff04d33bf7de700341b569c9368969b0\": rpc error: code = NotFound desc = could not find container \"f70d33d83484034d6e19db9daa40b139ff04d33bf7de700341b569c9368969b0\": container with ID starting with f70d33d83484034d6e19db9daa40b139ff04d33bf7de700341b569c9368969b0 not found: ID does not exist"
Sep 16 02:20:43.992157 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:43.992136    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c8fbc86d5-kdlf6"]
Sep 16 02:20:43.998609 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:43.998584    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c8fbc86d5-kdlf6"]
Sep 16 02:20:44.390119 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:20:44.390046    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9758d76e-bdce-40aa-a4e6-9b34f9f29958" path="/var/lib/kubelet/pods/9758d76e-bdce-40aa-a4e6-9b34f9f29958/volumes"
Sep 16 02:21:00.027886 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:00.027839    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:21:00.075685 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:00.075631    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:21:05.869400 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.869345    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 02:21:05.869885 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.869632    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b33bde5f-ae41-4273-8746-3c06939ab8c7" containerName="console"
Sep 16 02:21:05.869885 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.869645    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b33bde5f-ae41-4273-8746-3c06939ab8c7" containerName="console"
Sep 16 02:21:05.869885 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.869662    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9758d76e-bdce-40aa-a4e6-9b34f9f29958" containerName="console"
Sep 16 02:21:05.869885 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.869667    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9758d76e-bdce-40aa-a4e6-9b34f9f29958" containerName="console"
Sep 16 02:21:05.869885 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.869716    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b33bde5f-ae41-4273-8746-3c06939ab8c7" containerName="console"
Sep 16 02:21:05.869885 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.869724    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9758d76e-bdce-40aa-a4e6-9b34f9f29958" containerName="console"
Sep 16 02:21:05.872147 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.872128    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:05.874626 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.874596    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 16 02:21:05.874875 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.874853    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 16 02:21:05.874981 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.874958    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 16 02:21:05.875101 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.875083    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 16 02:21:05.875303 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.875280    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 16 02:21:05.875338 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.875301    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tv9h9\""
Sep 16 02:21:05.875594 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.875578    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 16 02:21:05.875700 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.875683    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 16 02:21:05.875739 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.875701    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 16 02:21:05.880426 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.880401    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 16 02:21:05.885892 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.885868    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 02:21:05.962456 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.962431    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2167a2d5-5649-4538-b2e7-55a713b3c794-config-out\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:05.962558 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.962461    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2167a2d5-5649-4538-b2e7-55a713b3c794-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:05.962558 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.962485    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2167a2d5-5649-4538-b2e7-55a713b3c794-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:05.962558 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.962512    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kftqx\" (UniqueName: \"kubernetes.io/projected/2167a2d5-5649-4538-b2e7-55a713b3c794-kube-api-access-kftqx\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:05.962558 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.962546    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2167a2d5-5649-4538-b2e7-55a713b3c794-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:05.962682 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.962560    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2167a2d5-5649-4538-b2e7-55a713b3c794-web-config\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:05.962682 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.962583    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2167a2d5-5649-4538-b2e7-55a713b3c794-config-volume\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:05.962682 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.962604    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2167a2d5-5649-4538-b2e7-55a713b3c794-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:05.962682 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.962624    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2167a2d5-5649-4538-b2e7-55a713b3c794-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:05.962682 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.962645    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2167a2d5-5649-4538-b2e7-55a713b3c794-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:05.962826 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.962699    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2167a2d5-5649-4538-b2e7-55a713b3c794-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:05.962826 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.962731    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2167a2d5-5649-4538-b2e7-55a713b3c794-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:05.962826 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:05.962753    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2167a2d5-5649-4538-b2e7-55a713b3c794-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:06.063498 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:06.063474    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2167a2d5-5649-4538-b2e7-55a713b3c794-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:06.063498 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:06.063499    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2167a2d5-5649-4538-b2e7-55a713b3c794-web-config\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:06.063657 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:06.063517    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2167a2d5-5649-4538-b2e7-55a713b3c794-config-volume\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:06.063657 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:06.063532    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2167a2d5-5649-4538-b2e7-55a713b3c794-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:06.063657 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:06.063551    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2167a2d5-5649-4538-b2e7-55a713b3c794-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:06.063657 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:06.063569    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2167a2d5-5649-4538-b2e7-55a713b3c794-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:06.063657 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:06.063590    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2167a2d5-5649-4538-b2e7-55a713b3c794-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:06.063657 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:06.063619    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2167a2d5-5649-4538-b2e7-55a713b3c794-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:06.063657 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:06.063649    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2167a2d5-5649-4538-b2e7-55a713b3c794-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:06.063981 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:06.063682    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2167a2d5-5649-4538-b2e7-55a713b3c794-config-out\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:06.063981 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:06.063713    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2167a2d5-5649-4538-b2e7-55a713b3c794-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:06.063981 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:06.063742    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2167a2d5-5649-4538-b2e7-55a713b3c794-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:06.063981 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:06.063770    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kftqx\" (UniqueName: \"kubernetes.io/projected/2167a2d5-5649-4538-b2e7-55a713b3c794-kube-api-access-kftqx\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:06.064498 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:06.064472    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2167a2d5-5649-4538-b2e7-55a713b3c794-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:06.065226 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:06.064858    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2167a2d5-5649-4538-b2e7-55a713b3c794-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:06.065226 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:06.065168    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2167a2d5-5649-4538-b2e7-55a713b3c794-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:06.066644 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:06.066617    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2167a2d5-5649-4538-b2e7-55a713b3c794-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:06.066900 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:06.066851    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2167a2d5-5649-4538-b2e7-55a713b3c794-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:06.067115 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:06.067014    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2167a2d5-5649-4538-b2e7-55a713b3c794-web-config\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:06.067334 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:06.067312    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2167a2d5-5649-4538-b2e7-55a713b3c794-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:06.067502 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:06.067479    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2167a2d5-5649-4538-b2e7-55a713b3c794-config-out\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:06.067502 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:06.067494    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2167a2d5-5649-4538-b2e7-55a713b3c794-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:06.067763 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:06.067741    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2167a2d5-5649-4538-b2e7-55a713b3c794-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:06.067809 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:06.067749    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2167a2d5-5649-4538-b2e7-55a713b3c794-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:06.068741 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:06.068710    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2167a2d5-5649-4538-b2e7-55a713b3c794-config-volume\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:06.070565 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:06.070547    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kftqx\" (UniqueName: \"kubernetes.io/projected/2167a2d5-5649-4538-b2e7-55a713b3c794-kube-api-access-kftqx\") pod \"alertmanager-main-0\" (UID: \"2167a2d5-5649-4538-b2e7-55a713b3c794\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:06.182069 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:06.182040    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 16 02:21:06.455624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:06.455548    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 02:21:06.458713 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:21:06.458683    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2167a2d5_5649_4538_b2e7_55a713b3c794.slice/crio-d4a66a1642b68cf9494f678b71cc29acb42da4bd24a7273ab9324a38e43a0fd4 WatchSource:0}: Error finding container d4a66a1642b68cf9494f678b71cc29acb42da4bd24a7273ab9324a38e43a0fd4: Status 404 returned error can't find the container with id d4a66a1642b68cf9494f678b71cc29acb42da4bd24a7273ab9324a38e43a0fd4
Sep 16 02:21:07.056921 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:07.056889    2565 generic.go:356] "Generic (PLEG): container finished" podID="2167a2d5-5649-4538-b2e7-55a713b3c794" containerID="d34beb7b5515a5bc11bbd22aababa426d3a0deb541b2599e8d04eff54bd52646" exitCode=0
Sep 16 02:21:07.057258 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:07.056964    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2167a2d5-5649-4538-b2e7-55a713b3c794","Type":"ContainerDied","Data":"d34beb7b5515a5bc11bbd22aababa426d3a0deb541b2599e8d04eff54bd52646"}
Sep 16 02:21:07.057258 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:07.057043    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2167a2d5-5649-4538-b2e7-55a713b3c794","Type":"ContainerStarted","Data":"d4a66a1642b68cf9494f678b71cc29acb42da4bd24a7273ab9324a38e43a0fd4"}
Sep 16 02:21:09.067840 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:09.067768    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2167a2d5-5649-4538-b2e7-55a713b3c794","Type":"ContainerStarted","Data":"9dade682117b6d85121b25e32618ba8337454ba2c96528c5b423cb19e85d7a9e"}
Sep 16 02:21:09.067840 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:09.067835    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2167a2d5-5649-4538-b2e7-55a713b3c794","Type":"ContainerStarted","Data":"7e5c4e0b1c4846c97e295d25f93cde024fda48feff64a0a5ba91fbb8cf920ead"}
Sep 16 02:21:09.068173 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:09.067861    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2167a2d5-5649-4538-b2e7-55a713b3c794","Type":"ContainerStarted","Data":"8b168eccaa993c5ad4f16688f91f5996d80bca51d4f70aa2ddf1b1d7fae26c68"}
Sep 16 02:21:09.068173 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:09.067886    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2167a2d5-5649-4538-b2e7-55a713b3c794","Type":"ContainerStarted","Data":"262a6b2e2d783b098eef793a9df46128e921391444be5f4881b2474deaa20bea"}
Sep 16 02:21:09.068173 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:09.067910    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2167a2d5-5649-4538-b2e7-55a713b3c794","Type":"ContainerStarted","Data":"2aab7c0d69932439c268b0c6588b45df11e88d78d54b8955b9124ed8ac0e5bdd"}
Sep 16 02:21:10.075861 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:10.075820    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2167a2d5-5649-4538-b2e7-55a713b3c794","Type":"ContainerStarted","Data":"13e899266251a5b027bc7454c1f1d9c101de194ab578cd5dadf34e26fced1371"}
Sep 16 02:21:10.099675 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:10.099619    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.853246275 podStartE2EDuration="5.099599249s" totalImagesPullingTime="2.230651179s" totalInitContainerRuntime="15.701795ms" isStatefulPod=false podCreationTimestamp="2026-09-16 02:21:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:21:10.097749778 +0000 UTC m=+148.148094270" watchObservedRunningTime="2026-09-16 02:21:10.099599249 +0000 UTC m=+148.149943743"
Sep 16 02:21:11.910847 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:11.910812    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:21:12.011544 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:12.011514    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:21:14.917572 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:14.917533    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-857964cff9-rrkm5"]
Sep 16 02:21:14.920124 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:14.920108    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-857964cff9-rrkm5"
Sep 16 02:21:14.929619 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:14.929588    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-857964cff9-rrkm5"]
Sep 16 02:21:14.969181 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:14.969156    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:21:15.030807 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:15.030776    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b8aba58-4742-47f5-9418-24bb303b3811-trusted-ca-bundle\") pod \"console-857964cff9-rrkm5\" (UID: \"7b8aba58-4742-47f5-9418-24bb303b3811\") " pod="openshift-console/console-857964cff9-rrkm5"
Sep 16 02:21:15.030973 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:15.030841    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7b8aba58-4742-47f5-9418-24bb303b3811-console-config\") pod \"console-857964cff9-rrkm5\" (UID: \"7b8aba58-4742-47f5-9418-24bb303b3811\") " pod="openshift-console/console-857964cff9-rrkm5"
Sep 16 02:21:15.030973 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:15.030870    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7b8aba58-4742-47f5-9418-24bb303b3811-console-oauth-config\") pod \"console-857964cff9-rrkm5\" (UID: \"7b8aba58-4742-47f5-9418-24bb303b3811\") " pod="openshift-console/console-857964cff9-rrkm5"
Sep 16 02:21:15.030973 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:15.030926    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7b8aba58-4742-47f5-9418-24bb303b3811-service-ca\") pod \"console-857964cff9-rrkm5\" (UID: \"7b8aba58-4742-47f5-9418-24bb303b3811\") " pod="openshift-console/console-857964cff9-rrkm5"
Sep 16 02:21:15.030973 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:15.030953    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w29vw\" (UniqueName: \"kubernetes.io/projected/7b8aba58-4742-47f5-9418-24bb303b3811-kube-api-access-w29vw\") pod \"console-857964cff9-rrkm5\" (UID: \"7b8aba58-4742-47f5-9418-24bb303b3811\") " pod="openshift-console/console-857964cff9-rrkm5"
Sep 16 02:21:15.031124 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:15.030985    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b8aba58-4742-47f5-9418-24bb303b3811-console-serving-cert\") pod \"console-857964cff9-rrkm5\" (UID: \"7b8aba58-4742-47f5-9418-24bb303b3811\") " pod="openshift-console/console-857964cff9-rrkm5"
Sep 16 02:21:15.031124 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:15.031000    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7b8aba58-4742-47f5-9418-24bb303b3811-oauth-serving-cert\") pod \"console-857964cff9-rrkm5\" (UID: \"7b8aba58-4742-47f5-9418-24bb303b3811\") " pod="openshift-console/console-857964cff9-rrkm5"
Sep 16 02:21:15.125507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:15.125472    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:21:15.131547 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:15.131520    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b8aba58-4742-47f5-9418-24bb303b3811-console-serving-cert\") pod \"console-857964cff9-rrkm5\" (UID: \"7b8aba58-4742-47f5-9418-24bb303b3811\") " pod="openshift-console/console-857964cff9-rrkm5"
Sep 16 02:21:15.131624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:15.131552    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7b8aba58-4742-47f5-9418-24bb303b3811-oauth-serving-cert\") pod \"console-857964cff9-rrkm5\" (UID: \"7b8aba58-4742-47f5-9418-24bb303b3811\") " pod="openshift-console/console-857964cff9-rrkm5"
Sep 16 02:21:15.131624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:15.131584    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b8aba58-4742-47f5-9418-24bb303b3811-trusted-ca-bundle\") pod \"console-857964cff9-rrkm5\" (UID: \"7b8aba58-4742-47f5-9418-24bb303b3811\") " pod="openshift-console/console-857964cff9-rrkm5"
Sep 16 02:21:15.131624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:15.131619    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7b8aba58-4742-47f5-9418-24bb303b3811-console-config\") pod \"console-857964cff9-rrkm5\" (UID: \"7b8aba58-4742-47f5-9418-24bb303b3811\") " pod="openshift-console/console-857964cff9-rrkm5"
Sep 16 02:21:15.131761 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:15.131639    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7b8aba58-4742-47f5-9418-24bb303b3811-console-oauth-config\") pod \"console-857964cff9-rrkm5\" (UID: \"7b8aba58-4742-47f5-9418-24bb303b3811\") " pod="openshift-console/console-857964cff9-rrkm5"
Sep 16 02:21:15.131761 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:15.131664    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7b8aba58-4742-47f5-9418-24bb303b3811-service-ca\") pod \"console-857964cff9-rrkm5\" (UID: \"7b8aba58-4742-47f5-9418-24bb303b3811\") " pod="openshift-console/console-857964cff9-rrkm5"
Sep 16 02:21:15.131761 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:15.131680    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w29vw\" (UniqueName: \"kubernetes.io/projected/7b8aba58-4742-47f5-9418-24bb303b3811-kube-api-access-w29vw\") pod \"console-857964cff9-rrkm5\" (UID: \"7b8aba58-4742-47f5-9418-24bb303b3811\") " pod="openshift-console/console-857964cff9-rrkm5"
Sep 16 02:21:15.132344 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:15.132316    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7b8aba58-4742-47f5-9418-24bb303b3811-oauth-serving-cert\") pod \"console-857964cff9-rrkm5\" (UID: \"7b8aba58-4742-47f5-9418-24bb303b3811\") " pod="openshift-console/console-857964cff9-rrkm5"
Sep 16 02:21:15.132344 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:15.132339    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7b8aba58-4742-47f5-9418-24bb303b3811-console-config\") pod \"console-857964cff9-rrkm5\" (UID: \"7b8aba58-4742-47f5-9418-24bb303b3811\") " pod="openshift-console/console-857964cff9-rrkm5"
Sep 16 02:21:15.132582 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:15.132561    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b8aba58-4742-47f5-9418-24bb303b3811-trusted-ca-bundle\") pod \"console-857964cff9-rrkm5\" (UID: \"7b8aba58-4742-47f5-9418-24bb303b3811\") " pod="openshift-console/console-857964cff9-rrkm5"
Sep 16 02:21:15.132679 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:15.132656    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7b8aba58-4742-47f5-9418-24bb303b3811-service-ca\") pod \"console-857964cff9-rrkm5\" (UID: \"7b8aba58-4742-47f5-9418-24bb303b3811\") " pod="openshift-console/console-857964cff9-rrkm5"
Sep 16 02:21:15.134217 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:15.134198    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7b8aba58-4742-47f5-9418-24bb303b3811-console-oauth-config\") pod \"console-857964cff9-rrkm5\" (UID: \"7b8aba58-4742-47f5-9418-24bb303b3811\") " pod="openshift-console/console-857964cff9-rrkm5"
Sep 16 02:21:15.134301 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:15.134242    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b8aba58-4742-47f5-9418-24bb303b3811-console-serving-cert\") pod \"console-857964cff9-rrkm5\" (UID: \"7b8aba58-4742-47f5-9418-24bb303b3811\") " pod="openshift-console/console-857964cff9-rrkm5"
Sep 16 02:21:15.138742 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:15.138721    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w29vw\" (UniqueName: \"kubernetes.io/projected/7b8aba58-4742-47f5-9418-24bb303b3811-kube-api-access-w29vw\") pod \"console-857964cff9-rrkm5\" (UID: \"7b8aba58-4742-47f5-9418-24bb303b3811\") " pod="openshift-console/console-857964cff9-rrkm5"
Sep 16 02:21:15.178019 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:15.177939    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:21:15.229218 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:15.229183    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-857964cff9-rrkm5"
Sep 16 02:21:15.497418 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:15.497396    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-857964cff9-rrkm5"]
Sep 16 02:21:15.499515 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:21:15.499481    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b8aba58_4742_47f5_9418_24bb303b3811.slice/crio-a1ffe7361ab520e7b3e77d0ab83dbf4d5109a67e4758e11ea8b4a1d17173851e WatchSource:0}: Error finding container a1ffe7361ab520e7b3e77d0ab83dbf4d5109a67e4758e11ea8b4a1d17173851e: Status 404 returned error can't find the container with id a1ffe7361ab520e7b3e77d0ab83dbf4d5109a67e4758e11ea8b4a1d17173851e
Sep 16 02:21:15.722997 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:15.722962    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:21:15.777601 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:15.777541    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:21:16.104447 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:16.104352    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-857964cff9-rrkm5" event={"ID":"7b8aba58-4742-47f5-9418-24bb303b3811","Type":"ContainerStarted","Data":"6fbd6866e61e53f9ae75793faf0fa93485e0af664609524be6e840a1469eb6e6"}
Sep 16 02:21:16.104794 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:16.104454    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-857964cff9-rrkm5" event={"ID":"7b8aba58-4742-47f5-9418-24bb303b3811","Type":"ContainerStarted","Data":"a1ffe7361ab520e7b3e77d0ab83dbf4d5109a67e4758e11ea8b4a1d17173851e"}
Sep 16 02:21:16.120562 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:16.120509    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-857964cff9-rrkm5" podStartSLOduration=2.120493669 podStartE2EDuration="2.120493669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:21:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:21:16.119088325 +0000 UTC m=+154.169432835" watchObservedRunningTime="2026-09-16 02:21:16.120493669 +0000 UTC m=+154.170838161"
Sep 16 02:21:16.639307 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:16.639275    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:21:21.940162 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:21.940119    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:21:22.041003 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:22.040968    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:21:25.229344 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:25.229304    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-857964cff9-rrkm5"
Sep 16 02:21:25.229745 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:25.229379    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-857964cff9-rrkm5"
Sep 16 02:21:25.233859 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:25.233835    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-857964cff9-rrkm5"
Sep 16 02:21:26.145219 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:26.145188    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-857964cff9-rrkm5"
Sep 16 02:21:26.183513 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:26.183478    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d88ff674d-vzrz2"]
Sep 16 02:21:26.268232 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:26.268203    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:21:26.369003 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:26.368973    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:21:26.419915 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:26.419889    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:21:43.350475 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:43.350440    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:21:45.550501 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:45.550429    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:21:50.876742 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:50.876710    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:21:50.973077 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:50.973042    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:21:51.203310 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.203274    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d88ff674d-vzrz2" podUID="86d33b9c-7de2-42fb-8c0a-bd8465f9acc2" containerName="console" containerID="cri-o://36491c16febc9a83833aab229e25c76bdb5f8b48030fbf57cefa601a55862bf7" gracePeriod=15
Sep 16 02:21:51.444114 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.444093    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d88ff674d-vzrz2"
Sep 16 02:21:51.493184 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.493119    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kj6rf\" (UniqueName: \"kubernetes.io/projected/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-kube-api-access-kj6rf\") pod \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\" (UID: \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\") "
Sep 16 02:21:51.493184 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.493152    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-console-oauth-config\") pod \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\" (UID: \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\") "
Sep 16 02:21:51.493383 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.493194    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-service-ca\") pod \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\" (UID: \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\") "
Sep 16 02:21:51.493383 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.493291    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-trusted-ca-bundle\") pod \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\" (UID: \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\") "
Sep 16 02:21:51.493383 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.493330    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-oauth-serving-cert\") pod \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\" (UID: \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\") "
Sep 16 02:21:51.493383 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.493377    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-console-config\") pod \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\" (UID: \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\") "
Sep 16 02:21:51.493587 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.493412    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-console-serving-cert\") pod \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\" (UID: \"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2\") "
Sep 16 02:21:51.493720 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.493680    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-service-ca" (OuterVolumeSpecName: "service-ca") pod "86d33b9c-7de2-42fb-8c0a-bd8465f9acc2" (UID: "86d33b9c-7de2-42fb-8c0a-bd8465f9acc2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:21:51.493720 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.493692    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "86d33b9c-7de2-42fb-8c0a-bd8465f9acc2" (UID: "86d33b9c-7de2-42fb-8c0a-bd8465f9acc2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:21:51.493720 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.493710    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "86d33b9c-7de2-42fb-8c0a-bd8465f9acc2" (UID: "86d33b9c-7de2-42fb-8c0a-bd8465f9acc2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:21:51.493943 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.493803    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-console-config" (OuterVolumeSpecName: "console-config") pod "86d33b9c-7de2-42fb-8c0a-bd8465f9acc2" (UID: "86d33b9c-7de2-42fb-8c0a-bd8465f9acc2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:21:51.495259 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.495241    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-kube-api-access-kj6rf" (OuterVolumeSpecName: "kube-api-access-kj6rf") pod "86d33b9c-7de2-42fb-8c0a-bd8465f9acc2" (UID: "86d33b9c-7de2-42fb-8c0a-bd8465f9acc2"). InnerVolumeSpecName "kube-api-access-kj6rf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:21:51.495467 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.495443    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "86d33b9c-7de2-42fb-8c0a-bd8465f9acc2" (UID: "86d33b9c-7de2-42fb-8c0a-bd8465f9acc2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:21:51.495586 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.495568    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "86d33b9c-7de2-42fb-8c0a-bd8465f9acc2" (UID: "86d33b9c-7de2-42fb-8c0a-bd8465f9acc2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:21:51.521835 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.521800    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2"]
Sep 16 02:21:51.522070 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.522059    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86d33b9c-7de2-42fb-8c0a-bd8465f9acc2" containerName="console"
Sep 16 02:21:51.522113 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.522072    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="86d33b9c-7de2-42fb-8c0a-bd8465f9acc2" containerName="console"
Sep 16 02:21:51.522149 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.522129    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="86d33b9c-7de2-42fb-8c0a-bd8465f9acc2" containerName="console"
Sep 16 02:21:51.525330 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.525316    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2"
Sep 16 02:21:51.528348 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.528331    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bpxgl\""
Sep 16 02:21:51.528422 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.528387    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 02:21:51.528469 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.528427    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 02:21:51.531975 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.531953    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2"]
Sep 16 02:21:51.594177 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.594141    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94dfe37a-665b-4828-ab0e-a6e083bee016-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2\" (UID: \"94dfe37a-665b-4828-ab0e-a6e083bee016\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2"
Sep 16 02:21:51.594177 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.594179    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc2fn\" (UniqueName: \"kubernetes.io/projected/94dfe37a-665b-4828-ab0e-a6e083bee016-kube-api-access-dc2fn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2\" (UID: \"94dfe37a-665b-4828-ab0e-a6e083bee016\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2"
Sep 16 02:21:51.594402 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.594199    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94dfe37a-665b-4828-ab0e-a6e083bee016-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2\" (UID: \"94dfe37a-665b-4828-ab0e-a6e083bee016\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2"
Sep 16 02:21:51.594402 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.594251    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kj6rf\" (UniqueName: \"kubernetes.io/projected/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-kube-api-access-kj6rf\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:21:51.594402 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.594262    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-console-oauth-config\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:21:51.594402 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.594271    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:21:51.594402 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.594280    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-trusted-ca-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:21:51.594402 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.594321    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-oauth-serving-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:21:51.594402 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.594340    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-console-config\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:21:51.594402 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.594352    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2-console-serving-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:21:51.695247 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.695214    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94dfe37a-665b-4828-ab0e-a6e083bee016-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2\" (UID: \"94dfe37a-665b-4828-ab0e-a6e083bee016\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2"
Sep 16 02:21:51.695385 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.695255    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc2fn\" (UniqueName: \"kubernetes.io/projected/94dfe37a-665b-4828-ab0e-a6e083bee016-kube-api-access-dc2fn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2\" (UID: \"94dfe37a-665b-4828-ab0e-a6e083bee016\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2"
Sep 16 02:21:51.695385 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.695275    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94dfe37a-665b-4828-ab0e-a6e083bee016-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2\" (UID: \"94dfe37a-665b-4828-ab0e-a6e083bee016\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2"
Sep 16 02:21:51.695656 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.695636    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94dfe37a-665b-4828-ab0e-a6e083bee016-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2\" (UID: \"94dfe37a-665b-4828-ab0e-a6e083bee016\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2"
Sep 16 02:21:51.695714 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.695657    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94dfe37a-665b-4828-ab0e-a6e083bee016-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2\" (UID: \"94dfe37a-665b-4828-ab0e-a6e083bee016\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2"
Sep 16 02:21:51.703216 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.703196    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc2fn\" (UniqueName: \"kubernetes.io/projected/94dfe37a-665b-4828-ab0e-a6e083bee016-kube-api-access-dc2fn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2\" (UID: \"94dfe37a-665b-4828-ab0e-a6e083bee016\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2"
Sep 16 02:21:51.834940 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:51.834872    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2"
Sep 16 02:21:52.099672 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:52.099476    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2"]
Sep 16 02:21:52.102201 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:21:52.102171    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94dfe37a_665b_4828_ab0e_a6e083bee016.slice/crio-72b48ce99dfb3115edab28b7aadf10c3b98174ead36f97572d3d765848afca17 WatchSource:0}: Error finding container 72b48ce99dfb3115edab28b7aadf10c3b98174ead36f97572d3d765848afca17: Status 404 returned error can't find the container with id 72b48ce99dfb3115edab28b7aadf10c3b98174ead36f97572d3d765848afca17
Sep 16 02:21:52.241583 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:52.241555    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2" event={"ID":"94dfe37a-665b-4828-ab0e-a6e083bee016","Type":"ContainerStarted","Data":"72b48ce99dfb3115edab28b7aadf10c3b98174ead36f97572d3d765848afca17"}
Sep 16 02:21:52.242780 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:52.242759    2565 generic.go:356] "Generic (PLEG): container finished" podID="86d33b9c-7de2-42fb-8c0a-bd8465f9acc2" containerID="36491c16febc9a83833aab229e25c76bdb5f8b48030fbf57cefa601a55862bf7" exitCode=0
Sep 16 02:21:52.242858 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:52.242788    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d88ff674d-vzrz2" event={"ID":"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2","Type":"ContainerDied","Data":"36491c16febc9a83833aab229e25c76bdb5f8b48030fbf57cefa601a55862bf7"}
Sep 16 02:21:52.242858 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:52.242817    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d88ff674d-vzrz2" event={"ID":"86d33b9c-7de2-42fb-8c0a-bd8465f9acc2","Type":"ContainerDied","Data":"c8b062dec45d27ecab331679a0364434bf2283d27cc94a05ff2422a50e6fcc6c"}
Sep 16 02:21:52.242858 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:52.242817    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d88ff674d-vzrz2"
Sep 16 02:21:52.243371 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:52.242838    2565 scope.go:117] "RemoveContainer" containerID="36491c16febc9a83833aab229e25c76bdb5f8b48030fbf57cefa601a55862bf7"
Sep 16 02:21:52.251676 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:52.251656    2565 scope.go:117] "RemoveContainer" containerID="36491c16febc9a83833aab229e25c76bdb5f8b48030fbf57cefa601a55862bf7"
Sep 16 02:21:52.251914 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:21:52.251894    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36491c16febc9a83833aab229e25c76bdb5f8b48030fbf57cefa601a55862bf7\": container with ID starting with 36491c16febc9a83833aab229e25c76bdb5f8b48030fbf57cefa601a55862bf7 not found: ID does not exist" containerID="36491c16febc9a83833aab229e25c76bdb5f8b48030fbf57cefa601a55862bf7"
Sep 16 02:21:52.251977 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:52.251926    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36491c16febc9a83833aab229e25c76bdb5f8b48030fbf57cefa601a55862bf7"} err="failed to get container status \"36491c16febc9a83833aab229e25c76bdb5f8b48030fbf57cefa601a55862bf7\": rpc error: code = NotFound desc = could not find container \"36491c16febc9a83833aab229e25c76bdb5f8b48030fbf57cefa601a55862bf7\": container with ID starting with 36491c16febc9a83833aab229e25c76bdb5f8b48030fbf57cefa601a55862bf7 not found: ID does not exist"
Sep 16 02:21:52.263010 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:52.262989    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d88ff674d-vzrz2"]
Sep 16 02:21:52.268285 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:52.268267    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d88ff674d-vzrz2"]
Sep 16 02:21:52.388901 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:21:52.388834    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86d33b9c-7de2-42fb-8c0a-bd8465f9acc2" path="/var/lib/kubelet/pods/86d33b9c-7de2-42fb-8c0a-bd8465f9acc2/volumes"
Sep 16 02:22:00.278460 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:00.278376    2565 generic.go:356] "Generic (PLEG): container finished" podID="94dfe37a-665b-4828-ab0e-a6e083bee016" containerID="4a5c494d656fd8e238df8aaab4523ec1930d0ca0fe41044a6929ea4d443b0c8f" exitCode=0
Sep 16 02:22:00.278460 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:00.278412    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2" event={"ID":"94dfe37a-665b-4828-ab0e-a6e083bee016","Type":"ContainerDied","Data":"4a5c494d656fd8e238df8aaab4523ec1930d0ca0fe41044a6929ea4d443b0c8f"}
Sep 16 02:22:04.003224 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:04.003181    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:22:04.051617 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:04.051572    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:22:09.318590 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:09.318548    2565 generic.go:356] "Generic (PLEG): container finished" podID="94dfe37a-665b-4828-ab0e-a6e083bee016" containerID="d3996b203cb7eebb9d1674e4062c31642caed63e07bd121d74ba835138c25354" exitCode=0
Sep 16 02:22:09.318982 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:09.318634    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2" event={"ID":"94dfe37a-665b-4828-ab0e-a6e083bee016","Type":"ContainerDied","Data":"d3996b203cb7eebb9d1674e4062c31642caed63e07bd121d74ba835138c25354"}
Sep 16 02:22:17.351979 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:17.351947    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2" event={"ID":"94dfe37a-665b-4828-ab0e-a6e083bee016","Type":"ContainerStarted","Data":"7910528919dae61d4ee45ae08726bc88672425c17e129b9bc00809415ad260ee"}
Sep 16 02:22:17.367765 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:17.367709    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2" podStartSLOduration=2.741809794 podStartE2EDuration="26.367688975s" totalImagesPullingTime="23.625879181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:21:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:22:17.366709187 +0000 UTC m=+215.417053679" watchObservedRunningTime="2026-09-16 02:22:17.367688975 +0000 UTC m=+215.418033469"
Sep 16 02:22:18.358611 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:18.358576    2565 generic.go:356] "Generic (PLEG): container finished" podID="94dfe37a-665b-4828-ab0e-a6e083bee016" containerID="7910528919dae61d4ee45ae08726bc88672425c17e129b9bc00809415ad260ee" exitCode=0
Sep 16 02:22:18.358993 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:18.358670    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2" event={"ID":"94dfe37a-665b-4828-ab0e-a6e083bee016","Type":"ContainerDied","Data":"7910528919dae61d4ee45ae08726bc88672425c17e129b9bc00809415ad260ee"}
Sep 16 02:22:19.480726 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:19.480702    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2"
Sep 16 02:22:19.610713 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:19.610688    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94dfe37a-665b-4828-ab0e-a6e083bee016-bundle\") pod \"94dfe37a-665b-4828-ab0e-a6e083bee016\" (UID: \"94dfe37a-665b-4828-ab0e-a6e083bee016\") "
Sep 16 02:22:19.610847 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:19.610721    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94dfe37a-665b-4828-ab0e-a6e083bee016-util\") pod \"94dfe37a-665b-4828-ab0e-a6e083bee016\" (UID: \"94dfe37a-665b-4828-ab0e-a6e083bee016\") "
Sep 16 02:22:19.610847 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:19.610749    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dc2fn\" (UniqueName: \"kubernetes.io/projected/94dfe37a-665b-4828-ab0e-a6e083bee016-kube-api-access-dc2fn\") pod \"94dfe37a-665b-4828-ab0e-a6e083bee016\" (UID: \"94dfe37a-665b-4828-ab0e-a6e083bee016\") "
Sep 16 02:22:19.611335 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:19.611307    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94dfe37a-665b-4828-ab0e-a6e083bee016-bundle" (OuterVolumeSpecName: "bundle") pod "94dfe37a-665b-4828-ab0e-a6e083bee016" (UID: "94dfe37a-665b-4828-ab0e-a6e083bee016"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:22:19.613030 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:19.612997    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94dfe37a-665b-4828-ab0e-a6e083bee016-kube-api-access-dc2fn" (OuterVolumeSpecName: "kube-api-access-dc2fn") pod "94dfe37a-665b-4828-ab0e-a6e083bee016" (UID: "94dfe37a-665b-4828-ab0e-a6e083bee016"). InnerVolumeSpecName "kube-api-access-dc2fn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:22:19.618965 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:19.618935    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94dfe37a-665b-4828-ab0e-a6e083bee016-util" (OuterVolumeSpecName: "util") pod "94dfe37a-665b-4828-ab0e-a6e083bee016" (UID: "94dfe37a-665b-4828-ab0e-a6e083bee016"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:22:19.711903 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:19.711870    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94dfe37a-665b-4828-ab0e-a6e083bee016-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:22:19.711903 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:19.711902    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94dfe37a-665b-4828-ab0e-a6e083bee016-util\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:22:19.711903 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:19.711911    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dc2fn\" (UniqueName: \"kubernetes.io/projected/94dfe37a-665b-4828-ab0e-a6e083bee016-kube-api-access-dc2fn\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:22:20.373151 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:20.373071    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2"
Sep 16 02:22:20.373305 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:20.373066    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tntp2" event={"ID":"94dfe37a-665b-4828-ab0e-a6e083bee016","Type":"ContainerDied","Data":"72b48ce99dfb3115edab28b7aadf10c3b98174ead36f97572d3d765848afca17"}
Sep 16 02:22:20.373305 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:20.373217    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="72b48ce99dfb3115edab28b7aadf10c3b98174ead36f97572d3d765848afca17"
Sep 16 02:22:22.555784 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:22.555750    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:22:23.376048 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:23.376017    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:22:24.493580 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:24.493547    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5vvq2"]
Sep 16 02:22:24.493955 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:24.493811    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94dfe37a-665b-4828-ab0e-a6e083bee016" containerName="pull"
Sep 16 02:22:24.493955 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:24.493822    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="94dfe37a-665b-4828-ab0e-a6e083bee016" containerName="pull"
Sep 16 02:22:24.493955 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:24.493837    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94dfe37a-665b-4828-ab0e-a6e083bee016" containerName="extract"
Sep 16 02:22:24.493955 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:24.493843    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="94dfe37a-665b-4828-ab0e-a6e083bee016" containerName="extract"
Sep 16 02:22:24.493955 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:24.493851    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94dfe37a-665b-4828-ab0e-a6e083bee016" containerName="util"
Sep 16 02:22:24.493955 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:24.493855    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="94dfe37a-665b-4828-ab0e-a6e083bee016" containerName="util"
Sep 16 02:22:24.493955 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:24.493897    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="94dfe37a-665b-4828-ab0e-a6e083bee016" containerName="extract"
Sep 16 02:22:24.495685 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:24.495668    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5vvq2"
Sep 16 02:22:24.498229 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:24.498204    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 16 02:22:24.498335 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:24.498206    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-k2zbz\""
Sep 16 02:22:24.498335 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:24.498245    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 16 02:22:24.508277 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:24.508257    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5vvq2"]
Sep 16 02:22:24.649648 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:24.649615    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6aea483c-e456-4d19-8439-521c3d0ebfc4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5vvq2\" (UID: \"6aea483c-e456-4d19-8439-521c3d0ebfc4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5vvq2"
Sep 16 02:22:24.649796 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:24.649674    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjhxj\" (UniqueName: \"kubernetes.io/projected/6aea483c-e456-4d19-8439-521c3d0ebfc4-kube-api-access-fjhxj\") pod \"cert-manager-operator-controller-manager-55c444bf86-5vvq2\" (UID: \"6aea483c-e456-4d19-8439-521c3d0ebfc4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5vvq2"
Sep 16 02:22:24.750941 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:24.750861    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6aea483c-e456-4d19-8439-521c3d0ebfc4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5vvq2\" (UID: \"6aea483c-e456-4d19-8439-521c3d0ebfc4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5vvq2"
Sep 16 02:22:24.750941 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:24.750934    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjhxj\" (UniqueName: \"kubernetes.io/projected/6aea483c-e456-4d19-8439-521c3d0ebfc4-kube-api-access-fjhxj\") pod \"cert-manager-operator-controller-manager-55c444bf86-5vvq2\" (UID: \"6aea483c-e456-4d19-8439-521c3d0ebfc4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5vvq2"
Sep 16 02:22:24.751231 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:24.751207    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6aea483c-e456-4d19-8439-521c3d0ebfc4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5vvq2\" (UID: \"6aea483c-e456-4d19-8439-521c3d0ebfc4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5vvq2"
Sep 16 02:22:24.759256 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:24.759228    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjhxj\" (UniqueName: \"kubernetes.io/projected/6aea483c-e456-4d19-8439-521c3d0ebfc4-kube-api-access-fjhxj\") pod \"cert-manager-operator-controller-manager-55c444bf86-5vvq2\" (UID: \"6aea483c-e456-4d19-8439-521c3d0ebfc4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5vvq2"
Sep 16 02:22:24.805202 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:24.805178    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5vvq2"
Sep 16 02:22:25.075277 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:25.075248    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5vvq2"]
Sep 16 02:22:25.078203 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:22:25.078179    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aea483c_e456_4d19_8439_521c3d0ebfc4.slice/crio-ae6d743d238238ae619931a61bb04741c87c4cca6be27bf25fd41a171d3e3138 WatchSource:0}: Error finding container ae6d743d238238ae619931a61bb04741c87c4cca6be27bf25fd41a171d3e3138: Status 404 returned error can't find the container with id ae6d743d238238ae619931a61bb04741c87c4cca6be27bf25fd41a171d3e3138
Sep 16 02:22:25.394267 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:25.394183    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5vvq2" event={"ID":"6aea483c-e456-4d19-8439-521c3d0ebfc4","Type":"ContainerStarted","Data":"ae6d743d238238ae619931a61bb04741c87c4cca6be27bf25fd41a171d3e3138"}
Sep 16 02:22:26.175839 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:26.175802    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:22:26.276988 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:26.276950    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:22:27.404791 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:27.404736    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5vvq2" event={"ID":"6aea483c-e456-4d19-8439-521c3d0ebfc4","Type":"ContainerStarted","Data":"067959698be4db3d78c62a12b81a662ff5790f9e1e3e2b66b5894956ba7db79f"}
Sep 16 02:22:27.425352 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:27.425302    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5vvq2" podStartSLOduration=1.625465991 podStartE2EDuration="3.425287808s" totalImagesPullingTime="1.799821817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:22:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:22:27.423689899 +0000 UTC m=+225.474034403" watchObservedRunningTime="2026-09-16 02:22:27.425287808 +0000 UTC m=+225.475632301"
Sep 16 02:22:27.566670 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:27.566638    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:22:27.660591 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:27.660514    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:22:27.678234 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:27.678208    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lcq7c"]
Sep 16 02:22:27.680547 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:27.680528    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lcq7c"
Sep 16 02:22:27.682970 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:27.682951    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 16 02:22:27.683078 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:27.682953    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 16 02:22:27.695461 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:27.695441    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lcq7c"]
Sep 16 02:22:27.776131 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:27.776100    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a15a83d-8671-4999-a050-7790490ad435-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lcq7c\" (UID: \"4a15a83d-8671-4999-a050-7790490ad435\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lcq7c"
Sep 16 02:22:27.776131 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:27.776134    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2gms\" (UniqueName: \"kubernetes.io/projected/4a15a83d-8671-4999-a050-7790490ad435-kube-api-access-q2gms\") pod \"cert-manager-webhook-6486ffd997-lcq7c\" (UID: \"4a15a83d-8671-4999-a050-7790490ad435\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lcq7c"
Sep 16 02:22:27.814791 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:27.814764    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:22:27.877075 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:27.877044    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a15a83d-8671-4999-a050-7790490ad435-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lcq7c\" (UID: \"4a15a83d-8671-4999-a050-7790490ad435\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lcq7c"
Sep 16 02:22:27.877204 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:27.877076    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2gms\" (UniqueName: \"kubernetes.io/projected/4a15a83d-8671-4999-a050-7790490ad435-kube-api-access-q2gms\") pod \"cert-manager-webhook-6486ffd997-lcq7c\" (UID: \"4a15a83d-8671-4999-a050-7790490ad435\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lcq7c"
Sep 16 02:22:27.899533 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:27.899506    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a15a83d-8671-4999-a050-7790490ad435-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lcq7c\" (UID: \"4a15a83d-8671-4999-a050-7790490ad435\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lcq7c"
Sep 16 02:22:27.899650 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:27.899570    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2gms\" (UniqueName: \"kubernetes.io/projected/4a15a83d-8671-4999-a050-7790490ad435-kube-api-access-q2gms\") pod \"cert-manager-webhook-6486ffd997-lcq7c\" (UID: \"4a15a83d-8671-4999-a050-7790490ad435\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lcq7c"
Sep 16 02:22:27.917385 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:27.917314    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:22:28.007603 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:28.007560    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lcq7c"
Sep 16 02:22:28.274566 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:28.274543    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lcq7c"]
Sep 16 02:22:28.276943 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:22:28.276914    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a15a83d_8671_4999_a050_7790490ad435.slice/crio-adf54697a3b914d9571f3ddd69bb6eec004646d18505cb53b574d030306b01bb WatchSource:0}: Error finding container adf54697a3b914d9571f3ddd69bb6eec004646d18505cb53b574d030306b01bb: Status 404 returned error can't find the container with id adf54697a3b914d9571f3ddd69bb6eec004646d18505cb53b574d030306b01bb
Sep 16 02:22:28.409095 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:28.409066    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lcq7c" event={"ID":"4a15a83d-8671-4999-a050-7790490ad435","Type":"ContainerStarted","Data":"adf54697a3b914d9571f3ddd69bb6eec004646d18505cb53b574d030306b01bb"}
Sep 16 02:22:28.596906 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:28.596832    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5n55"]
Sep 16 02:22:28.599650 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:28.599635    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5n55"
Sep 16 02:22:28.601781 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:28.601759    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 02:22:28.602632 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:28.602615    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 02:22:28.602708 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:28.602674    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bpxgl\""
Sep 16 02:22:28.607086 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:28.607066    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5n55"]
Sep 16 02:22:28.685228 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:28.685201    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0dddcdec-3592-4617-97a0-dc0b72baaac7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5n55\" (UID: \"0dddcdec-3592-4617-97a0-dc0b72baaac7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5n55"
Sep 16 02:22:28.685342 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:28.685249    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0dddcdec-3592-4617-97a0-dc0b72baaac7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5n55\" (UID: \"0dddcdec-3592-4617-97a0-dc0b72baaac7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5n55"
Sep 16 02:22:28.685342 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:28.685298    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t6g9\" (UniqueName: \"kubernetes.io/projected/0dddcdec-3592-4617-97a0-dc0b72baaac7-kube-api-access-8t6g9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5n55\" (UID: \"0dddcdec-3592-4617-97a0-dc0b72baaac7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5n55"
Sep 16 02:22:28.785635 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:28.785612    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0dddcdec-3592-4617-97a0-dc0b72baaac7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5n55\" (UID: \"0dddcdec-3592-4617-97a0-dc0b72baaac7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5n55"
Sep 16 02:22:28.785785 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:28.785655    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0dddcdec-3592-4617-97a0-dc0b72baaac7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5n55\" (UID: \"0dddcdec-3592-4617-97a0-dc0b72baaac7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5n55"
Sep 16 02:22:28.785785 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:28.785678    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t6g9\" (UniqueName: \"kubernetes.io/projected/0dddcdec-3592-4617-97a0-dc0b72baaac7-kube-api-access-8t6g9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5n55\" (UID: \"0dddcdec-3592-4617-97a0-dc0b72baaac7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5n55"
Sep 16 02:22:28.786041 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:28.786021    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0dddcdec-3592-4617-97a0-dc0b72baaac7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5n55\" (UID: \"0dddcdec-3592-4617-97a0-dc0b72baaac7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5n55"
Sep 16 02:22:28.786100 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:28.786039    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0dddcdec-3592-4617-97a0-dc0b72baaac7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5n55\" (UID: \"0dddcdec-3592-4617-97a0-dc0b72baaac7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5n55"
Sep 16 02:22:28.799176 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:28.799155    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t6g9\" (UniqueName: \"kubernetes.io/projected/0dddcdec-3592-4617-97a0-dc0b72baaac7-kube-api-access-8t6g9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5n55\" (UID: \"0dddcdec-3592-4617-97a0-dc0b72baaac7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5n55"
Sep 16 02:22:28.909250 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:28.909229    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5n55"
Sep 16 02:22:29.172546 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:29.172273    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5n55"]
Sep 16 02:22:29.174857 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:22:29.174825    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dddcdec_3592_4617_97a0_dc0b72baaac7.slice/crio-9e85ffcebb051fc3d4d230eead5113365f093b88634bcb341a09ba7a90d32de2 WatchSource:0}: Error finding container 9e85ffcebb051fc3d4d230eead5113365f093b88634bcb341a09ba7a90d32de2: Status 404 returned error can't find the container with id 9e85ffcebb051fc3d4d230eead5113365f093b88634bcb341a09ba7a90d32de2
Sep 16 02:22:29.415548 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:29.415513    2565 generic.go:356] "Generic (PLEG): container finished" podID="0dddcdec-3592-4617-97a0-dc0b72baaac7" containerID="08e63a7cbdaac0fad2173ead344c3325c221272dd8e2f3b9c80ac5b4ec77526a" exitCode=0
Sep 16 02:22:29.415978 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:29.415560    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5n55" event={"ID":"0dddcdec-3592-4617-97a0-dc0b72baaac7","Type":"ContainerDied","Data":"08e63a7cbdaac0fad2173ead344c3325c221272dd8e2f3b9c80ac5b4ec77526a"}
Sep 16 02:22:29.415978 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:29.415604    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5n55" event={"ID":"0dddcdec-3592-4617-97a0-dc0b72baaac7","Type":"ContainerStarted","Data":"9e85ffcebb051fc3d4d230eead5113365f093b88634bcb341a09ba7a90d32de2"}
Sep 16 02:22:29.566150 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:29.566076    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:22:29.954699 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:29.954667    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:22:32.432133 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:32.432097    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5n55" event={"ID":"0dddcdec-3592-4617-97a0-dc0b72baaac7","Type":"ContainerStarted","Data":"2b201894c3d4efcf0583e6b8275689d36e136740cb64ce17ef8d2f9847cb198a"}
Sep 16 02:22:32.433660 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:32.433627    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lcq7c" event={"ID":"4a15a83d-8671-4999-a050-7790490ad435","Type":"ContainerStarted","Data":"4d94f822643da7e4e2d6aab4a30438666dee1b5d3576fce248b06f5c5a7e728d"}
Sep 16 02:22:32.433789 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:32.433772    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lcq7c"
Sep 16 02:22:32.460919 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:32.460874    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-lcq7c" podStartSLOduration=1.460542098 podStartE2EDuration="5.460860072s" totalImagesPullingTime="4.000317974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:22:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:22:32.459730111 +0000 UTC m=+230.510074604" watchObservedRunningTime="2026-09-16 02:22:32.460860072 +0000 UTC m=+230.511204565"
Sep 16 02:22:32.967622 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:32.967558    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:22:33.022569 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:33.022539    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:22:33.439580 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:33.439551    2565 generic.go:356] "Generic (PLEG): container finished" podID="0dddcdec-3592-4617-97a0-dc0b72baaac7" containerID="2b201894c3d4efcf0583e6b8275689d36e136740cb64ce17ef8d2f9847cb198a" exitCode=0
Sep 16 02:22:33.439932 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:33.439638    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5n55" event={"ID":"0dddcdec-3592-4617-97a0-dc0b72baaac7","Type":"ContainerDied","Data":"2b201894c3d4efcf0583e6b8275689d36e136740cb64ce17ef8d2f9847cb198a"}
Sep 16 02:22:34.445580 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:34.445551    2565 generic.go:356] "Generic (PLEG): container finished" podID="0dddcdec-3592-4617-97a0-dc0b72baaac7" containerID="8d883b062bfcbed9ded1e16dbc6d777a1c7e9897d5135cc8b3d921e9fd47f886" exitCode=0
Sep 16 02:22:34.445957 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:34.445591    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5n55" event={"ID":"0dddcdec-3592-4617-97a0-dc0b72baaac7","Type":"ContainerDied","Data":"8d883b062bfcbed9ded1e16dbc6d777a1c7e9897d5135cc8b3d921e9fd47f886"}
Sep 16 02:22:35.039720 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:35.039685    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:22:35.089553 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:35.089524    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:22:35.567733 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:35.567711    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5n55"
Sep 16 02:22:35.639630 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:35.639604    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0dddcdec-3592-4617-97a0-dc0b72baaac7-util\") pod \"0dddcdec-3592-4617-97a0-dc0b72baaac7\" (UID: \"0dddcdec-3592-4617-97a0-dc0b72baaac7\") "
Sep 16 02:22:35.639756 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:35.639636    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8t6g9\" (UniqueName: \"kubernetes.io/projected/0dddcdec-3592-4617-97a0-dc0b72baaac7-kube-api-access-8t6g9\") pod \"0dddcdec-3592-4617-97a0-dc0b72baaac7\" (UID: \"0dddcdec-3592-4617-97a0-dc0b72baaac7\") "
Sep 16 02:22:35.639756 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:35.639683    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0dddcdec-3592-4617-97a0-dc0b72baaac7-bundle\") pod \"0dddcdec-3592-4617-97a0-dc0b72baaac7\" (UID: \"0dddcdec-3592-4617-97a0-dc0b72baaac7\") "
Sep 16 02:22:35.640107 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:35.640081    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dddcdec-3592-4617-97a0-dc0b72baaac7-bundle" (OuterVolumeSpecName: "bundle") pod "0dddcdec-3592-4617-97a0-dc0b72baaac7" (UID: "0dddcdec-3592-4617-97a0-dc0b72baaac7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:22:35.641728 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:35.641698    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dddcdec-3592-4617-97a0-dc0b72baaac7-kube-api-access-8t6g9" (OuterVolumeSpecName: "kube-api-access-8t6g9") pod "0dddcdec-3592-4617-97a0-dc0b72baaac7" (UID: "0dddcdec-3592-4617-97a0-dc0b72baaac7"). InnerVolumeSpecName "kube-api-access-8t6g9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:22:35.644279 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:35.644257    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dddcdec-3592-4617-97a0-dc0b72baaac7-util" (OuterVolumeSpecName: "util") pod "0dddcdec-3592-4617-97a0-dc0b72baaac7" (UID: "0dddcdec-3592-4617-97a0-dc0b72baaac7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:22:35.740465 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:35.740406    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0dddcdec-3592-4617-97a0-dc0b72baaac7-util\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:22:35.740465 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:35.740436    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8t6g9\" (UniqueName: \"kubernetes.io/projected/0dddcdec-3592-4617-97a0-dc0b72baaac7-kube-api-access-8t6g9\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:22:35.740465 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:35.740447    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0dddcdec-3592-4617-97a0-dc0b72baaac7-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:22:36.456159 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:36.456129    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5n55" event={"ID":"0dddcdec-3592-4617-97a0-dc0b72baaac7","Type":"ContainerDied","Data":"9e85ffcebb051fc3d4d230eead5113365f093b88634bcb341a09ba7a90d32de2"}
Sep 16 02:22:36.456280 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:36.456164    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5n55"
Sep 16 02:22:36.456280 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:36.456171    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e85ffcebb051fc3d4d230eead5113365f093b88634bcb341a09ba7a90d32de2"
Sep 16 02:22:38.172291 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:38.172258    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:22:38.442095 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:38.442021    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lcq7c"
Sep 16 02:22:39.486586 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:39.486555    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-gkgt7"]
Sep 16 02:22:39.487038 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:39.486814    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dddcdec-3592-4617-97a0-dc0b72baaac7" containerName="util"
Sep 16 02:22:39.487038 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:39.486825    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dddcdec-3592-4617-97a0-dc0b72baaac7" containerName="util"
Sep 16 02:22:39.487038 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:39.486841    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dddcdec-3592-4617-97a0-dc0b72baaac7" containerName="extract"
Sep 16 02:22:39.487038 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:39.486847    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dddcdec-3592-4617-97a0-dc0b72baaac7" containerName="extract"
Sep 16 02:22:39.487038 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:39.486863    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dddcdec-3592-4617-97a0-dc0b72baaac7" containerName="pull"
Sep 16 02:22:39.487038 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:39.486868    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dddcdec-3592-4617-97a0-dc0b72baaac7" containerName="pull"
Sep 16 02:22:39.487038 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:39.486914    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dddcdec-3592-4617-97a0-dc0b72baaac7" containerName="extract"
Sep 16 02:22:39.490846 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:39.490828    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-gkgt7"
Sep 16 02:22:39.492937 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:39.492917    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-mph2b\""
Sep 16 02:22:39.499406 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:39.499383    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-gkgt7"]
Sep 16 02:22:39.564469 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:39.564450    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwr7c\" (UniqueName: \"kubernetes.io/projected/0d0788c3-9832-4a8d-835e-28fc1acb2ce5-kube-api-access-gwr7c\") pod \"cert-manager-55b4d954d5-gkgt7\" (UID: \"0d0788c3-9832-4a8d-835e-28fc1acb2ce5\") " pod="cert-manager/cert-manager-55b4d954d5-gkgt7"
Sep 16 02:22:39.564554 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:39.564479    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d0788c3-9832-4a8d-835e-28fc1acb2ce5-bound-sa-token\") pod \"cert-manager-55b4d954d5-gkgt7\" (UID: \"0d0788c3-9832-4a8d-835e-28fc1acb2ce5\") " pod="cert-manager/cert-manager-55b4d954d5-gkgt7"
Sep 16 02:22:39.665737 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:39.665711    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwr7c\" (UniqueName: \"kubernetes.io/projected/0d0788c3-9832-4a8d-835e-28fc1acb2ce5-kube-api-access-gwr7c\") pod \"cert-manager-55b4d954d5-gkgt7\" (UID: \"0d0788c3-9832-4a8d-835e-28fc1acb2ce5\") " pod="cert-manager/cert-manager-55b4d954d5-gkgt7"
Sep 16 02:22:39.665819 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:39.665746    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d0788c3-9832-4a8d-835e-28fc1acb2ce5-bound-sa-token\") pod \"cert-manager-55b4d954d5-gkgt7\" (UID: \"0d0788c3-9832-4a8d-835e-28fc1acb2ce5\") " pod="cert-manager/cert-manager-55b4d954d5-gkgt7"
Sep 16 02:22:39.672777 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:39.672755    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d0788c3-9832-4a8d-835e-28fc1acb2ce5-bound-sa-token\") pod \"cert-manager-55b4d954d5-gkgt7\" (UID: \"0d0788c3-9832-4a8d-835e-28fc1acb2ce5\") " pod="cert-manager/cert-manager-55b4d954d5-gkgt7"
Sep 16 02:22:39.673049 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:39.673030    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwr7c\" (UniqueName: \"kubernetes.io/projected/0d0788c3-9832-4a8d-835e-28fc1acb2ce5-kube-api-access-gwr7c\") pod \"cert-manager-55b4d954d5-gkgt7\" (UID: \"0d0788c3-9832-4a8d-835e-28fc1acb2ce5\") " pod="cert-manager/cert-manager-55b4d954d5-gkgt7"
Sep 16 02:22:39.799471 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:39.799405    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-gkgt7"
Sep 16 02:22:40.066265 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:40.066221    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-gkgt7"]
Sep 16 02:22:40.068510 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:22:40.068478    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d0788c3_9832_4a8d_835e_28fc1acb2ce5.slice/crio-42883fcb6288f51c3bd52ebd7436f60e0bf18f8d9f803cf6181f14b0c1005aa1 WatchSource:0}: Error finding container 42883fcb6288f51c3bd52ebd7436f60e0bf18f8d9f803cf6181f14b0c1005aa1: Status 404 returned error can't find the container with id 42883fcb6288f51c3bd52ebd7436f60e0bf18f8d9f803cf6181f14b0c1005aa1
Sep 16 02:22:40.473044 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:40.473009    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-gkgt7" event={"ID":"0d0788c3-9832-4a8d-835e-28fc1acb2ce5","Type":"ContainerStarted","Data":"2d250b8a1f7e4df8b15434ba1c48ab424d0439002dbec3f11b3359211e019129"}
Sep 16 02:22:40.473186 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:40.473051    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-gkgt7" event={"ID":"0d0788c3-9832-4a8d-835e-28fc1acb2ce5","Type":"ContainerStarted","Data":"42883fcb6288f51c3bd52ebd7436f60e0bf18f8d9f803cf6181f14b0c1005aa1"}
Sep 16 02:22:40.487640 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:40.487595    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-gkgt7" podStartSLOduration=1.4875802550000001 podStartE2EDuration="1.487580255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:22:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:22:40.486195658 +0000 UTC m=+238.536540150" watchObservedRunningTime="2026-09-16 02:22:40.487580255 +0000 UTC m=+238.537924748"
Sep 16 02:22:44.380001 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:44.379965    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:22:44.474501 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:44.474470    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:22:46.403870 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:46.403838    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7wdn2"]
Sep 16 02:22:46.458305 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:46.458275    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7wdn2"]
Sep 16 02:22:46.458455 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:46.458315    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7wdn2"
Sep 16 02:22:46.460983 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:46.460961    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 16 02:22:46.461099 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:46.461009    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 16 02:22:46.461737 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:46.461719    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-q8lxm\""
Sep 16 02:22:46.616287 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:46.616256    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8ca801a-6998-4bf0-850f-01e7d321f75b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7wdn2\" (UID: \"a8ca801a-6998-4bf0-850f-01e7d321f75b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7wdn2"
Sep 16 02:22:46.616442 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:46.616293    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k5ks\" (UniqueName: \"kubernetes.io/projected/a8ca801a-6998-4bf0-850f-01e7d321f75b-kube-api-access-9k5ks\") pod \"openshift-lws-operator-fd8ccff4c-7wdn2\" (UID: \"a8ca801a-6998-4bf0-850f-01e7d321f75b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7wdn2"
Sep 16 02:22:46.716663 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:46.716634    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k5ks\" (UniqueName: \"kubernetes.io/projected/a8ca801a-6998-4bf0-850f-01e7d321f75b-kube-api-access-9k5ks\") pod \"openshift-lws-operator-fd8ccff4c-7wdn2\" (UID: \"a8ca801a-6998-4bf0-850f-01e7d321f75b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7wdn2"
Sep 16 02:22:46.716755 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:46.716704    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8ca801a-6998-4bf0-850f-01e7d321f75b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7wdn2\" (UID: \"a8ca801a-6998-4bf0-850f-01e7d321f75b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7wdn2"
Sep 16 02:22:46.716983 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:46.716968    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8ca801a-6998-4bf0-850f-01e7d321f75b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7wdn2\" (UID: \"a8ca801a-6998-4bf0-850f-01e7d321f75b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7wdn2"
Sep 16 02:22:46.723690 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:46.723664    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k5ks\" (UniqueName: \"kubernetes.io/projected/a8ca801a-6998-4bf0-850f-01e7d321f75b-kube-api-access-9k5ks\") pod \"openshift-lws-operator-fd8ccff4c-7wdn2\" (UID: \"a8ca801a-6998-4bf0-850f-01e7d321f75b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7wdn2"
Sep 16 02:22:46.766529 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:46.766507    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7wdn2"
Sep 16 02:22:47.045297 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:47.045272    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7wdn2"]
Sep 16 02:22:47.047761 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:22:47.047720    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8ca801a_6998_4bf0_850f_01e7d321f75b.slice/crio-e8af5861ba8de6db2aefd7226b391544c204ea77d1b4c03083dcb41f3b0ae2b3 WatchSource:0}: Error finding container e8af5861ba8de6db2aefd7226b391544c204ea77d1b4c03083dcb41f3b0ae2b3: Status 404 returned error can't find the container with id e8af5861ba8de6db2aefd7226b391544c204ea77d1b4c03083dcb41f3b0ae2b3
Sep 16 02:22:47.505166 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:47.505135    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7wdn2" event={"ID":"a8ca801a-6998-4bf0-850f-01e7d321f75b","Type":"ContainerStarted","Data":"e8af5861ba8de6db2aefd7226b391544c204ea77d1b4c03083dcb41f3b0ae2b3"}
Sep 16 02:22:49.517000 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:49.516962    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7wdn2" event={"ID":"a8ca801a-6998-4bf0-850f-01e7d321f75b","Type":"ContainerStarted","Data":"c98e8440477cc7d51e7d0876d5929d34c5c4513c644cc209d4dc1f8750c1cf82"}
Sep 16 02:22:49.531626 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:49.531536    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7wdn2" podStartSLOduration=1.300272396 podStartE2EDuration="3.531516388s" totalImagesPullingTime="2.231243992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:22:49.529816622 +0000 UTC m=+247.580161116" watchObservedRunningTime="2026-09-16 02:22:49.531516388 +0000 UTC m=+247.581860883"
Sep 16 02:22:50.199714 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:50.199683    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:22:50.300745 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:50.300713    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:22:52.428711 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:52.428678    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:22:54.171214 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:54.171180    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nm9x"]
Sep 16 02:22:54.173337 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:54.173319    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nm9x"
Sep 16 02:22:54.175576 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:54.175556    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 02:22:54.176342 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:54.176325    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bpxgl\""
Sep 16 02:22:54.176342 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:54.176332    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 02:22:54.181428 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:54.181406    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nm9x"]
Sep 16 02:22:54.274771 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:54.274750    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkw6z\" (UniqueName: \"kubernetes.io/projected/9d0d2802-c083-4850-88d5-424d1cbf6ee9-kube-api-access-bkw6z\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nm9x\" (UID: \"9d0d2802-c083-4850-88d5-424d1cbf6ee9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nm9x"
Sep 16 02:22:54.274879 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:54.274814    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d0d2802-c083-4850-88d5-424d1cbf6ee9-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nm9x\" (UID: \"9d0d2802-c083-4850-88d5-424d1cbf6ee9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nm9x"
Sep 16 02:22:54.274879 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:54.274873    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d0d2802-c083-4850-88d5-424d1cbf6ee9-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nm9x\" (UID: \"9d0d2802-c083-4850-88d5-424d1cbf6ee9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nm9x"
Sep 16 02:22:54.375434 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:54.375411    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d0d2802-c083-4850-88d5-424d1cbf6ee9-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nm9x\" (UID: \"9d0d2802-c083-4850-88d5-424d1cbf6ee9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nm9x"
Sep 16 02:22:54.375554 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:54.375445    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d0d2802-c083-4850-88d5-424d1cbf6ee9-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nm9x\" (UID: \"9d0d2802-c083-4850-88d5-424d1cbf6ee9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nm9x"
Sep 16 02:22:54.375554 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:54.375477    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkw6z\" (UniqueName: \"kubernetes.io/projected/9d0d2802-c083-4850-88d5-424d1cbf6ee9-kube-api-access-bkw6z\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nm9x\" (UID: \"9d0d2802-c083-4850-88d5-424d1cbf6ee9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nm9x"
Sep 16 02:22:54.375835 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:54.375813    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d0d2802-c083-4850-88d5-424d1cbf6ee9-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nm9x\" (UID: \"9d0d2802-c083-4850-88d5-424d1cbf6ee9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nm9x"
Sep 16 02:22:54.375899 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:54.375821    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d0d2802-c083-4850-88d5-424d1cbf6ee9-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nm9x\" (UID: \"9d0d2802-c083-4850-88d5-424d1cbf6ee9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nm9x"
Sep 16 02:22:54.382899 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:54.382879    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkw6z\" (UniqueName: \"kubernetes.io/projected/9d0d2802-c083-4850-88d5-424d1cbf6ee9-kube-api-access-bkw6z\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nm9x\" (UID: \"9d0d2802-c083-4850-88d5-424d1cbf6ee9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nm9x"
Sep 16 02:22:54.483405 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:54.483344    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nm9x"
Sep 16 02:22:54.754136 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:54.754111    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nm9x"]
Sep 16 02:22:54.756298 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:22:54.756275    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d0d2802_c083_4850_88d5_424d1cbf6ee9.slice/crio-be880b4fe4576a243eea69ec1dcb3004860e9a7ec3a72a7d8381a0c53a5f2796 WatchSource:0}: Error finding container be880b4fe4576a243eea69ec1dcb3004860e9a7ec3a72a7d8381a0c53a5f2796: Status 404 returned error can't find the container with id be880b4fe4576a243eea69ec1dcb3004860e9a7ec3a72a7d8381a0c53a5f2796
Sep 16 02:22:55.543450 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:55.543416    2565 generic.go:356] "Generic (PLEG): container finished" podID="9d0d2802-c083-4850-88d5-424d1cbf6ee9" containerID="a05d10ca85ac5d2bab4b7b87cb3132edbc6e8814b867628fa59e360a0931303b" exitCode=0
Sep 16 02:22:55.543917 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:55.543464    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nm9x" event={"ID":"9d0d2802-c083-4850-88d5-424d1cbf6ee9","Type":"ContainerDied","Data":"a05d10ca85ac5d2bab4b7b87cb3132edbc6e8814b867628fa59e360a0931303b"}
Sep 16 02:22:55.543917 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:55.543507    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nm9x" event={"ID":"9d0d2802-c083-4850-88d5-424d1cbf6ee9","Type":"ContainerStarted","Data":"be880b4fe4576a243eea69ec1dcb3004860e9a7ec3a72a7d8381a0c53a5f2796"}
Sep 16 02:22:56.549225 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:56.549191    2565 generic.go:356] "Generic (PLEG): container finished" podID="9d0d2802-c083-4850-88d5-424d1cbf6ee9" containerID="3c669d381472136445d0525be1f35c251b4c6267aeb2b38814d96a2aaa1e3ef2" exitCode=0
Sep 16 02:22:56.549629 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:56.549240    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nm9x" event={"ID":"9d0d2802-c083-4850-88d5-424d1cbf6ee9","Type":"ContainerDied","Data":"3c669d381472136445d0525be1f35c251b4c6267aeb2b38814d96a2aaa1e3ef2"}
Sep 16 02:22:56.951863 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:56.951813    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:22:57.052475 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:57.052433    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:22:57.555277 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:57.555245    2565 generic.go:356] "Generic (PLEG): container finished" podID="9d0d2802-c083-4850-88d5-424d1cbf6ee9" containerID="4ba4d2f80a6f6e6906dd36daf6193e1eb32fa2a1da823ab2e0383eaec44d271a" exitCode=0
Sep 16 02:22:57.555724 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:57.555304    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nm9x" event={"ID":"9d0d2802-c083-4850-88d5-424d1cbf6ee9","Type":"ContainerDied","Data":"4ba4d2f80a6f6e6906dd36daf6193e1eb32fa2a1da823ab2e0383eaec44d271a"}
Sep 16 02:22:58.672766 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:58.672744    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nm9x"
Sep 16 02:22:58.812288 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:58.812221    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkw6z\" (UniqueName: \"kubernetes.io/projected/9d0d2802-c083-4850-88d5-424d1cbf6ee9-kube-api-access-bkw6z\") pod \"9d0d2802-c083-4850-88d5-424d1cbf6ee9\" (UID: \"9d0d2802-c083-4850-88d5-424d1cbf6ee9\") "
Sep 16 02:22:58.812288 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:58.812269    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d0d2802-c083-4850-88d5-424d1cbf6ee9-util\") pod \"9d0d2802-c083-4850-88d5-424d1cbf6ee9\" (UID: \"9d0d2802-c083-4850-88d5-424d1cbf6ee9\") "
Sep 16 02:22:58.812525 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:58.812298    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d0d2802-c083-4850-88d5-424d1cbf6ee9-bundle\") pod \"9d0d2802-c083-4850-88d5-424d1cbf6ee9\" (UID: \"9d0d2802-c083-4850-88d5-424d1cbf6ee9\") "
Sep 16 02:22:58.813015 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:58.812984    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d0d2802-c083-4850-88d5-424d1cbf6ee9-bundle" (OuterVolumeSpecName: "bundle") pod "9d0d2802-c083-4850-88d5-424d1cbf6ee9" (UID: "9d0d2802-c083-4850-88d5-424d1cbf6ee9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:22:58.814247 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:58.814214    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d0d2802-c083-4850-88d5-424d1cbf6ee9-kube-api-access-bkw6z" (OuterVolumeSpecName: "kube-api-access-bkw6z") pod "9d0d2802-c083-4850-88d5-424d1cbf6ee9" (UID: "9d0d2802-c083-4850-88d5-424d1cbf6ee9"). InnerVolumeSpecName "kube-api-access-bkw6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:22:58.817574 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:58.817541    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d0d2802-c083-4850-88d5-424d1cbf6ee9-util" (OuterVolumeSpecName: "util") pod "9d0d2802-c083-4850-88d5-424d1cbf6ee9" (UID: "9d0d2802-c083-4850-88d5-424d1cbf6ee9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:22:58.913592 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:58.913561    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkw6z\" (UniqueName: \"kubernetes.io/projected/9d0d2802-c083-4850-88d5-424d1cbf6ee9-kube-api-access-bkw6z\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:22:58.913592 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:58.913592    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d0d2802-c083-4850-88d5-424d1cbf6ee9-util\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:22:58.913592 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:58.913602    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d0d2802-c083-4850-88d5-424d1cbf6ee9-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:22:59.566675 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:59.566652    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nm9x"
Sep 16 02:22:59.566832 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:59.566671    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2nm9x" event={"ID":"9d0d2802-c083-4850-88d5-424d1cbf6ee9","Type":"ContainerDied","Data":"be880b4fe4576a243eea69ec1dcb3004860e9a7ec3a72a7d8381a0c53a5f2796"}
Sep 16 02:22:59.566832 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:22:59.566714    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be880b4fe4576a243eea69ec1dcb3004860e9a7ec3a72a7d8381a0c53a5f2796"
Sep 16 02:23:04.985606 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:04.985518    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gq77g"]
Sep 16 02:23:04.985973 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:04.985833    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d0d2802-c083-4850-88d5-424d1cbf6ee9" containerName="pull"
Sep 16 02:23:04.985973 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:04.985846    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d0d2802-c083-4850-88d5-424d1cbf6ee9" containerName="pull"
Sep 16 02:23:04.985973 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:04.985853    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d0d2802-c083-4850-88d5-424d1cbf6ee9" containerName="extract"
Sep 16 02:23:04.985973 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:04.985859    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d0d2802-c083-4850-88d5-424d1cbf6ee9" containerName="extract"
Sep 16 02:23:04.985973 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:04.985871    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d0d2802-c083-4850-88d5-424d1cbf6ee9" containerName="util"
Sep 16 02:23:04.985973 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:04.985877    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d0d2802-c083-4850-88d5-424d1cbf6ee9" containerName="util"
Sep 16 02:23:04.985973 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:04.985921    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d0d2802-c083-4850-88d5-424d1cbf6ee9" containerName="extract"
Sep 16 02:23:04.988202 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:04.988182    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gq77g"
Sep 16 02:23:04.990587 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:04.990552    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 02:23:04.990724 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:04.990557    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bpxgl\""
Sep 16 02:23:04.991317 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:04.991290    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 02:23:04.996888 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:04.996861    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gq77g"]
Sep 16 02:23:05.051616 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:05.051592    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kzdc\" (UniqueName: \"kubernetes.io/projected/69818318-e76a-4ba6-b980-acdcf6d54303-kube-api-access-9kzdc\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gq77g\" (UID: \"69818318-e76a-4ba6-b980-acdcf6d54303\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gq77g"
Sep 16 02:23:05.051728 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:05.051658    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69818318-e76a-4ba6-b980-acdcf6d54303-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gq77g\" (UID: \"69818318-e76a-4ba6-b980-acdcf6d54303\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gq77g"
Sep 16 02:23:05.051728 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:05.051697    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69818318-e76a-4ba6-b980-acdcf6d54303-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gq77g\" (UID: \"69818318-e76a-4ba6-b980-acdcf6d54303\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gq77g"
Sep 16 02:23:05.152830 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:05.152798    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69818318-e76a-4ba6-b980-acdcf6d54303-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gq77g\" (UID: \"69818318-e76a-4ba6-b980-acdcf6d54303\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gq77g"
Sep 16 02:23:05.152953 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:05.152846    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69818318-e76a-4ba6-b980-acdcf6d54303-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gq77g\" (UID: \"69818318-e76a-4ba6-b980-acdcf6d54303\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gq77g"
Sep 16 02:23:05.152953 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:05.152915    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kzdc\" (UniqueName: \"kubernetes.io/projected/69818318-e76a-4ba6-b980-acdcf6d54303-kube-api-access-9kzdc\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gq77g\" (UID: \"69818318-e76a-4ba6-b980-acdcf6d54303\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gq77g"
Sep 16 02:23:05.153215 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:05.153176    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69818318-e76a-4ba6-b980-acdcf6d54303-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gq77g\" (UID: \"69818318-e76a-4ba6-b980-acdcf6d54303\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gq77g"
Sep 16 02:23:05.153283 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:05.153213    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69818318-e76a-4ba6-b980-acdcf6d54303-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gq77g\" (UID: \"69818318-e76a-4ba6-b980-acdcf6d54303\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gq77g"
Sep 16 02:23:05.160555 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:05.160523    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kzdc\" (UniqueName: \"kubernetes.io/projected/69818318-e76a-4ba6-b980-acdcf6d54303-kube-api-access-9kzdc\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gq77g\" (UID: \"69818318-e76a-4ba6-b980-acdcf6d54303\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gq77g"
Sep 16 02:23:05.298661 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:05.298602    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gq77g"
Sep 16 02:23:05.570640 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:05.570617    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gq77g"]
Sep 16 02:23:05.572882 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:23:05.572851    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69818318_e76a_4ba6_b980_acdcf6d54303.slice/crio-a667d69e4f24aa90a7fa2efde70c8d6c9e3a13ee5541cdd4fdd3651e600ab828 WatchSource:0}: Error finding container a667d69e4f24aa90a7fa2efde70c8d6c9e3a13ee5541cdd4fdd3651e600ab828: Status 404 returned error can't find the container with id a667d69e4f24aa90a7fa2efde70c8d6c9e3a13ee5541cdd4fdd3651e600ab828
Sep 16 02:23:05.593498 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:05.593471    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gq77g" event={"ID":"69818318-e76a-4ba6-b980-acdcf6d54303","Type":"ContainerStarted","Data":"a667d69e4f24aa90a7fa2efde70c8d6c9e3a13ee5541cdd4fdd3651e600ab828"}
Sep 16 02:23:06.289930 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:06.289905    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:06.389464 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:06.389438    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:06.598913 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:06.598821    2565 generic.go:356] "Generic (PLEG): container finished" podID="69818318-e76a-4ba6-b980-acdcf6d54303" containerID="0f71406e5392d7c5ccb1701d709cf5d114d67acfca7421baff8f07f9f47a89a8" exitCode=0
Sep 16 02:23:06.598913 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:06.598873    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gq77g" event={"ID":"69818318-e76a-4ba6-b980-acdcf6d54303","Type":"ContainerDied","Data":"0f71406e5392d7c5ccb1701d709cf5d114d67acfca7421baff8f07f9f47a89a8"}
Sep 16 02:23:06.698581 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:06.698544    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:06.756138 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:06.756108    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-54ff6bb656-2x6d2"]
Sep 16 02:23:06.758103 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:06.758087    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54ff6bb656-2x6d2"
Sep 16 02:23:06.760445 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:06.760390    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5ndtq\""
Sep 16 02:23:06.760548 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:06.760465    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 16 02:23:06.760616 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:06.760567    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 16 02:23:06.760800 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:06.760774    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 16 02:23:06.763857 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:06.763835    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d838c72f-30dc-484a-87c9-5aeffb4b8361-cert\") pod \"lws-controller-manager-54ff6bb656-2x6d2\" (UID: \"d838c72f-30dc-484a-87c9-5aeffb4b8361\") " pod="openshift-lws-operator/lws-controller-manager-54ff6bb656-2x6d2"
Sep 16 02:23:06.763937 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:06.763895    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d838c72f-30dc-484a-87c9-5aeffb4b8361-metrics-cert\") pod \"lws-controller-manager-54ff6bb656-2x6d2\" (UID: \"d838c72f-30dc-484a-87c9-5aeffb4b8361\") " pod="openshift-lws-operator/lws-controller-manager-54ff6bb656-2x6d2"
Sep 16 02:23:06.763991 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:06.763970    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d838c72f-30dc-484a-87c9-5aeffb4b8361-manager-config\") pod \"lws-controller-manager-54ff6bb656-2x6d2\" (UID: \"d838c72f-30dc-484a-87c9-5aeffb4b8361\") " pod="openshift-lws-operator/lws-controller-manager-54ff6bb656-2x6d2"
Sep 16 02:23:06.764032 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:06.764006    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67vks\" (UniqueName: \"kubernetes.io/projected/d838c72f-30dc-484a-87c9-5aeffb4b8361-kube-api-access-67vks\") pod \"lws-controller-manager-54ff6bb656-2x6d2\" (UID: \"d838c72f-30dc-484a-87c9-5aeffb4b8361\") " pod="openshift-lws-operator/lws-controller-manager-54ff6bb656-2x6d2"
Sep 16 02:23:06.768204 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:06.768185    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54ff6bb656-2x6d2"]
Sep 16 02:23:06.773284 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:06.773264    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:06.865011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:06.864959    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d838c72f-30dc-484a-87c9-5aeffb4b8361-cert\") pod \"lws-controller-manager-54ff6bb656-2x6d2\" (UID: \"d838c72f-30dc-484a-87c9-5aeffb4b8361\") " pod="openshift-lws-operator/lws-controller-manager-54ff6bb656-2x6d2"
Sep 16 02:23:06.865011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:06.865009    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d838c72f-30dc-484a-87c9-5aeffb4b8361-metrics-cert\") pod \"lws-controller-manager-54ff6bb656-2x6d2\" (UID: \"d838c72f-30dc-484a-87c9-5aeffb4b8361\") " pod="openshift-lws-operator/lws-controller-manager-54ff6bb656-2x6d2"
Sep 16 02:23:06.865164 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:06.865034    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d838c72f-30dc-484a-87c9-5aeffb4b8361-manager-config\") pod \"lws-controller-manager-54ff6bb656-2x6d2\" (UID: \"d838c72f-30dc-484a-87c9-5aeffb4b8361\") " pod="openshift-lws-operator/lws-controller-manager-54ff6bb656-2x6d2"
Sep 16 02:23:06.865164 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:06.865059    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67vks\" (UniqueName: \"kubernetes.io/projected/d838c72f-30dc-484a-87c9-5aeffb4b8361-kube-api-access-67vks\") pod \"lws-controller-manager-54ff6bb656-2x6d2\" (UID: \"d838c72f-30dc-484a-87c9-5aeffb4b8361\") " pod="openshift-lws-operator/lws-controller-manager-54ff6bb656-2x6d2"
Sep 16 02:23:06.865724 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:06.865697    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d838c72f-30dc-484a-87c9-5aeffb4b8361-manager-config\") pod \"lws-controller-manager-54ff6bb656-2x6d2\" (UID: \"d838c72f-30dc-484a-87c9-5aeffb4b8361\") " pod="openshift-lws-operator/lws-controller-manager-54ff6bb656-2x6d2"
Sep 16 02:23:06.867587 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:06.867558    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d838c72f-30dc-484a-87c9-5aeffb4b8361-metrics-cert\") pod \"lws-controller-manager-54ff6bb656-2x6d2\" (UID: \"d838c72f-30dc-484a-87c9-5aeffb4b8361\") " pod="openshift-lws-operator/lws-controller-manager-54ff6bb656-2x6d2"
Sep 16 02:23:06.867587 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:06.867572    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d838c72f-30dc-484a-87c9-5aeffb4b8361-cert\") pod \"lws-controller-manager-54ff6bb656-2x6d2\" (UID: \"d838c72f-30dc-484a-87c9-5aeffb4b8361\") " pod="openshift-lws-operator/lws-controller-manager-54ff6bb656-2x6d2"
Sep 16 02:23:06.875631 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:06.875612    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67vks\" (UniqueName: \"kubernetes.io/projected/d838c72f-30dc-484a-87c9-5aeffb4b8361-kube-api-access-67vks\") pod \"lws-controller-manager-54ff6bb656-2x6d2\" (UID: \"d838c72f-30dc-484a-87c9-5aeffb4b8361\") " pod="openshift-lws-operator/lws-controller-manager-54ff6bb656-2x6d2"
Sep 16 02:23:06.958069 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:06.958043    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:07.066933 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.066909    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54ff6bb656-2x6d2"
Sep 16 02:23:07.338657 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.338634    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54ff6bb656-2x6d2"]
Sep 16 02:23:07.340632 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:23:07.340611    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd838c72f_30dc_484a_87c9_5aeffb4b8361.slice/crio-aaf7e85cfe91cb81c72b604adb8ec3a4f35797efd2ff11b3b11055e026c93f45 WatchSource:0}: Error finding container aaf7e85cfe91cb81c72b604adb8ec3a4f35797efd2ff11b3b11055e026c93f45: Status 404 returned error can't find the container with id aaf7e85cfe91cb81c72b604adb8ec3a4f35797efd2ff11b3b11055e026c93f45
Sep 16 02:23:07.397984 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.397924    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:07.500959 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.500934    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:07.538503 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.538478    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-599b75f66d-dkpvk"]
Sep 16 02:23:07.540706 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.540692    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-599b75f66d-dkpvk"
Sep 16 02:23:07.543043 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.543015    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 16 02:23:07.543121 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.543064    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 16 02:23:07.543185 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.543144    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 16 02:23:07.543242 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.543215    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 16 02:23:07.543429 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.543416    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-tdbgx\""
Sep 16 02:23:07.556017 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.555998    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-599b75f66d-dkpvk"]
Sep 16 02:23:07.570535 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.570512    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/28a73677-4241-42ba-9d5c-c10ad8fa3c7e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-599b75f66d-dkpvk\" (UID: \"28a73677-4241-42ba-9d5c-c10ad8fa3c7e\") " pod="opendatahub/opendatahub-operator-controller-manager-599b75f66d-dkpvk"
Sep 16 02:23:07.570635 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.570555    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/28a73677-4241-42ba-9d5c-c10ad8fa3c7e-manifests\") pod \"opendatahub-operator-controller-manager-599b75f66d-dkpvk\" (UID: \"28a73677-4241-42ba-9d5c-c10ad8fa3c7e\") " pod="opendatahub/opendatahub-operator-controller-manager-599b75f66d-dkpvk"
Sep 16 02:23:07.570635 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.570571    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/28a73677-4241-42ba-9d5c-c10ad8fa3c7e-webhook-cert\") pod \"opendatahub-operator-controller-manager-599b75f66d-dkpvk\" (UID: \"28a73677-4241-42ba-9d5c-c10ad8fa3c7e\") " pod="opendatahub/opendatahub-operator-controller-manager-599b75f66d-dkpvk"
Sep 16 02:23:07.570635 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.570594    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mzsv\" (UniqueName: \"kubernetes.io/projected/28a73677-4241-42ba-9d5c-c10ad8fa3c7e-kube-api-access-8mzsv\") pod \"opendatahub-operator-controller-manager-599b75f66d-dkpvk\" (UID: \"28a73677-4241-42ba-9d5c-c10ad8fa3c7e\") " pod="opendatahub/opendatahub-operator-controller-manager-599b75f66d-dkpvk"
Sep 16 02:23:07.570755 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.570657    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28a73677-4241-42ba-9d5c-c10ad8fa3c7e-tmp\") pod \"opendatahub-operator-controller-manager-599b75f66d-dkpvk\" (UID: \"28a73677-4241-42ba-9d5c-c10ad8fa3c7e\") " pod="opendatahub/opendatahub-operator-controller-manager-599b75f66d-dkpvk"
Sep 16 02:23:07.604354 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.604325    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54ff6bb656-2x6d2" event={"ID":"d838c72f-30dc-484a-87c9-5aeffb4b8361","Type":"ContainerStarted","Data":"aaf7e85cfe91cb81c72b604adb8ec3a4f35797efd2ff11b3b11055e026c93f45"}
Sep 16 02:23:07.605987 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.605966    2565 generic.go:356] "Generic (PLEG): container finished" podID="69818318-e76a-4ba6-b980-acdcf6d54303" containerID="82bbe558f66bd5a5f27f4686b6f2c2351b338fe827e23f241bac176653cfdeaf" exitCode=0
Sep 16 02:23:07.606074 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.605998    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gq77g" event={"ID":"69818318-e76a-4ba6-b980-acdcf6d54303","Type":"ContainerDied","Data":"82bbe558f66bd5a5f27f4686b6f2c2351b338fe827e23f241bac176653cfdeaf"}
Sep 16 02:23:07.651988 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.651968    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:07.671512 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.671489    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/28a73677-4241-42ba-9d5c-c10ad8fa3c7e-manifests\") pod \"opendatahub-operator-controller-manager-599b75f66d-dkpvk\" (UID: \"28a73677-4241-42ba-9d5c-c10ad8fa3c7e\") " pod="opendatahub/opendatahub-operator-controller-manager-599b75f66d-dkpvk"
Sep 16 02:23:07.671608 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.671516    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/28a73677-4241-42ba-9d5c-c10ad8fa3c7e-webhook-cert\") pod \"opendatahub-operator-controller-manager-599b75f66d-dkpvk\" (UID: \"28a73677-4241-42ba-9d5c-c10ad8fa3c7e\") " pod="opendatahub/opendatahub-operator-controller-manager-599b75f66d-dkpvk"
Sep 16 02:23:07.671608 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.671547    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mzsv\" (UniqueName: \"kubernetes.io/projected/28a73677-4241-42ba-9d5c-c10ad8fa3c7e-kube-api-access-8mzsv\") pod \"opendatahub-operator-controller-manager-599b75f66d-dkpvk\" (UID: \"28a73677-4241-42ba-9d5c-c10ad8fa3c7e\") " pod="opendatahub/opendatahub-operator-controller-manager-599b75f66d-dkpvk"
Sep 16 02:23:07.671608 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.671568    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28a73677-4241-42ba-9d5c-c10ad8fa3c7e-tmp\") pod \"opendatahub-operator-controller-manager-599b75f66d-dkpvk\" (UID: \"28a73677-4241-42ba-9d5c-c10ad8fa3c7e\") " pod="opendatahub/opendatahub-operator-controller-manager-599b75f66d-dkpvk"
Sep 16 02:23:07.671772 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.671634    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/28a73677-4241-42ba-9d5c-c10ad8fa3c7e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-599b75f66d-dkpvk\" (UID: \"28a73677-4241-42ba-9d5c-c10ad8fa3c7e\") " pod="opendatahub/opendatahub-operator-controller-manager-599b75f66d-dkpvk"
Sep 16 02:23:07.671918 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.671893    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/28a73677-4241-42ba-9d5c-c10ad8fa3c7e-manifests\") pod \"opendatahub-operator-controller-manager-599b75f66d-dkpvk\" (UID: \"28a73677-4241-42ba-9d5c-c10ad8fa3c7e\") " pod="opendatahub/opendatahub-operator-controller-manager-599b75f66d-dkpvk"
Sep 16 02:23:07.674106 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.674086    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28a73677-4241-42ba-9d5c-c10ad8fa3c7e-tmp\") pod \"opendatahub-operator-controller-manager-599b75f66d-dkpvk\" (UID: \"28a73677-4241-42ba-9d5c-c10ad8fa3c7e\") " pod="opendatahub/opendatahub-operator-controller-manager-599b75f66d-dkpvk"
Sep 16 02:23:07.674327 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.674313    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/28a73677-4241-42ba-9d5c-c10ad8fa3c7e-webhook-cert\") pod \"opendatahub-operator-controller-manager-599b75f66d-dkpvk\" (UID: \"28a73677-4241-42ba-9d5c-c10ad8fa3c7e\") " pod="opendatahub/opendatahub-operator-controller-manager-599b75f66d-dkpvk"
Sep 16 02:23:07.674522 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.674502    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/28a73677-4241-42ba-9d5c-c10ad8fa3c7e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-599b75f66d-dkpvk\" (UID: \"28a73677-4241-42ba-9d5c-c10ad8fa3c7e\") " pod="opendatahub/opendatahub-operator-controller-manager-599b75f66d-dkpvk"
Sep 16 02:23:07.688753 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.688733    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mzsv\" (UniqueName: \"kubernetes.io/projected/28a73677-4241-42ba-9d5c-c10ad8fa3c7e-kube-api-access-8mzsv\") pod \"opendatahub-operator-controller-manager-599b75f66d-dkpvk\" (UID: \"28a73677-4241-42ba-9d5c-c10ad8fa3c7e\") " pod="opendatahub/opendatahub-operator-controller-manager-599b75f66d-dkpvk"
Sep 16 02:23:07.763233 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.763190    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:07.850073 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.850048    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:07.850999 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.850981    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-599b75f66d-dkpvk"
Sep 16 02:23:07.955287 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:07.955256    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:08.055298 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:08.055264    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:08.129212 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:08.129174    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-599b75f66d-dkpvk"]
Sep 16 02:23:08.130277 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:08.130243    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:08.132534 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:23:08.132506    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28a73677_4241_42ba_9d5c_c10ad8fa3c7e.slice/crio-4ec9e9005714c7213d37ebce28721814133940bdd51fb164ba0e1da586b110a2 WatchSource:0}: Error finding container 4ec9e9005714c7213d37ebce28721814133940bdd51fb164ba0e1da586b110a2: Status 404 returned error can't find the container with id 4ec9e9005714c7213d37ebce28721814133940bdd51fb164ba0e1da586b110a2
Sep 16 02:23:08.614191 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:08.614148    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-599b75f66d-dkpvk" event={"ID":"28a73677-4241-42ba-9d5c-c10ad8fa3c7e","Type":"ContainerStarted","Data":"4ec9e9005714c7213d37ebce28721814133940bdd51fb164ba0e1da586b110a2"}
Sep 16 02:23:08.616919 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:08.616888    2565 generic.go:356] "Generic (PLEG): container finished" podID="69818318-e76a-4ba6-b980-acdcf6d54303" containerID="c015abc550ffc248d11b90091e50c365c0412d54a42d1d07bfd75b3686e65dae" exitCode=0
Sep 16 02:23:08.617043 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:08.616928    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gq77g" event={"ID":"69818318-e76a-4ba6-b980-acdcf6d54303","Type":"ContainerDied","Data":"c015abc550ffc248d11b90091e50c365c0412d54a42d1d07bfd75b3686e65dae"}
Sep 16 02:23:09.625503 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:09.625462    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54ff6bb656-2x6d2" event={"ID":"d838c72f-30dc-484a-87c9-5aeffb4b8361","Type":"ContainerStarted","Data":"1f9d969393e88da8c672bee64d6a80b7c48238822805c687cf1feff4fbcd48ca"}
Sep 16 02:23:09.625951 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:09.625694    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-54ff6bb656-2x6d2"
Sep 16 02:23:09.646111 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:09.646058    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-54ff6bb656-2x6d2" podStartSLOduration=2.071500237 podStartE2EDuration="3.646024737s" totalImagesPullingTime="1.5745245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:23:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:23:09.644091988 +0000 UTC m=+267.694436498" watchObservedRunningTime="2026-09-16 02:23:09.646024737 +0000 UTC m=+267.696369233"
Sep 16 02:23:11.251643 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:11.251617    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gq77g"
Sep 16 02:23:11.302173 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:11.302154    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69818318-e76a-4ba6-b980-acdcf6d54303-util\") pod \"69818318-e76a-4ba6-b980-acdcf6d54303\" (UID: \"69818318-e76a-4ba6-b980-acdcf6d54303\") "
Sep 16 02:23:11.302285 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:11.302199    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69818318-e76a-4ba6-b980-acdcf6d54303-bundle\") pod \"69818318-e76a-4ba6-b980-acdcf6d54303\" (UID: \"69818318-e76a-4ba6-b980-acdcf6d54303\") "
Sep 16 02:23:11.302285 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:11.302231    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kzdc\" (UniqueName: \"kubernetes.io/projected/69818318-e76a-4ba6-b980-acdcf6d54303-kube-api-access-9kzdc\") pod \"69818318-e76a-4ba6-b980-acdcf6d54303\" (UID: \"69818318-e76a-4ba6-b980-acdcf6d54303\") "
Sep 16 02:23:11.302940 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:11.302913    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69818318-e76a-4ba6-b980-acdcf6d54303-bundle" (OuterVolumeSpecName: "bundle") pod "69818318-e76a-4ba6-b980-acdcf6d54303" (UID: "69818318-e76a-4ba6-b980-acdcf6d54303"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:23:11.304687 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:11.304661    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69818318-e76a-4ba6-b980-acdcf6d54303-kube-api-access-9kzdc" (OuterVolumeSpecName: "kube-api-access-9kzdc") pod "69818318-e76a-4ba6-b980-acdcf6d54303" (UID: "69818318-e76a-4ba6-b980-acdcf6d54303"). InnerVolumeSpecName "kube-api-access-9kzdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:23:11.307336 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:11.307312    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69818318-e76a-4ba6-b980-acdcf6d54303-util" (OuterVolumeSpecName: "util") pod "69818318-e76a-4ba6-b980-acdcf6d54303" (UID: "69818318-e76a-4ba6-b980-acdcf6d54303"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:23:11.403432 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:11.403407    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69818318-e76a-4ba6-b980-acdcf6d54303-util\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:23:11.403432 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:11.403429    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69818318-e76a-4ba6-b980-acdcf6d54303-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:23:11.403547 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:11.403439    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kzdc\" (UniqueName: \"kubernetes.io/projected/69818318-e76a-4ba6-b980-acdcf6d54303-kube-api-access-9kzdc\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:23:11.636314 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:11.636252    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-599b75f66d-dkpvk" event={"ID":"28a73677-4241-42ba-9d5c-c10ad8fa3c7e","Type":"ContainerStarted","Data":"f90aa2b50eb32adbf6b04836d73b524f439e6b2fd288c52b4b4a616a83c2587f"}
Sep 16 02:23:11.638191 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:11.638173    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gq77g"
Sep 16 02:23:11.638279 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:11.638172    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gq77g" event={"ID":"69818318-e76a-4ba6-b980-acdcf6d54303","Type":"ContainerDied","Data":"a667d69e4f24aa90a7fa2efde70c8d6c9e3a13ee5541cdd4fdd3651e600ab828"}
Sep 16 02:23:11.638325 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:11.638284    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a667d69e4f24aa90a7fa2efde70c8d6c9e3a13ee5541cdd4fdd3651e600ab828"
Sep 16 02:23:12.643628 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:12.643594    2565 generic.go:356] "Generic (PLEG): container finished" podID="28a73677-4241-42ba-9d5c-c10ad8fa3c7e" containerID="f90aa2b50eb32adbf6b04836d73b524f439e6b2fd288c52b4b4a616a83c2587f" exitCode=0
Sep 16 02:23:12.643897 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:12.643660    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-599b75f66d-dkpvk" event={"ID":"28a73677-4241-42ba-9d5c-c10ad8fa3c7e","Type":"ContainerDied","Data":"f90aa2b50eb32adbf6b04836d73b524f439e6b2fd288c52b4b4a616a83c2587f"}
Sep 16 02:23:13.651001 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:13.650966    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-599b75f66d-dkpvk" event={"ID":"28a73677-4241-42ba-9d5c-c10ad8fa3c7e","Type":"ContainerStarted","Data":"0aef342f9cb0e1f121a3e6fe1e3027931dae5d4f83ad635745de62d02d9d618c"}
Sep 16 02:23:13.651420 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:13.651060    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-599b75f66d-dkpvk"
Sep 16 02:23:13.672424 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:13.672374    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-599b75f66d-dkpvk" podStartSLOduration=2.103488934 podStartE2EDuration="6.672341608s" totalImagesPullingTime="3.478608422s" totalInitContainerRuntime="1.090244252s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:23:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:23:13.669658911 +0000 UTC m=+271.720003404" watchObservedRunningTime="2026-09-16 02:23:13.672341608 +0000 UTC m=+271.722686186"
Sep 16 02:23:20.633635 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:20.633598    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-54ff6bb656-2x6d2"
Sep 16 02:23:23.001584 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:23.001553    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:24.300694 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:24.300660    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:24.656673 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:24.656643    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-599b75f66d-dkpvk"
Sep 16 02:23:26.951249 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:26.951219    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:27.041878 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:27.041846    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:27.232791 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:27.232707    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:27.768379 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:27.768335    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:28.457093 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:28.457059    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:28.519473 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:28.519443    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:29.296190 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:29.296157    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:33.155694 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.155659    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:33.256437 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.256406    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:33.697566 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.697533    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"]
Sep 16 02:23:33.698034 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.698018    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69818318-e76a-4ba6-b980-acdcf6d54303" containerName="pull"
Sep 16 02:23:33.698079 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.698038    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="69818318-e76a-4ba6-b980-acdcf6d54303" containerName="pull"
Sep 16 02:23:33.698079 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.698049    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69818318-e76a-4ba6-b980-acdcf6d54303" containerName="extract"
Sep 16 02:23:33.698079 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.698058    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="69818318-e76a-4ba6-b980-acdcf6d54303" containerName="extract"
Sep 16 02:23:33.698171 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.698081    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69818318-e76a-4ba6-b980-acdcf6d54303" containerName="util"
Sep 16 02:23:33.698171 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.698090    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="69818318-e76a-4ba6-b980-acdcf6d54303" containerName="util"
Sep 16 02:23:33.698171 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.698165    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="69818318-e76a-4ba6-b980-acdcf6d54303" containerName="extract"
Sep 16 02:23:33.707925 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.707901    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:33.709875 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.709849    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"]
Sep 16 02:23:33.710378 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.710347    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 16 02:23:33.710529 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.710511    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-52wtk\""
Sep 16 02:23:33.710665 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.710650    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 16 02:23:33.710790 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.710772    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 16 02:23:33.733862 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.733840    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:33.763764 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.763742    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9fd013c-2c32-4366-8fe2-98c6b8b097c8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl\" (UID: \"b9fd013c-2c32-4366-8fe2-98c6b8b097c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:33.763850 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.763772    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9fd013c-2c32-4366-8fe2-98c6b8b097c8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl\" (UID: \"b9fd013c-2c32-4366-8fe2-98c6b8b097c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:33.763850 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.763798    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9fd013c-2c32-4366-8fe2-98c6b8b097c8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl\" (UID: \"b9fd013c-2c32-4366-8fe2-98c6b8b097c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:33.763916 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.763866    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9fd013c-2c32-4366-8fe2-98c6b8b097c8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl\" (UID: \"b9fd013c-2c32-4366-8fe2-98c6b8b097c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:33.763954 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.763921    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9fd013c-2c32-4366-8fe2-98c6b8b097c8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl\" (UID: \"b9fd013c-2c32-4366-8fe2-98c6b8b097c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:33.763954 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.763941    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgf5j\" (UniqueName: \"kubernetes.io/projected/b9fd013c-2c32-4366-8fe2-98c6b8b097c8-kube-api-access-zgf5j\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl\" (UID: \"b9fd013c-2c32-4366-8fe2-98c6b8b097c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:33.764015 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.763978    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9fd013c-2c32-4366-8fe2-98c6b8b097c8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl\" (UID: \"b9fd013c-2c32-4366-8fe2-98c6b8b097c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:33.764015 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.764003    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9fd013c-2c32-4366-8fe2-98c6b8b097c8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl\" (UID: \"b9fd013c-2c32-4366-8fe2-98c6b8b097c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:33.764076 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.764027    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9fd013c-2c32-4366-8fe2-98c6b8b097c8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl\" (UID: \"b9fd013c-2c32-4366-8fe2-98c6b8b097c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:33.864802 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.864779    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9fd013c-2c32-4366-8fe2-98c6b8b097c8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl\" (UID: \"b9fd013c-2c32-4366-8fe2-98c6b8b097c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:33.864913 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.864822    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9fd013c-2c32-4366-8fe2-98c6b8b097c8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl\" (UID: \"b9fd013c-2c32-4366-8fe2-98c6b8b097c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:33.864913 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.864842    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgf5j\" (UniqueName: \"kubernetes.io/projected/b9fd013c-2c32-4366-8fe2-98c6b8b097c8-kube-api-access-zgf5j\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl\" (UID: \"b9fd013c-2c32-4366-8fe2-98c6b8b097c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:33.864913 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.864867    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9fd013c-2c32-4366-8fe2-98c6b8b097c8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl\" (UID: \"b9fd013c-2c32-4366-8fe2-98c6b8b097c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:33.864913 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.864892    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9fd013c-2c32-4366-8fe2-98c6b8b097c8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl\" (UID: \"b9fd013c-2c32-4366-8fe2-98c6b8b097c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:33.865136 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.864915    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9fd013c-2c32-4366-8fe2-98c6b8b097c8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl\" (UID: \"b9fd013c-2c32-4366-8fe2-98c6b8b097c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:33.865136 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.864982    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9fd013c-2c32-4366-8fe2-98c6b8b097c8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl\" (UID: \"b9fd013c-2c32-4366-8fe2-98c6b8b097c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:33.865136 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.865013    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9fd013c-2c32-4366-8fe2-98c6b8b097c8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl\" (UID: \"b9fd013c-2c32-4366-8fe2-98c6b8b097c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:33.865136 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.865045    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9fd013c-2c32-4366-8fe2-98c6b8b097c8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl\" (UID: \"b9fd013c-2c32-4366-8fe2-98c6b8b097c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:33.865340 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.865263    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9fd013c-2c32-4366-8fe2-98c6b8b097c8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl\" (UID: \"b9fd013c-2c32-4366-8fe2-98c6b8b097c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:33.865420 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.865355    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9fd013c-2c32-4366-8fe2-98c6b8b097c8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl\" (UID: \"b9fd013c-2c32-4366-8fe2-98c6b8b097c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:33.865616 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.865593    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9fd013c-2c32-4366-8fe2-98c6b8b097c8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl\" (UID: \"b9fd013c-2c32-4366-8fe2-98c6b8b097c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:33.865688 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.865631    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9fd013c-2c32-4366-8fe2-98c6b8b097c8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl\" (UID: \"b9fd013c-2c32-4366-8fe2-98c6b8b097c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:33.865818 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.865788    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9fd013c-2c32-4366-8fe2-98c6b8b097c8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl\" (UID: \"b9fd013c-2c32-4366-8fe2-98c6b8b097c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:33.867176 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.867157    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9fd013c-2c32-4366-8fe2-98c6b8b097c8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl\" (UID: \"b9fd013c-2c32-4366-8fe2-98c6b8b097c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:33.867564 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.867547    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9fd013c-2c32-4366-8fe2-98c6b8b097c8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl\" (UID: \"b9fd013c-2c32-4366-8fe2-98c6b8b097c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:33.871769 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.871746    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9fd013c-2c32-4366-8fe2-98c6b8b097c8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl\" (UID: \"b9fd013c-2c32-4366-8fe2-98c6b8b097c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:33.871972 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.871953    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgf5j\" (UniqueName: \"kubernetes.io/projected/b9fd013c-2c32-4366-8fe2-98c6b8b097c8-kube-api-access-zgf5j\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl\" (UID: \"b9fd013c-2c32-4366-8fe2-98c6b8b097c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:33.874479 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:33.874428    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:34.018402 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:34.018326    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:34.285530 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:34.285471    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:34.292583 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:34.292561    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"]
Sep 16 02:23:34.294648 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:23:34.294624    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9fd013c_2c32_4366_8fe2_98c6b8b097c8.slice/crio-bf948c7920a7041d97491dfe384401915a12beb3e4ec29b7f56590cd871bc0f2 WatchSource:0}: Error finding container bf948c7920a7041d97491dfe384401915a12beb3e4ec29b7f56590cd871bc0f2: Status 404 returned error can't find the container with id bf948c7920a7041d97491dfe384401915a12beb3e4ec29b7f56590cd871bc0f2
Sep 16 02:23:34.740521 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:34.740482    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl" event={"ID":"b9fd013c-2c32-4366-8fe2-98c6b8b097c8","Type":"ContainerStarted","Data":"bf948c7920a7041d97491dfe384401915a12beb3e4ec29b7f56590cd871bc0f2"}
Sep 16 02:23:36.988111 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:36.988064    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:23:36.988356 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:36.988147    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:23:36.988356 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:36.988175    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:23:37.757967 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:37.757929    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl" event={"ID":"b9fd013c-2c32-4366-8fe2-98c6b8b097c8","Type":"ContainerStarted","Data":"7f6b58bae54eb3a8b822268a32f3b98f38de3b27a80dd26eb4c7459ea43762eb"}
Sep 16 02:23:37.777796 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:37.777736    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl" podStartSLOduration=2.086676205 podStartE2EDuration="4.777721321s" totalImagesPullingTime="2.691045116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:23:37.776437514 +0000 UTC m=+295.826782020" watchObservedRunningTime="2026-09-16 02:23:37.777721321 +0000 UTC m=+295.828065792"
Sep 16 02:23:38.019057 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.018983    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:38.023446 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.023417    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:38.061519 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.061491    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-t9htj"]
Sep 16 02:23:38.064824 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.064807    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-t9htj"
Sep 16 02:23:38.066898 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.066872    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 16 02:23:38.067004 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.066985    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-mr58m\""
Sep 16 02:23:38.076248 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.076225    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-t9htj"]
Sep 16 02:23:38.094352 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.094323    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:38.196215 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.196183    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:38.200347 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.200326    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prclz\" (UniqueName: \"kubernetes.io/projected/0e253ed5-c778-481a-99dd-57e7ad152373-kube-api-access-prclz\") pod \"odh-model-controller-7998c67dc4-t9htj\" (UID: \"0e253ed5-c778-481a-99dd-57e7ad152373\") " pod="opendatahub/odh-model-controller-7998c67dc4-t9htj"
Sep 16 02:23:38.200444 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.200381    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e253ed5-c778-481a-99dd-57e7ad152373-cert\") pod \"odh-model-controller-7998c67dc4-t9htj\" (UID: \"0e253ed5-c778-481a-99dd-57e7ad152373\") " pod="opendatahub/odh-model-controller-7998c67dc4-t9htj"
Sep 16 02:23:38.301104 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.301040    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prclz\" (UniqueName: \"kubernetes.io/projected/0e253ed5-c778-481a-99dd-57e7ad152373-kube-api-access-prclz\") pod \"odh-model-controller-7998c67dc4-t9htj\" (UID: \"0e253ed5-c778-481a-99dd-57e7ad152373\") " pod="opendatahub/odh-model-controller-7998c67dc4-t9htj"
Sep 16 02:23:38.301104 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.301084    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e253ed5-c778-481a-99dd-57e7ad152373-cert\") pod \"odh-model-controller-7998c67dc4-t9htj\" (UID: \"0e253ed5-c778-481a-99dd-57e7ad152373\") " pod="opendatahub/odh-model-controller-7998c67dc4-t9htj"
Sep 16 02:23:38.301274 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:23:38.301253    2565 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 16 02:23:38.301326 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:23:38.301317    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e253ed5-c778-481a-99dd-57e7ad152373-cert podName:0e253ed5-c778-481a-99dd-57e7ad152373 nodeName:}" failed. No retries permitted until 2026-09-16 02:23:38.801301311 +0000 UTC m=+296.851645787 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0e253ed5-c778-481a-99dd-57e7ad152373-cert") pod "odh-model-controller-7998c67dc4-t9htj" (UID: "0e253ed5-c778-481a-99dd-57e7ad152373") : secret "odh-model-controller-webhook-cert" not found
Sep 16 02:23:38.310040 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.310016    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prclz\" (UniqueName: \"kubernetes.io/projected/0e253ed5-c778-481a-99dd-57e7ad152373-kube-api-access-prclz\") pod \"odh-model-controller-7998c67dc4-t9htj\" (UID: \"0e253ed5-c778-481a-99dd-57e7ad152373\") " pod="opendatahub/odh-model-controller-7998c67dc4-t9htj"
Sep 16 02:23:38.406388 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.406338    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:38.463373 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.463328    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-drgfc"]
Sep 16 02:23:38.466292 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.466271    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:38.466600 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.466583    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-drgfc"
Sep 16 02:23:38.469123 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.469107    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 16 02:23:38.469205 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.469108    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-p4f9c\""
Sep 16 02:23:38.476294 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.476267    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-drgfc"]
Sep 16 02:23:38.585493 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.585412    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:38.604076 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.604052    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdqtc\" (UniqueName: \"kubernetes.io/projected/1d14ed0f-f87a-4a2b-859b-fe3044d4302c-kube-api-access-jdqtc\") pod \"model-serving-api-54d89bd5fc-drgfc\" (UID: \"1d14ed0f-f87a-4a2b-859b-fe3044d4302c\") " pod="opendatahub/model-serving-api-54d89bd5fc-drgfc"
Sep 16 02:23:38.604164 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.604111    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d14ed0f-f87a-4a2b-859b-fe3044d4302c-tls-certs\") pod \"model-serving-api-54d89bd5fc-drgfc\" (UID: \"1d14ed0f-f87a-4a2b-859b-fe3044d4302c\") " pod="opendatahub/model-serving-api-54d89bd5fc-drgfc"
Sep 16 02:23:38.633790 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.633765    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:38.705303 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.705273    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdqtc\" (UniqueName: \"kubernetes.io/projected/1d14ed0f-f87a-4a2b-859b-fe3044d4302c-kube-api-access-jdqtc\") pod \"model-serving-api-54d89bd5fc-drgfc\" (UID: \"1d14ed0f-f87a-4a2b-859b-fe3044d4302c\") " pod="opendatahub/model-serving-api-54d89bd5fc-drgfc"
Sep 16 02:23:38.705422 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.705329    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d14ed0f-f87a-4a2b-859b-fe3044d4302c-tls-certs\") pod \"model-serving-api-54d89bd5fc-drgfc\" (UID: \"1d14ed0f-f87a-4a2b-859b-fe3044d4302c\") " pod="opendatahub/model-serving-api-54d89bd5fc-drgfc"
Sep 16 02:23:38.705477 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:23:38.705459    2565 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 16 02:23:38.705538 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:23:38.705526    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d14ed0f-f87a-4a2b-859b-fe3044d4302c-tls-certs podName:1d14ed0f-f87a-4a2b-859b-fe3044d4302c nodeName:}" failed. No retries permitted until 2026-09-16 02:23:39.205508322 +0000 UTC m=+297.255852800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/1d14ed0f-f87a-4a2b-859b-fe3044d4302c-tls-certs") pod "model-serving-api-54d89bd5fc-drgfc" (UID: "1d14ed0f-f87a-4a2b-859b-fe3044d4302c") : secret "model-serving-api-tls" not found
Sep 16 02:23:38.715457 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.715439    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdqtc\" (UniqueName: \"kubernetes.io/projected/1d14ed0f-f87a-4a2b-859b-fe3044d4302c-kube-api-access-jdqtc\") pod \"model-serving-api-54d89bd5fc-drgfc\" (UID: \"1d14ed0f-f87a-4a2b-859b-fe3044d4302c\") " pod="opendatahub/model-serving-api-54d89bd5fc-drgfc"
Sep 16 02:23:38.762513 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.762493    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:38.763482 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.763462    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl"
Sep 16 02:23:38.805820 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.805794    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e253ed5-c778-481a-99dd-57e7ad152373-cert\") pod \"odh-model-controller-7998c67dc4-t9htj\" (UID: \"0e253ed5-c778-481a-99dd-57e7ad152373\") " pod="opendatahub/odh-model-controller-7998c67dc4-t9htj"
Sep 16 02:23:38.808050 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.808026    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e253ed5-c778-481a-99dd-57e7ad152373-cert\") pod \"odh-model-controller-7998c67dc4-t9htj\" (UID: \"0e253ed5-c778-481a-99dd-57e7ad152373\") " pod="opendatahub/odh-model-controller-7998c67dc4-t9htj"
Sep 16 02:23:38.976251 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:38.976230    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-t9htj"
Sep 16 02:23:39.208922 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:39.208894    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d14ed0f-f87a-4a2b-859b-fe3044d4302c-tls-certs\") pod \"model-serving-api-54d89bd5fc-drgfc\" (UID: \"1d14ed0f-f87a-4a2b-859b-fe3044d4302c\") " pod="opendatahub/model-serving-api-54d89bd5fc-drgfc"
Sep 16 02:23:39.209305 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:23:39.209075    2565 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 16 02:23:39.209305 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:23:39.209151    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d14ed0f-f87a-4a2b-859b-fe3044d4302c-tls-certs podName:1d14ed0f-f87a-4a2b-859b-fe3044d4302c nodeName:}" failed. No retries permitted until 2026-09-16 02:23:40.209131501 +0000 UTC m=+298.259475992 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/1d14ed0f-f87a-4a2b-859b-fe3044d4302c-tls-certs") pod "model-serving-api-54d89bd5fc-drgfc" (UID: "1d14ed0f-f87a-4a2b-859b-fe3044d4302c") : secret "model-serving-api-tls" not found
Sep 16 02:23:39.244211 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:39.244190    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-t9htj"]
Sep 16 02:23:39.245850 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:23:39.245820    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e253ed5_c778_481a_99dd_57e7ad152373.slice/crio-88dea77d8b89f618ab9a2ab627d7db6f673d8d83cf7713999a0a948c2856e8e4 WatchSource:0}: Error finding container 88dea77d8b89f618ab9a2ab627d7db6f673d8d83cf7713999a0a948c2856e8e4: Status 404 returned error can't find the container with id 88dea77d8b89f618ab9a2ab627d7db6f673d8d83cf7713999a0a948c2856e8e4
Sep 16 02:23:39.267479 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:39.267453    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:39.767924 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:39.767892    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-t9htj" event={"ID":"0e253ed5-c778-481a-99dd-57e7ad152373","Type":"ContainerStarted","Data":"88dea77d8b89f618ab9a2ab627d7db6f673d8d83cf7713999a0a948c2856e8e4"}
Sep 16 02:23:40.216208 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:40.216170    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d14ed0f-f87a-4a2b-859b-fe3044d4302c-tls-certs\") pod \"model-serving-api-54d89bd5fc-drgfc\" (UID: \"1d14ed0f-f87a-4a2b-859b-fe3044d4302c\") " pod="opendatahub/model-serving-api-54d89bd5fc-drgfc"
Sep 16 02:23:40.219179 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:40.219152    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d14ed0f-f87a-4a2b-859b-fe3044d4302c-tls-certs\") pod \"model-serving-api-54d89bd5fc-drgfc\" (UID: \"1d14ed0f-f87a-4a2b-859b-fe3044d4302c\") " pod="opendatahub/model-serving-api-54d89bd5fc-drgfc"
Sep 16 02:23:40.276911 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:40.276868    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-drgfc"
Sep 16 02:23:40.443766 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:40.443723    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:40.494134 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:40.494058    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:40.557435 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:40.557348    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-drgfc"]
Sep 16 02:23:40.558710 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:23:40.558678    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d14ed0f_f87a_4a2b_859b_fe3044d4302c.slice/crio-34a084c9a3ded6883d2e2b78bf3b100da1a10770860b7fe09189d979eed0f7ac WatchSource:0}: Error finding container 34a084c9a3ded6883d2e2b78bf3b100da1a10770860b7fe09189d979eed0f7ac: Status 404 returned error can't find the container with id 34a084c9a3ded6883d2e2b78bf3b100da1a10770860b7fe09189d979eed0f7ac
Sep 16 02:23:40.772968 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:40.772877    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-drgfc" event={"ID":"1d14ed0f-f87a-4a2b-859b-fe3044d4302c","Type":"ContainerStarted","Data":"34a084c9a3ded6883d2e2b78bf3b100da1a10770860b7fe09189d979eed0f7ac"}
Sep 16 02:23:43.684110 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:43.684080    2565 kubelet.go:1648] "Image garbage collection succeeded"
Sep 16 02:23:43.791065 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:43.791013    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-t9htj" event={"ID":"0e253ed5-c778-481a-99dd-57e7ad152373","Type":"ContainerStarted","Data":"df52d06fcba30207e696d881b71c5c6349a4b71ffe213857bba03f25af049dcd"}
Sep 16 02:23:43.791242 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:43.791137    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-t9htj"
Sep 16 02:23:43.792797 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:43.792773    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-drgfc" event={"ID":"1d14ed0f-f87a-4a2b-859b-fe3044d4302c","Type":"ContainerStarted","Data":"a8840f6bc50b5c0734b6fdaec9f01541059e6e1375d03645400cca099777ad28"}
Sep 16 02:23:43.792925 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:43.792905    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-drgfc"
Sep 16 02:23:43.805822 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:43.805780    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-t9htj" podStartSLOduration=1.3957493269999999 podStartE2EDuration="5.805765753s" totalImagesPullingTime="4.410016426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:23:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:23:43.804939455 +0000 UTC m=+301.855283980" watchObservedRunningTime="2026-09-16 02:23:43.805765753 +0000 UTC m=+301.856110246"
Sep 16 02:23:43.819293 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:43.819254    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-drgfc" podStartSLOduration=2.6830024850000003 podStartE2EDuration="5.819237906s" totalImagesPullingTime="3.136235421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:23:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:23:43.818833415 +0000 UTC m=+301.869177932" watchObservedRunningTime="2026-09-16 02:23:43.819237906 +0000 UTC m=+301.869582400"
Sep 16 02:23:44.594935 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:44.594895    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9"]
Sep 16 02:23:44.598215 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:44.598194    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9"
Sep 16 02:23:44.600908 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:44.600872    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 16 02:23:44.600908 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:44.600880    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-q62wt\""
Sep 16 02:23:44.601071 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:44.600879    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 16 02:23:44.601071 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:44.600879    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 16 02:23:44.609138 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:44.609112    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9"]
Sep 16 02:23:44.656055 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:44.656026    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr5hv\" (UniqueName: \"kubernetes.io/projected/3a28e95a-1262-4c3f-82a3-198beec0a7dc-kube-api-access-nr5hv\") pod \"istiod-openshift-gateway-5677ccb49b-gdrj9\" (UID: \"3a28e95a-1262-4c3f-82a3-198beec0a7dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9"
Sep 16 02:23:44.656184 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:44.656089    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3a28e95a-1262-4c3f-82a3-198beec0a7dc-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-gdrj9\" (UID: \"3a28e95a-1262-4c3f-82a3-198beec0a7dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9"
Sep 16 02:23:44.656184 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:44.656153    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a28e95a-1262-4c3f-82a3-198beec0a7dc-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-gdrj9\" (UID: \"3a28e95a-1262-4c3f-82a3-198beec0a7dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9"
Sep 16 02:23:44.656260 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:44.656195    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3a28e95a-1262-4c3f-82a3-198beec0a7dc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-gdrj9\" (UID: \"3a28e95a-1262-4c3f-82a3-198beec0a7dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9"
Sep 16 02:23:44.656260 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:44.656235    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a28e95a-1262-4c3f-82a3-198beec0a7dc-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-gdrj9\" (UID: \"3a28e95a-1262-4c3f-82a3-198beec0a7dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9"
Sep 16 02:23:44.656260 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:44.656253    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3a28e95a-1262-4c3f-82a3-198beec0a7dc-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-gdrj9\" (UID: \"3a28e95a-1262-4c3f-82a3-198beec0a7dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9"
Sep 16 02:23:44.656387 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:44.656277    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3a28e95a-1262-4c3f-82a3-198beec0a7dc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-gdrj9\" (UID: \"3a28e95a-1262-4c3f-82a3-198beec0a7dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9"
Sep 16 02:23:44.757437 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:44.757400    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3a28e95a-1262-4c3f-82a3-198beec0a7dc-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-gdrj9\" (UID: \"3a28e95a-1262-4c3f-82a3-198beec0a7dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9"
Sep 16 02:23:44.757908 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:44.757458    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a28e95a-1262-4c3f-82a3-198beec0a7dc-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-gdrj9\" (UID: \"3a28e95a-1262-4c3f-82a3-198beec0a7dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9"
Sep 16 02:23:44.757908 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:44.757486    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3a28e95a-1262-4c3f-82a3-198beec0a7dc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-gdrj9\" (UID: \"3a28e95a-1262-4c3f-82a3-198beec0a7dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9"
Sep 16 02:23:44.757908 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:44.757523    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a28e95a-1262-4c3f-82a3-198beec0a7dc-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-gdrj9\" (UID: \"3a28e95a-1262-4c3f-82a3-198beec0a7dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9"
Sep 16 02:23:44.757908 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:44.757599    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3a28e95a-1262-4c3f-82a3-198beec0a7dc-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-gdrj9\" (UID: \"3a28e95a-1262-4c3f-82a3-198beec0a7dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9"
Sep 16 02:23:44.757908 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:44.757639    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3a28e95a-1262-4c3f-82a3-198beec0a7dc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-gdrj9\" (UID: \"3a28e95a-1262-4c3f-82a3-198beec0a7dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9"
Sep 16 02:23:44.757908 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:44.757678    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr5hv\" (UniqueName: \"kubernetes.io/projected/3a28e95a-1262-4c3f-82a3-198beec0a7dc-kube-api-access-nr5hv\") pod \"istiod-openshift-gateway-5677ccb49b-gdrj9\" (UID: \"3a28e95a-1262-4c3f-82a3-198beec0a7dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9"
Sep 16 02:23:44.758400 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:44.758351    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3a28e95a-1262-4c3f-82a3-198beec0a7dc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-gdrj9\" (UID: \"3a28e95a-1262-4c3f-82a3-198beec0a7dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9"
Sep 16 02:23:44.759898 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:44.759871    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3a28e95a-1262-4c3f-82a3-198beec0a7dc-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-gdrj9\" (UID: \"3a28e95a-1262-4c3f-82a3-198beec0a7dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9"
Sep 16 02:23:44.760033 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:44.760007    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a28e95a-1262-4c3f-82a3-198beec0a7dc-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-gdrj9\" (UID: \"3a28e95a-1262-4c3f-82a3-198beec0a7dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9"
Sep 16 02:23:44.760100 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:44.760068    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3a28e95a-1262-4c3f-82a3-198beec0a7dc-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-gdrj9\" (UID: \"3a28e95a-1262-4c3f-82a3-198beec0a7dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9"
Sep 16 02:23:44.760100 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:44.760076    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3a28e95a-1262-4c3f-82a3-198beec0a7dc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-gdrj9\" (UID: \"3a28e95a-1262-4c3f-82a3-198beec0a7dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9"
Sep 16 02:23:44.766731 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:44.766706    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a28e95a-1262-4c3f-82a3-198beec0a7dc-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-gdrj9\" (UID: \"3a28e95a-1262-4c3f-82a3-198beec0a7dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9"
Sep 16 02:23:44.766831 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:44.766754    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr5hv\" (UniqueName: \"kubernetes.io/projected/3a28e95a-1262-4c3f-82a3-198beec0a7dc-kube-api-access-nr5hv\") pod \"istiod-openshift-gateway-5677ccb49b-gdrj9\" (UID: \"3a28e95a-1262-4c3f-82a3-198beec0a7dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9"
Sep 16 02:23:44.908199 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:44.908174    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9"
Sep 16 02:23:45.202311 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:45.202280    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9"]
Sep 16 02:23:45.202498 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:23:45.202474    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a28e95a_1262_4c3f_82a3_198beec0a7dc.slice/crio-a0f725359f57d769f4cc177f2e3ac4fdeb1f03a474dfd13b5be0ab44aef3fef9 WatchSource:0}: Error finding container a0f725359f57d769f4cc177f2e3ac4fdeb1f03a474dfd13b5be0ab44aef3fef9: Status 404 returned error can't find the container with id a0f725359f57d769f4cc177f2e3ac4fdeb1f03a474dfd13b5be0ab44aef3fef9
Sep 16 02:23:45.204763 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:45.204744    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 02:23:45.803587 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:45.803544    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9" event={"ID":"3a28e95a-1262-4c3f-82a3-198beec0a7dc","Type":"ContainerStarted","Data":"a0f725359f57d769f4cc177f2e3ac4fdeb1f03a474dfd13b5be0ab44aef3fef9"}
Sep 16 02:23:47.018954 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:47.018907    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:47.127425 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:47.127387    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:47.211784 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:47.211749    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:47.569516 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:47.569469    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:47.836973 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:47.836944    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:23:47.837059 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:47.837004    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:23:48.430012 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:48.429973    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:48.522160 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:48.522125    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:48.621538 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:48.621504    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:48.692098 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:48.692031    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:48.818030 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:48.817997    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9" event={"ID":"3a28e95a-1262-4c3f-82a3-198beec0a7dc","Type":"ContainerStarted","Data":"eebb4fba4221deacb1ef9003970a5bb5d6e1d1d041fe54abbe92f74df2446222"}
Sep 16 02:23:48.818183 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:48.818121    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9"
Sep 16 02:23:48.819803 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:48.819783    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9"
Sep 16 02:23:48.872058 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:48.872012    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9" podStartSLOduration=2.240203443 podStartE2EDuration="4.871998182s" totalImagesPullingTime="2.631794739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:23:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:23:48.870221394 +0000 UTC m=+306.920565887" watchObservedRunningTime="2026-09-16 02:23:48.871998182 +0000 UTC m=+306.922342674"
Sep 16 02:23:51.938444 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:51.938406    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:51.989325 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:51.989279    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:23:54.799582 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:54.799552    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-t9htj"
Sep 16 02:23:54.802170 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:23:54.802148    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-drgfc"
Sep 16 02:24:39.341510 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:39.341431    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:24:39.438481 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:39.438448    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:24:42.792731 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:42.792695    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmd5n"]
Sep 16 02:24:42.795084 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:42.795068    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmd5n"
Sep 16 02:24:42.797259 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:42.797236    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 02:24:42.797407 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:42.797391    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 02:24:42.798174 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:42.798159    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bpxgl\""
Sep 16 02:24:42.803733 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:42.803711    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmd5n"]
Sep 16 02:24:42.890432 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:42.890408    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x9x9t"]
Sep 16 02:24:42.892569 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:42.892554    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x9x9t"
Sep 16 02:24:42.901649 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:42.901627    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x9x9t"]
Sep 16 02:24:42.913492 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:42.913467    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9057a1cb-9423-4448-b8f9-af8a82c96447-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmd5n\" (UID: \"9057a1cb-9423-4448-b8f9-af8a82c96447\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmd5n"
Sep 16 02:24:42.913585 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:42.913512    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l6sx\" (UniqueName: \"kubernetes.io/projected/9057a1cb-9423-4448-b8f9-af8a82c96447-kube-api-access-7l6sx\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmd5n\" (UID: \"9057a1cb-9423-4448-b8f9-af8a82c96447\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmd5n"
Sep 16 02:24:42.913647 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:42.913584    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9057a1cb-9423-4448-b8f9-af8a82c96447-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmd5n\" (UID: \"9057a1cb-9423-4448-b8f9-af8a82c96447\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmd5n"
Sep 16 02:24:42.992356 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:42.992335    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6jqcv"]
Sep 16 02:24:42.994656 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:42.994642    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6jqcv"
Sep 16 02:24:43.003255 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.003230    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6jqcv"]
Sep 16 02:24:43.014111 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.014087    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9057a1cb-9423-4448-b8f9-af8a82c96447-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmd5n\" (UID: \"9057a1cb-9423-4448-b8f9-af8a82c96447\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmd5n"
Sep 16 02:24:43.014215 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.014118    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l6sx\" (UniqueName: \"kubernetes.io/projected/9057a1cb-9423-4448-b8f9-af8a82c96447-kube-api-access-7l6sx\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmd5n\" (UID: \"9057a1cb-9423-4448-b8f9-af8a82c96447\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmd5n"
Sep 16 02:24:43.014215 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.014162    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95e2b253-1089-49c8-b4c6-eb41f6c82bf8-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x9x9t\" (UID: \"95e2b253-1089-49c8-b4c6-eb41f6c82bf8\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x9x9t"
Sep 16 02:24:43.014215 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.014196    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9057a1cb-9423-4448-b8f9-af8a82c96447-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmd5n\" (UID: \"9057a1cb-9423-4448-b8f9-af8a82c96447\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmd5n"
Sep 16 02:24:43.014409 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.014234    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhth4\" (UniqueName: \"kubernetes.io/projected/95e2b253-1089-49c8-b4c6-eb41f6c82bf8-kube-api-access-lhth4\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x9x9t\" (UID: \"95e2b253-1089-49c8-b4c6-eb41f6c82bf8\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x9x9t"
Sep 16 02:24:43.014409 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.014264    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95e2b253-1089-49c8-b4c6-eb41f6c82bf8-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x9x9t\" (UID: \"95e2b253-1089-49c8-b4c6-eb41f6c82bf8\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x9x9t"
Sep 16 02:24:43.014530 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.014457    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9057a1cb-9423-4448-b8f9-af8a82c96447-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmd5n\" (UID: \"9057a1cb-9423-4448-b8f9-af8a82c96447\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmd5n"
Sep 16 02:24:43.014593 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.014526    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9057a1cb-9423-4448-b8f9-af8a82c96447-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmd5n\" (UID: \"9057a1cb-9423-4448-b8f9-af8a82c96447\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmd5n"
Sep 16 02:24:43.021815 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.021792    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l6sx\" (UniqueName: \"kubernetes.io/projected/9057a1cb-9423-4448-b8f9-af8a82c96447-kube-api-access-7l6sx\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmd5n\" (UID: \"9057a1cb-9423-4448-b8f9-af8a82c96447\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmd5n"
Sep 16 02:24:43.096451 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.096389    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l8kwb"]
Sep 16 02:24:43.098705 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.098691    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l8kwb"
Sep 16 02:24:43.103917 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.103895    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmd5n"
Sep 16 02:24:43.109450 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.109428    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l8kwb"]
Sep 16 02:24:43.115632 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.115611    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/367d197e-a9c3-4b0d-997c-9e022d2e2206-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6jqcv\" (UID: \"367d197e-a9c3-4b0d-997c-9e022d2e2206\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6jqcv"
Sep 16 02:24:43.115773 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.115741    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmcsf\" (UniqueName: \"kubernetes.io/projected/367d197e-a9c3-4b0d-997c-9e022d2e2206-kube-api-access-cmcsf\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6jqcv\" (UID: \"367d197e-a9c3-4b0d-997c-9e022d2e2206\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6jqcv"
Sep 16 02:24:43.115874 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.115851    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/367d197e-a9c3-4b0d-997c-9e022d2e2206-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6jqcv\" (UID: \"367d197e-a9c3-4b0d-997c-9e022d2e2206\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6jqcv"
Sep 16 02:24:43.115932 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.115917    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95e2b253-1089-49c8-b4c6-eb41f6c82bf8-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x9x9t\" (UID: \"95e2b253-1089-49c8-b4c6-eb41f6c82bf8\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x9x9t"
Sep 16 02:24:43.115991 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.115976    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhth4\" (UniqueName: \"kubernetes.io/projected/95e2b253-1089-49c8-b4c6-eb41f6c82bf8-kube-api-access-lhth4\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x9x9t\" (UID: \"95e2b253-1089-49c8-b4c6-eb41f6c82bf8\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x9x9t"
Sep 16 02:24:43.116038 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.116009    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95e2b253-1089-49c8-b4c6-eb41f6c82bf8-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x9x9t\" (UID: \"95e2b253-1089-49c8-b4c6-eb41f6c82bf8\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x9x9t"
Sep 16 02:24:43.116376 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.116342    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95e2b253-1089-49c8-b4c6-eb41f6c82bf8-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x9x9t\" (UID: \"95e2b253-1089-49c8-b4c6-eb41f6c82bf8\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x9x9t"
Sep 16 02:24:43.116452 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.116388    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95e2b253-1089-49c8-b4c6-eb41f6c82bf8-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x9x9t\" (UID: \"95e2b253-1089-49c8-b4c6-eb41f6c82bf8\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x9x9t"
Sep 16 02:24:43.126842 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.126821    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhth4\" (UniqueName: \"kubernetes.io/projected/95e2b253-1089-49c8-b4c6-eb41f6c82bf8-kube-api-access-lhth4\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x9x9t\" (UID: \"95e2b253-1089-49c8-b4c6-eb41f6c82bf8\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x9x9t"
Sep 16 02:24:43.201284 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.201259    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x9x9t"
Sep 16 02:24:43.216862 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.216835    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvtbr\" (UniqueName: \"kubernetes.io/projected/9079a184-955c-4e2c-95f9-960e0d5b67fc-kube-api-access-tvtbr\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l8kwb\" (UID: \"9079a184-955c-4e2c-95f9-960e0d5b67fc\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l8kwb"
Sep 16 02:24:43.216989 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.216879    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/367d197e-a9c3-4b0d-997c-9e022d2e2206-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6jqcv\" (UID: \"367d197e-a9c3-4b0d-997c-9e022d2e2206\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6jqcv"
Sep 16 02:24:43.216989 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.216963    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmcsf\" (UniqueName: \"kubernetes.io/projected/367d197e-a9c3-4b0d-997c-9e022d2e2206-kube-api-access-cmcsf\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6jqcv\" (UID: \"367d197e-a9c3-4b0d-997c-9e022d2e2206\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6jqcv"
Sep 16 02:24:43.217115 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.217002    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9079a184-955c-4e2c-95f9-960e0d5b67fc-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l8kwb\" (UID: \"9079a184-955c-4e2c-95f9-960e0d5b67fc\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l8kwb"
Sep 16 02:24:43.217115 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.217049    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/367d197e-a9c3-4b0d-997c-9e022d2e2206-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6jqcv\" (UID: \"367d197e-a9c3-4b0d-997c-9e022d2e2206\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6jqcv"
Sep 16 02:24:43.217227 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.217124    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9079a184-955c-4e2c-95f9-960e0d5b67fc-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l8kwb\" (UID: \"9079a184-955c-4e2c-95f9-960e0d5b67fc\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l8kwb"
Sep 16 02:24:43.217281 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.217239    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/367d197e-a9c3-4b0d-997c-9e022d2e2206-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6jqcv\" (UID: \"367d197e-a9c3-4b0d-997c-9e022d2e2206\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6jqcv"
Sep 16 02:24:43.217407 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.217389    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/367d197e-a9c3-4b0d-997c-9e022d2e2206-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6jqcv\" (UID: \"367d197e-a9c3-4b0d-997c-9e022d2e2206\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6jqcv"
Sep 16 02:24:43.225003 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.224983    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmcsf\" (UniqueName: \"kubernetes.io/projected/367d197e-a9c3-4b0d-997c-9e022d2e2206-kube-api-access-cmcsf\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6jqcv\" (UID: \"367d197e-a9c3-4b0d-997c-9e022d2e2206\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6jqcv"
Sep 16 02:24:43.303785 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.303761    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6jqcv"
Sep 16 02:24:43.317717 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.317693    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9079a184-955c-4e2c-95f9-960e0d5b67fc-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l8kwb\" (UID: \"9079a184-955c-4e2c-95f9-960e0d5b67fc\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l8kwb"
Sep 16 02:24:43.317818 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.317757    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9079a184-955c-4e2c-95f9-960e0d5b67fc-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l8kwb\" (UID: \"9079a184-955c-4e2c-95f9-960e0d5b67fc\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l8kwb"
Sep 16 02:24:43.317868 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.317822    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvtbr\" (UniqueName: \"kubernetes.io/projected/9079a184-955c-4e2c-95f9-960e0d5b67fc-kube-api-access-tvtbr\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l8kwb\" (UID: \"9079a184-955c-4e2c-95f9-960e0d5b67fc\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l8kwb"
Sep 16 02:24:43.318071 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.318054    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9079a184-955c-4e2c-95f9-960e0d5b67fc-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l8kwb\" (UID: \"9079a184-955c-4e2c-95f9-960e0d5b67fc\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l8kwb"
Sep 16 02:24:43.318105 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.318091    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9079a184-955c-4e2c-95f9-960e0d5b67fc-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l8kwb\" (UID: \"9079a184-955c-4e2c-95f9-960e0d5b67fc\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l8kwb"
Sep 16 02:24:43.325690 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.325663    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvtbr\" (UniqueName: \"kubernetes.io/projected/9079a184-955c-4e2c-95f9-960e0d5b67fc-kube-api-access-tvtbr\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l8kwb\" (UID: \"9079a184-955c-4e2c-95f9-960e0d5b67fc\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l8kwb"
Sep 16 02:24:43.376565 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.376539    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmd5n"]
Sep 16 02:24:43.378816 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:24:43.378790    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9057a1cb_9423_4448_b8f9_af8a82c96447.slice/crio-fa95330dfac16084da99c82fbf4d909ce6a9294c76e04d67e7c10da2479342a6 WatchSource:0}: Error finding container fa95330dfac16084da99c82fbf4d909ce6a9294c76e04d67e7c10da2479342a6: Status 404 returned error can't find the container with id fa95330dfac16084da99c82fbf4d909ce6a9294c76e04d67e7c10da2479342a6
Sep 16 02:24:43.408072 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.408050    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l8kwb"
Sep 16 02:24:43.470041 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.470016    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x9x9t"]
Sep 16 02:24:43.472583 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:24:43.472558    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95e2b253_1089_49c8_b4c6_eb41f6c82bf8.slice/crio-7a0582dcb0f1eb3f40655c95801d4e4fd2128eb2b3737e51639d2993fcb9e809 WatchSource:0}: Error finding container 7a0582dcb0f1eb3f40655c95801d4e4fd2128eb2b3737e51639d2993fcb9e809: Status 404 returned error can't find the container with id 7a0582dcb0f1eb3f40655c95801d4e4fd2128eb2b3737e51639d2993fcb9e809
Sep 16 02:24:43.574238 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.574218    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6jqcv"]
Sep 16 02:24:43.680884 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:43.680798    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l8kwb"]
Sep 16 02:24:43.683309 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:24:43.683285    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9079a184_955c_4e2c_95f9_960e0d5b67fc.slice/crio-a47662dc175092c2188393dcd632734211c92cca3ac00d30b6d1848bd2e48d30 WatchSource:0}: Error finding container a47662dc175092c2188393dcd632734211c92cca3ac00d30b6d1848bd2e48d30: Status 404 returned error can't find the container with id a47662dc175092c2188393dcd632734211c92cca3ac00d30b6d1848bd2e48d30
Sep 16 02:24:44.075946 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:44.075915    2565 generic.go:356] "Generic (PLEG): container finished" podID="9079a184-955c-4e2c-95f9-960e0d5b67fc" containerID="0ba34f7cd7046d2109a658705de967985a14a4e51c40b3a82079d16e20a72227" exitCode=0
Sep 16 02:24:44.076310 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:44.075997    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l8kwb" event={"ID":"9079a184-955c-4e2c-95f9-960e0d5b67fc","Type":"ContainerDied","Data":"0ba34f7cd7046d2109a658705de967985a14a4e51c40b3a82079d16e20a72227"}
Sep 16 02:24:44.076310 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:44.076056    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l8kwb" event={"ID":"9079a184-955c-4e2c-95f9-960e0d5b67fc","Type":"ContainerStarted","Data":"a47662dc175092c2188393dcd632734211c92cca3ac00d30b6d1848bd2e48d30"}
Sep 16 02:24:44.077669 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:44.077647    2565 generic.go:356] "Generic (PLEG): container finished" podID="9057a1cb-9423-4448-b8f9-af8a82c96447" containerID="401d7a52a56cefe332537fcf638a3aa2925e3657b5b5254ef08b2b365373de3b" exitCode=0
Sep 16 02:24:44.077783 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:44.077677    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmd5n" event={"ID":"9057a1cb-9423-4448-b8f9-af8a82c96447","Type":"ContainerDied","Data":"401d7a52a56cefe332537fcf638a3aa2925e3657b5b5254ef08b2b365373de3b"}
Sep 16 02:24:44.077783 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:44.077721    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmd5n" event={"ID":"9057a1cb-9423-4448-b8f9-af8a82c96447","Type":"ContainerStarted","Data":"fa95330dfac16084da99c82fbf4d909ce6a9294c76e04d67e7c10da2479342a6"}
Sep 16 02:24:44.079434 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:44.079413    2565 generic.go:356] "Generic (PLEG): container finished" podID="367d197e-a9c3-4b0d-997c-9e022d2e2206" containerID="1186cad4774ac5dc90a580479dc9fb8dbafbe9ca4258b02f35459a39de4d08e7" exitCode=0
Sep 16 02:24:44.079533 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:44.079488    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6jqcv" event={"ID":"367d197e-a9c3-4b0d-997c-9e022d2e2206","Type":"ContainerDied","Data":"1186cad4774ac5dc90a580479dc9fb8dbafbe9ca4258b02f35459a39de4d08e7"}
Sep 16 02:24:44.079686 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:44.079545    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6jqcv" event={"ID":"367d197e-a9c3-4b0d-997c-9e022d2e2206","Type":"ContainerStarted","Data":"966d46198fd071c6d5f3380cb7bd2fdd321330e0638a86a92f72c0f5273bd548"}
Sep 16 02:24:44.081319 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:44.081297    2565 generic.go:356] "Generic (PLEG): container finished" podID="95e2b253-1089-49c8-b4c6-eb41f6c82bf8" containerID="71e313564f77e4a7daa6d42f3d7b73d8ed35c41cb596878c032ed7612dd87167" exitCode=0
Sep 16 02:24:44.081431 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:44.081408    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x9x9t" event={"ID":"95e2b253-1089-49c8-b4c6-eb41f6c82bf8","Type":"ContainerDied","Data":"71e313564f77e4a7daa6d42f3d7b73d8ed35c41cb596878c032ed7612dd87167"}
Sep 16 02:24:44.081497 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:44.081469    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x9x9t" event={"ID":"95e2b253-1089-49c8-b4c6-eb41f6c82bf8","Type":"ContainerStarted","Data":"7a0582dcb0f1eb3f40655c95801d4e4fd2128eb2b3737e51639d2993fcb9e809"}
Sep 16 02:24:45.090319 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:45.090288    2565 generic.go:356] "Generic (PLEG): container finished" podID="9079a184-955c-4e2c-95f9-960e0d5b67fc" containerID="a07fb8946d830085ee847e7339f16e5a98f7e93ed576843bf0fd06a22333c0eb" exitCode=0
Sep 16 02:24:45.090667 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:45.090379    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l8kwb" event={"ID":"9079a184-955c-4e2c-95f9-960e0d5b67fc","Type":"ContainerDied","Data":"a07fb8946d830085ee847e7339f16e5a98f7e93ed576843bf0fd06a22333c0eb"}
Sep 16 02:24:45.092445 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:45.092425    2565 generic.go:356] "Generic (PLEG): container finished" podID="367d197e-a9c3-4b0d-997c-9e022d2e2206" containerID="9d9592b21cfaf6adcf819064490dec6e7e5144c4305054f3244fd727639d63d8" exitCode=0
Sep 16 02:24:45.092553 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:45.092450    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6jqcv" event={"ID":"367d197e-a9c3-4b0d-997c-9e022d2e2206","Type":"ContainerDied","Data":"9d9592b21cfaf6adcf819064490dec6e7e5144c4305054f3244fd727639d63d8"}
Sep 16 02:24:45.094338 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:45.094320    2565 generic.go:356] "Generic (PLEG): container finished" podID="95e2b253-1089-49c8-b4c6-eb41f6c82bf8" containerID="984755a2bf3a50754fdfcec98356ae98047320c5cab829d4ab6ded3ea2d7a80f" exitCode=0
Sep 16 02:24:45.094436 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:45.094395    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x9x9t" event={"ID":"95e2b253-1089-49c8-b4c6-eb41f6c82bf8","Type":"ContainerDied","Data":"984755a2bf3a50754fdfcec98356ae98047320c5cab829d4ab6ded3ea2d7a80f"}
Sep 16 02:24:46.101562 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:46.101528    2565 generic.go:356] "Generic (PLEG): container finished" podID="367d197e-a9c3-4b0d-997c-9e022d2e2206" containerID="cf5c34251a4815ebc76f6c29b092a842238138dbd5215698d835bdbcca7201dc" exitCode=0
Sep 16 02:24:46.101909 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:46.101609    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6jqcv" event={"ID":"367d197e-a9c3-4b0d-997c-9e022d2e2206","Type":"ContainerDied","Data":"cf5c34251a4815ebc76f6c29b092a842238138dbd5215698d835bdbcca7201dc"}
Sep 16 02:24:46.103673 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:46.103654    2565 generic.go:356] "Generic (PLEG): container finished" podID="95e2b253-1089-49c8-b4c6-eb41f6c82bf8" containerID="676f81b4f5d5380dcbd7077e993d1d3aee1ec98a67a07ea874f62b2e7c308d4d" exitCode=0
Sep 16 02:24:46.103725 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:46.103680    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x9x9t" event={"ID":"95e2b253-1089-49c8-b4c6-eb41f6c82bf8","Type":"ContainerDied","Data":"676f81b4f5d5380dcbd7077e993d1d3aee1ec98a67a07ea874f62b2e7c308d4d"}
Sep 16 02:24:46.105845 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:46.105823    2565 generic.go:356] "Generic (PLEG): container finished" podID="9079a184-955c-4e2c-95f9-960e0d5b67fc" containerID="6d8881a082d78a7f94f838aa5b7d7082ff0f2f91288ced268e1dfb8cff02d18c" exitCode=0
Sep 16 02:24:46.105942 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:46.105908    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l8kwb" event={"ID":"9079a184-955c-4e2c-95f9-960e0d5b67fc","Type":"ContainerDied","Data":"6d8881a082d78a7f94f838aa5b7d7082ff0f2f91288ced268e1dfb8cff02d18c"}
Sep 16 02:24:46.107524 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:46.107506    2565 generic.go:356] "Generic (PLEG): container finished" podID="9057a1cb-9423-4448-b8f9-af8a82c96447" containerID="d0a913aba48586f9fe6af1e27e7a4a9ac8bc71d04ea1c3a11627f3338323602e" exitCode=0
Sep 16 02:24:46.107603 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:46.107529    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmd5n" event={"ID":"9057a1cb-9423-4448-b8f9-af8a82c96447","Type":"ContainerDied","Data":"d0a913aba48586f9fe6af1e27e7a4a9ac8bc71d04ea1c3a11627f3338323602e"}
Sep 16 02:24:47.114754 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.114712    2565 generic.go:356] "Generic (PLEG): container finished" podID="9057a1cb-9423-4448-b8f9-af8a82c96447" containerID="e8eab43717729364296a9340e61a062438add7a3ce9e55c9baca1c4458632aab" exitCode=0
Sep 16 02:24:47.115143 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.114791    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmd5n" event={"ID":"9057a1cb-9423-4448-b8f9-af8a82c96447","Type":"ContainerDied","Data":"e8eab43717729364296a9340e61a062438add7a3ce9e55c9baca1c4458632aab"}
Sep 16 02:24:47.252541 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.252517    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x9x9t"
Sep 16 02:24:47.298572 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.298552    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6jqcv"
Sep 16 02:24:47.301796 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.301776    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l8kwb"
Sep 16 02:24:47.350316 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.350292    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95e2b253-1089-49c8-b4c6-eb41f6c82bf8-bundle\") pod \"95e2b253-1089-49c8-b4c6-eb41f6c82bf8\" (UID: \"95e2b253-1089-49c8-b4c6-eb41f6c82bf8\") "
Sep 16 02:24:47.350445 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.350320    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/367d197e-a9c3-4b0d-997c-9e022d2e2206-bundle\") pod \"367d197e-a9c3-4b0d-997c-9e022d2e2206\" (UID: \"367d197e-a9c3-4b0d-997c-9e022d2e2206\") "
Sep 16 02:24:47.350445 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.350405    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvtbr\" (UniqueName: \"kubernetes.io/projected/9079a184-955c-4e2c-95f9-960e0d5b67fc-kube-api-access-tvtbr\") pod \"9079a184-955c-4e2c-95f9-960e0d5b67fc\" (UID: \"9079a184-955c-4e2c-95f9-960e0d5b67fc\") "
Sep 16 02:24:47.350445 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.350439    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/367d197e-a9c3-4b0d-997c-9e022d2e2206-util\") pod \"367d197e-a9c3-4b0d-997c-9e022d2e2206\" (UID: \"367d197e-a9c3-4b0d-997c-9e022d2e2206\") "
Sep 16 02:24:47.350582 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.350489    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhth4\" (UniqueName: \"kubernetes.io/projected/95e2b253-1089-49c8-b4c6-eb41f6c82bf8-kube-api-access-lhth4\") pod \"95e2b253-1089-49c8-b4c6-eb41f6c82bf8\" (UID: \"95e2b253-1089-49c8-b4c6-eb41f6c82bf8\") "
Sep 16 02:24:47.350582 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.350517    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95e2b253-1089-49c8-b4c6-eb41f6c82bf8-util\") pod \"95e2b253-1089-49c8-b4c6-eb41f6c82bf8\" (UID: \"95e2b253-1089-49c8-b4c6-eb41f6c82bf8\") "
Sep 16 02:24:47.350582 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.350556    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmcsf\" (UniqueName: \"kubernetes.io/projected/367d197e-a9c3-4b0d-997c-9e022d2e2206-kube-api-access-cmcsf\") pod \"367d197e-a9c3-4b0d-997c-9e022d2e2206\" (UID: \"367d197e-a9c3-4b0d-997c-9e022d2e2206\") "
Sep 16 02:24:47.350716 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.350583    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9079a184-955c-4e2c-95f9-960e0d5b67fc-util\") pod \"9079a184-955c-4e2c-95f9-960e0d5b67fc\" (UID: \"9079a184-955c-4e2c-95f9-960e0d5b67fc\") "
Sep 16 02:24:47.350716 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.350624    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9079a184-955c-4e2c-95f9-960e0d5b67fc-bundle\") pod \"9079a184-955c-4e2c-95f9-960e0d5b67fc\" (UID: \"9079a184-955c-4e2c-95f9-960e0d5b67fc\") "
Sep 16 02:24:47.351381 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.351071    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/367d197e-a9c3-4b0d-997c-9e022d2e2206-bundle" (OuterVolumeSpecName: "bundle") pod "367d197e-a9c3-4b0d-997c-9e022d2e2206" (UID: "367d197e-a9c3-4b0d-997c-9e022d2e2206"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:24:47.351381 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.351100    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95e2b253-1089-49c8-b4c6-eb41f6c82bf8-bundle" (OuterVolumeSpecName: "bundle") pod "95e2b253-1089-49c8-b4c6-eb41f6c82bf8" (UID: "95e2b253-1089-49c8-b4c6-eb41f6c82bf8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:24:47.351524 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.351416    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9079a184-955c-4e2c-95f9-960e0d5b67fc-bundle" (OuterVolumeSpecName: "bundle") pod "9079a184-955c-4e2c-95f9-960e0d5b67fc" (UID: "9079a184-955c-4e2c-95f9-960e0d5b67fc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:24:47.353085 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.353055    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9079a184-955c-4e2c-95f9-960e0d5b67fc-kube-api-access-tvtbr" (OuterVolumeSpecName: "kube-api-access-tvtbr") pod "9079a184-955c-4e2c-95f9-960e0d5b67fc" (UID: "9079a184-955c-4e2c-95f9-960e0d5b67fc"). InnerVolumeSpecName "kube-api-access-tvtbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:24:47.353182 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.353088    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95e2b253-1089-49c8-b4c6-eb41f6c82bf8-kube-api-access-lhth4" (OuterVolumeSpecName: "kube-api-access-lhth4") pod "95e2b253-1089-49c8-b4c6-eb41f6c82bf8" (UID: "95e2b253-1089-49c8-b4c6-eb41f6c82bf8"). InnerVolumeSpecName "kube-api-access-lhth4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:24:47.353237 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.353200    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/367d197e-a9c3-4b0d-997c-9e022d2e2206-kube-api-access-cmcsf" (OuterVolumeSpecName: "kube-api-access-cmcsf") pod "367d197e-a9c3-4b0d-997c-9e022d2e2206" (UID: "367d197e-a9c3-4b0d-997c-9e022d2e2206"). InnerVolumeSpecName "kube-api-access-cmcsf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:24:47.356979 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.356941    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95e2b253-1089-49c8-b4c6-eb41f6c82bf8-util" (OuterVolumeSpecName: "util") pod "95e2b253-1089-49c8-b4c6-eb41f6c82bf8" (UID: "95e2b253-1089-49c8-b4c6-eb41f6c82bf8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:24:47.359295 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.359255    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/367d197e-a9c3-4b0d-997c-9e022d2e2206-util" (OuterVolumeSpecName: "util") pod "367d197e-a9c3-4b0d-997c-9e022d2e2206" (UID: "367d197e-a9c3-4b0d-997c-9e022d2e2206"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:24:47.359990 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.359970    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9079a184-955c-4e2c-95f9-960e0d5b67fc-util" (OuterVolumeSpecName: "util") pod "9079a184-955c-4e2c-95f9-960e0d5b67fc" (UID: "9079a184-955c-4e2c-95f9-960e0d5b67fc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:24:47.451693 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.451453    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95e2b253-1089-49c8-b4c6-eb41f6c82bf8-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:24:47.451693 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.451479    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/367d197e-a9c3-4b0d-997c-9e022d2e2206-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:24:47.451693 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.451493    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvtbr\" (UniqueName: \"kubernetes.io/projected/9079a184-955c-4e2c-95f9-960e0d5b67fc-kube-api-access-tvtbr\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:24:47.451693 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.451506    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/367d197e-a9c3-4b0d-997c-9e022d2e2206-util\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:24:47.451693 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.451519    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhth4\" (UniqueName: \"kubernetes.io/projected/95e2b253-1089-49c8-b4c6-eb41f6c82bf8-kube-api-access-lhth4\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:24:47.451693 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.451531    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95e2b253-1089-49c8-b4c6-eb41f6c82bf8-util\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:24:47.451693 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.451546    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmcsf\" (UniqueName: \"kubernetes.io/projected/367d197e-a9c3-4b0d-997c-9e022d2e2206-kube-api-access-cmcsf\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:24:47.451693 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.451559    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9079a184-955c-4e2c-95f9-960e0d5b67fc-util\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:24:47.451693 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:47.451574    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9079a184-955c-4e2c-95f9-960e0d5b67fc-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:24:48.121914 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:48.121880    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l8kwb"
Sep 16 02:24:48.122307 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:48.121908    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l8kwb" event={"ID":"9079a184-955c-4e2c-95f9-960e0d5b67fc","Type":"ContainerDied","Data":"a47662dc175092c2188393dcd632734211c92cca3ac00d30b6d1848bd2e48d30"}
Sep 16 02:24:48.122307 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:48.121954    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a47662dc175092c2188393dcd632734211c92cca3ac00d30b6d1848bd2e48d30"
Sep 16 02:24:48.124010 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:48.123989    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6jqcv" event={"ID":"367d197e-a9c3-4b0d-997c-9e022d2e2206","Type":"ContainerDied","Data":"966d46198fd071c6d5f3380cb7bd2fdd321330e0638a86a92f72c0f5273bd548"}
Sep 16 02:24:48.124131 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:48.124008    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6jqcv"
Sep 16 02:24:48.124131 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:48.124037    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="966d46198fd071c6d5f3380cb7bd2fdd321330e0638a86a92f72c0f5273bd548"
Sep 16 02:24:48.126176 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:48.126149    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x9x9t"
Sep 16 02:24:48.126264 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:48.126200    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x9x9t" event={"ID":"95e2b253-1089-49c8-b4c6-eb41f6c82bf8","Type":"ContainerDied","Data":"7a0582dcb0f1eb3f40655c95801d4e4fd2128eb2b3737e51639d2993fcb9e809"}
Sep 16 02:24:48.126264 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:48.126239    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a0582dcb0f1eb3f40655c95801d4e4fd2128eb2b3737e51639d2993fcb9e809"
Sep 16 02:24:48.247019 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:48.246997    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmd5n"
Sep 16 02:24:48.358134 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:48.358112    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9057a1cb-9423-4448-b8f9-af8a82c96447-util\") pod \"9057a1cb-9423-4448-b8f9-af8a82c96447\" (UID: \"9057a1cb-9423-4448-b8f9-af8a82c96447\") "
Sep 16 02:24:48.358258 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:48.358146    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7l6sx\" (UniqueName: \"kubernetes.io/projected/9057a1cb-9423-4448-b8f9-af8a82c96447-kube-api-access-7l6sx\") pod \"9057a1cb-9423-4448-b8f9-af8a82c96447\" (UID: \"9057a1cb-9423-4448-b8f9-af8a82c96447\") "
Sep 16 02:24:48.358258 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:48.358224    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9057a1cb-9423-4448-b8f9-af8a82c96447-bundle\") pod \"9057a1cb-9423-4448-b8f9-af8a82c96447\" (UID: \"9057a1cb-9423-4448-b8f9-af8a82c96447\") "
Sep 16 02:24:48.358932 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:48.358905    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9057a1cb-9423-4448-b8f9-af8a82c96447-bundle" (OuterVolumeSpecName: "bundle") pod "9057a1cb-9423-4448-b8f9-af8a82c96447" (UID: "9057a1cb-9423-4448-b8f9-af8a82c96447"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:24:48.360245 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:48.360218    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9057a1cb-9423-4448-b8f9-af8a82c96447-kube-api-access-7l6sx" (OuterVolumeSpecName: "kube-api-access-7l6sx") pod "9057a1cb-9423-4448-b8f9-af8a82c96447" (UID: "9057a1cb-9423-4448-b8f9-af8a82c96447"). InnerVolumeSpecName "kube-api-access-7l6sx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:24:48.363759 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:48.363734    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9057a1cb-9423-4448-b8f9-af8a82c96447-util" (OuterVolumeSpecName: "util") pod "9057a1cb-9423-4448-b8f9-af8a82c96447" (UID: "9057a1cb-9423-4448-b8f9-af8a82c96447"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:24:48.459693 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:48.459668    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7l6sx\" (UniqueName: \"kubernetes.io/projected/9057a1cb-9423-4448-b8f9-af8a82c96447-kube-api-access-7l6sx\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:24:48.459693 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:48.459691    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9057a1cb-9423-4448-b8f9-af8a82c96447-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:24:48.459815 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:48.459701    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9057a1cb-9423-4448-b8f9-af8a82c96447-util\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:24:49.132812 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.132780    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmd5n" event={"ID":"9057a1cb-9423-4448-b8f9-af8a82c96447","Type":"ContainerDied","Data":"fa95330dfac16084da99c82fbf4d909ce6a9294c76e04d67e7c10da2479342a6"}
Sep 16 02:24:49.133154 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.132824    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa95330dfac16084da99c82fbf4d909ce6a9294c76e04d67e7c10da2479342a6"
Sep 16 02:24:49.133154 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.132825    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmd5n"
Sep 16 02:24:49.781981 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.781942    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cc69984b8-wjjq4"]
Sep 16 02:24:49.782306 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.782293    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="367d197e-a9c3-4b0d-997c-9e022d2e2206" containerName="util"
Sep 16 02:24:49.782377 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.782307    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="367d197e-a9c3-4b0d-997c-9e022d2e2206" containerName="util"
Sep 16 02:24:49.782377 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.782315    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="367d197e-a9c3-4b0d-997c-9e022d2e2206" containerName="extract"
Sep 16 02:24:49.782377 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.782321    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="367d197e-a9c3-4b0d-997c-9e022d2e2206" containerName="extract"
Sep 16 02:24:49.782377 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.782333    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9057a1cb-9423-4448-b8f9-af8a82c96447" containerName="pull"
Sep 16 02:24:49.782377 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.782338    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9057a1cb-9423-4448-b8f9-af8a82c96447" containerName="pull"
Sep 16 02:24:49.782377 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.782346    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9079a184-955c-4e2c-95f9-960e0d5b67fc" containerName="util"
Sep 16 02:24:49.782377 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.782351    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9079a184-955c-4e2c-95f9-960e0d5b67fc" containerName="util"
Sep 16 02:24:49.782377 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.782371    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="367d197e-a9c3-4b0d-997c-9e022d2e2206" containerName="pull"
Sep 16 02:24:49.782377 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.782377    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="367d197e-a9c3-4b0d-997c-9e022d2e2206" containerName="pull"
Sep 16 02:24:49.782667 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.782384    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95e2b253-1089-49c8-b4c6-eb41f6c82bf8" containerName="extract"
Sep 16 02:24:49.782667 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.782390    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="95e2b253-1089-49c8-b4c6-eb41f6c82bf8" containerName="extract"
Sep 16 02:24:49.782667 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.782398    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9057a1cb-9423-4448-b8f9-af8a82c96447" containerName="extract"
Sep 16 02:24:49.782667 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.782403    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9057a1cb-9423-4448-b8f9-af8a82c96447" containerName="extract"
Sep 16 02:24:49.782667 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.782411    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9079a184-955c-4e2c-95f9-960e0d5b67fc" containerName="extract"
Sep 16 02:24:49.782667 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.782416    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9079a184-955c-4e2c-95f9-960e0d5b67fc" containerName="extract"
Sep 16 02:24:49.782667 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.782423    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95e2b253-1089-49c8-b4c6-eb41f6c82bf8" containerName="pull"
Sep 16 02:24:49.782667 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.782428    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="95e2b253-1089-49c8-b4c6-eb41f6c82bf8" containerName="pull"
Sep 16 02:24:49.782667 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.782437    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95e2b253-1089-49c8-b4c6-eb41f6c82bf8" containerName="util"
Sep 16 02:24:49.782667 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.782442    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="95e2b253-1089-49c8-b4c6-eb41f6c82bf8" containerName="util"
Sep 16 02:24:49.782667 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.782447    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9079a184-955c-4e2c-95f9-960e0d5b67fc" containerName="pull"
Sep 16 02:24:49.782667 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.782452    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9079a184-955c-4e2c-95f9-960e0d5b67fc" containerName="pull"
Sep 16 02:24:49.782667 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.782458    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9057a1cb-9423-4448-b8f9-af8a82c96447" containerName="util"
Sep 16 02:24:49.782667 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.782462    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9057a1cb-9423-4448-b8f9-af8a82c96447" containerName="util"
Sep 16 02:24:49.782667 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.782509    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="95e2b253-1089-49c8-b4c6-eb41f6c82bf8" containerName="extract"
Sep 16 02:24:49.782667 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.782517    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9057a1cb-9423-4448-b8f9-af8a82c96447" containerName="extract"
Sep 16 02:24:49.782667 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.782522    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="367d197e-a9c3-4b0d-997c-9e022d2e2206" containerName="extract"
Sep 16 02:24:49.782667 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.782527    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9079a184-955c-4e2c-95f9-960e0d5b67fc" containerName="extract"
Sep 16 02:24:49.785542 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.785526    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cc69984b8-wjjq4"
Sep 16 02:24:49.797139 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.797111    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cc69984b8-wjjq4"]
Sep 16 02:24:49.837820 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.837792    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:24:49.871927 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.871903    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/822095f4-8797-46dc-9f8a-23e8f3266271-oauth-serving-cert\") pod \"console-5cc69984b8-wjjq4\" (UID: \"822095f4-8797-46dc-9f8a-23e8f3266271\") " pod="openshift-console/console-5cc69984b8-wjjq4"
Sep 16 02:24:49.872006 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.871941    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/822095f4-8797-46dc-9f8a-23e8f3266271-console-serving-cert\") pod \"console-5cc69984b8-wjjq4\" (UID: \"822095f4-8797-46dc-9f8a-23e8f3266271\") " pod="openshift-console/console-5cc69984b8-wjjq4"
Sep 16 02:24:49.872006 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.871964    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/822095f4-8797-46dc-9f8a-23e8f3266271-console-oauth-config\") pod \"console-5cc69984b8-wjjq4\" (UID: \"822095f4-8797-46dc-9f8a-23e8f3266271\") " pod="openshift-console/console-5cc69984b8-wjjq4"
Sep 16 02:24:49.872075 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.872047    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/822095f4-8797-46dc-9f8a-23e8f3266271-service-ca\") pod \"console-5cc69984b8-wjjq4\" (UID: \"822095f4-8797-46dc-9f8a-23e8f3266271\") " pod="openshift-console/console-5cc69984b8-wjjq4"
Sep 16 02:24:49.872107 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.872079    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/822095f4-8797-46dc-9f8a-23e8f3266271-console-config\") pod \"console-5cc69984b8-wjjq4\" (UID: \"822095f4-8797-46dc-9f8a-23e8f3266271\") " pod="openshift-console/console-5cc69984b8-wjjq4"
Sep 16 02:24:49.872157 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.872107    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9lbb\" (UniqueName: \"kubernetes.io/projected/822095f4-8797-46dc-9f8a-23e8f3266271-kube-api-access-c9lbb\") pod \"console-5cc69984b8-wjjq4\" (UID: \"822095f4-8797-46dc-9f8a-23e8f3266271\") " pod="openshift-console/console-5cc69984b8-wjjq4"
Sep 16 02:24:49.872190 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.872154    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/822095f4-8797-46dc-9f8a-23e8f3266271-trusted-ca-bundle\") pod \"console-5cc69984b8-wjjq4\" (UID: \"822095f4-8797-46dc-9f8a-23e8f3266271\") " pod="openshift-console/console-5cc69984b8-wjjq4"
Sep 16 02:24:49.885518 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.885490    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:24:49.973299 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.973269    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/822095f4-8797-46dc-9f8a-23e8f3266271-service-ca\") pod \"console-5cc69984b8-wjjq4\" (UID: \"822095f4-8797-46dc-9f8a-23e8f3266271\") " pod="openshift-console/console-5cc69984b8-wjjq4"
Sep 16 02:24:49.973464 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.973312    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/822095f4-8797-46dc-9f8a-23e8f3266271-console-config\") pod \"console-5cc69984b8-wjjq4\" (UID: \"822095f4-8797-46dc-9f8a-23e8f3266271\") " pod="openshift-console/console-5cc69984b8-wjjq4"
Sep 16 02:24:49.973464 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.973353    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9lbb\" (UniqueName: \"kubernetes.io/projected/822095f4-8797-46dc-9f8a-23e8f3266271-kube-api-access-c9lbb\") pod \"console-5cc69984b8-wjjq4\" (UID: \"822095f4-8797-46dc-9f8a-23e8f3266271\") " pod="openshift-console/console-5cc69984b8-wjjq4"
Sep 16 02:24:49.973464 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.973403    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/822095f4-8797-46dc-9f8a-23e8f3266271-trusted-ca-bundle\") pod \"console-5cc69984b8-wjjq4\" (UID: \"822095f4-8797-46dc-9f8a-23e8f3266271\") " pod="openshift-console/console-5cc69984b8-wjjq4"
Sep 16 02:24:49.973464 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.973440    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/822095f4-8797-46dc-9f8a-23e8f3266271-oauth-serving-cert\") pod \"console-5cc69984b8-wjjq4\" (UID: \"822095f4-8797-46dc-9f8a-23e8f3266271\") " pod="openshift-console/console-5cc69984b8-wjjq4"
Sep 16 02:24:49.973669 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.973486    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/822095f4-8797-46dc-9f8a-23e8f3266271-console-serving-cert\") pod \"console-5cc69984b8-wjjq4\" (UID: \"822095f4-8797-46dc-9f8a-23e8f3266271\") " pod="openshift-console/console-5cc69984b8-wjjq4"
Sep 16 02:24:49.973669 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.973521    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/822095f4-8797-46dc-9f8a-23e8f3266271-console-oauth-config\") pod \"console-5cc69984b8-wjjq4\" (UID: \"822095f4-8797-46dc-9f8a-23e8f3266271\") " pod="openshift-console/console-5cc69984b8-wjjq4"
Sep 16 02:24:49.974028 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.974000    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/822095f4-8797-46dc-9f8a-23e8f3266271-service-ca\") pod \"console-5cc69984b8-wjjq4\" (UID: \"822095f4-8797-46dc-9f8a-23e8f3266271\") " pod="openshift-console/console-5cc69984b8-wjjq4"
Sep 16 02:24:49.974242 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.974225    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/822095f4-8797-46dc-9f8a-23e8f3266271-console-config\") pod \"console-5cc69984b8-wjjq4\" (UID: \"822095f4-8797-46dc-9f8a-23e8f3266271\") " pod="openshift-console/console-5cc69984b8-wjjq4"
Sep 16 02:24:49.974309 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.974258    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/822095f4-8797-46dc-9f8a-23e8f3266271-oauth-serving-cert\") pod \"console-5cc69984b8-wjjq4\" (UID: \"822095f4-8797-46dc-9f8a-23e8f3266271\") " pod="openshift-console/console-5cc69984b8-wjjq4"
Sep 16 02:24:49.974309 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.974287    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/822095f4-8797-46dc-9f8a-23e8f3266271-trusted-ca-bundle\") pod \"console-5cc69984b8-wjjq4\" (UID: \"822095f4-8797-46dc-9f8a-23e8f3266271\") " pod="openshift-console/console-5cc69984b8-wjjq4"
Sep 16 02:24:49.975951 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.975919    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/822095f4-8797-46dc-9f8a-23e8f3266271-console-serving-cert\") pod \"console-5cc69984b8-wjjq4\" (UID: \"822095f4-8797-46dc-9f8a-23e8f3266271\") " pod="openshift-console/console-5cc69984b8-wjjq4"
Sep 16 02:24:49.975951 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.975940    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/822095f4-8797-46dc-9f8a-23e8f3266271-console-oauth-config\") pod \"console-5cc69984b8-wjjq4\" (UID: \"822095f4-8797-46dc-9f8a-23e8f3266271\") " pod="openshift-console/console-5cc69984b8-wjjq4"
Sep 16 02:24:49.980648 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:49.980628    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9lbb\" (UniqueName: \"kubernetes.io/projected/822095f4-8797-46dc-9f8a-23e8f3266271-kube-api-access-c9lbb\") pod \"console-5cc69984b8-wjjq4\" (UID: \"822095f4-8797-46dc-9f8a-23e8f3266271\") " pod="openshift-console/console-5cc69984b8-wjjq4"
Sep 16 02:24:50.095394 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:50.095313    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cc69984b8-wjjq4"
Sep 16 02:24:50.364543 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:50.364516    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cc69984b8-wjjq4"]
Sep 16 02:24:50.365765 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:24:50.365736    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod822095f4_8797_46dc_9f8a_23e8f3266271.slice/crio-ec704f4965b6ad30461509c9e83d445fd9baf7cbd78a276560a3971d10a74e19 WatchSource:0}: Error finding container ec704f4965b6ad30461509c9e83d445fd9baf7cbd78a276560a3971d10a74e19: Status 404 returned error can't find the container with id ec704f4965b6ad30461509c9e83d445fd9baf7cbd78a276560a3971d10a74e19
Sep 16 02:24:51.144577 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:51.144540    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cc69984b8-wjjq4" event={"ID":"822095f4-8797-46dc-9f8a-23e8f3266271","Type":"ContainerStarted","Data":"dace61f6472bb0311ded1c4258eee3b243f7f06314f825f9190d05c8338b718a"}
Sep 16 02:24:51.144720 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:51.144591    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cc69984b8-wjjq4" event={"ID":"822095f4-8797-46dc-9f8a-23e8f3266271","Type":"ContainerStarted","Data":"ec704f4965b6ad30461509c9e83d445fd9baf7cbd78a276560a3971d10a74e19"}
Sep 16 02:24:51.172016 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:51.171969    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cc69984b8-wjjq4" podStartSLOduration=2.171953068 podStartE2EDuration="2.171953068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:24:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:24:51.169279012 +0000 UTC m=+369.219623517" watchObservedRunningTime="2026-09-16 02:24:51.171953068 +0000 UTC m=+369.222297560"
Sep 16 02:24:51.553006 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:51.552978    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:24:52.356854 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:52.356822    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:24:55.402317 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:55.402283    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:24:55.513347 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:55.513314    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:24:55.606472 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:55.606442    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:24:57.601427 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:57.601393    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:24:57.769159 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:57.769117    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:24:59.767935 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:24:59.767903    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:00.076027 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:00.075943    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:00.095957 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:00.095926    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cc69984b8-wjjq4"
Sep 16 02:25:00.096040 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:00.095992    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cc69984b8-wjjq4"
Sep 16 02:25:00.101602 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:00.101578    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cc69984b8-wjjq4"
Sep 16 02:25:00.176087 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:00.176054    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:00.194907 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:00.194880    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cc69984b8-wjjq4"
Sep 16 02:25:00.246932 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:00.246895    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-857964cff9-rrkm5"]
Sep 16 02:25:00.375743 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:00.375664    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:00.481452 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:00.481422    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:00.573160 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:00.573127    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:00.675911 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:00.675880    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:00.773693 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:00.773656    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:01.416477 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:01.416442    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:05.368258 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:05.368194    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:05.469862 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:05.469824    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:05.957512 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:05.957463    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:06.007232 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:06.007202    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:09.373151 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:09.373117    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:09.480665 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:09.480634    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:10.960197 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:10.960164    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:11.038068 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:11.038032    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:11.215793 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:11.215718    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:11.464827 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:11.464781    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:17.317996 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:17.317951    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:17.414634 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:17.414601    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:17.467934 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:17.467907    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:25.171536 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:25.171482    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:25.266754 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:25.266718    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-857964cff9-rrkm5" podUID="7b8aba58-4742-47f5-9418-24bb303b3811" containerName="console" containerID="cri-o://6fbd6866e61e53f9ae75793faf0fa93485e0af664609524be6e840a1469eb6e6" gracePeriod=15
Sep 16 02:25:25.272042 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:25.271976    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:25.506865 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:25.506844    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-857964cff9-rrkm5"
Sep 16 02:25:25.555157 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:25.555133    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b8aba58-4742-47f5-9418-24bb303b3811-trusted-ca-bundle\") pod \"7b8aba58-4742-47f5-9418-24bb303b3811\" (UID: \"7b8aba58-4742-47f5-9418-24bb303b3811\") "
Sep 16 02:25:25.555263 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:25.555166    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w29vw\" (UniqueName: \"kubernetes.io/projected/7b8aba58-4742-47f5-9418-24bb303b3811-kube-api-access-w29vw\") pod \"7b8aba58-4742-47f5-9418-24bb303b3811\" (UID: \"7b8aba58-4742-47f5-9418-24bb303b3811\") "
Sep 16 02:25:25.555316 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:25.555299    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7b8aba58-4742-47f5-9418-24bb303b3811-service-ca\") pod \"7b8aba58-4742-47f5-9418-24bb303b3811\" (UID: \"7b8aba58-4742-47f5-9418-24bb303b3811\") "
Sep 16 02:25:25.555354 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:25.555338    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7b8aba58-4742-47f5-9418-24bb303b3811-console-oauth-config\") pod \"7b8aba58-4742-47f5-9418-24bb303b3811\" (UID: \"7b8aba58-4742-47f5-9418-24bb303b3811\") "
Sep 16 02:25:25.555421 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:25.555406    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7b8aba58-4742-47f5-9418-24bb303b3811-oauth-serving-cert\") pod \"7b8aba58-4742-47f5-9418-24bb303b3811\" (UID: \"7b8aba58-4742-47f5-9418-24bb303b3811\") "
Sep 16 02:25:25.555474 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:25.555441    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7b8aba58-4742-47f5-9418-24bb303b3811-console-config\") pod \"7b8aba58-4742-47f5-9418-24bb303b3811\" (UID: \"7b8aba58-4742-47f5-9418-24bb303b3811\") "
Sep 16 02:25:25.555474 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:25.555466    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b8aba58-4742-47f5-9418-24bb303b3811-console-serving-cert\") pod \"7b8aba58-4742-47f5-9418-24bb303b3811\" (UID: \"7b8aba58-4742-47f5-9418-24bb303b3811\") "
Sep 16 02:25:25.555620 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:25.555497    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b8aba58-4742-47f5-9418-24bb303b3811-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7b8aba58-4742-47f5-9418-24bb303b3811" (UID: "7b8aba58-4742-47f5-9418-24bb303b3811"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:25:25.555766 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:25.555742    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b8aba58-4742-47f5-9418-24bb303b3811-service-ca" (OuterVolumeSpecName: "service-ca") pod "7b8aba58-4742-47f5-9418-24bb303b3811" (UID: "7b8aba58-4742-47f5-9418-24bb303b3811"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:25:25.555853 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:25.555786    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b8aba58-4742-47f5-9418-24bb303b3811-trusted-ca-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:25:25.555853 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:25.555790    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b8aba58-4742-47f5-9418-24bb303b3811-console-config" (OuterVolumeSpecName: "console-config") pod "7b8aba58-4742-47f5-9418-24bb303b3811" (UID: "7b8aba58-4742-47f5-9418-24bb303b3811"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:25:25.555853 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:25.555804    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b8aba58-4742-47f5-9418-24bb303b3811-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7b8aba58-4742-47f5-9418-24bb303b3811" (UID: "7b8aba58-4742-47f5-9418-24bb303b3811"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:25:25.557222 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:25.557200    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b8aba58-4742-47f5-9418-24bb303b3811-kube-api-access-w29vw" (OuterVolumeSpecName: "kube-api-access-w29vw") pod "7b8aba58-4742-47f5-9418-24bb303b3811" (UID: "7b8aba58-4742-47f5-9418-24bb303b3811"). InnerVolumeSpecName "kube-api-access-w29vw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:25:25.557403 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:25.557382    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b8aba58-4742-47f5-9418-24bb303b3811-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7b8aba58-4742-47f5-9418-24bb303b3811" (UID: "7b8aba58-4742-47f5-9418-24bb303b3811"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:25:25.557567 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:25.557546    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b8aba58-4742-47f5-9418-24bb303b3811-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7b8aba58-4742-47f5-9418-24bb303b3811" (UID: "7b8aba58-4742-47f5-9418-24bb303b3811"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:25:25.656416 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:25.656393    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7b8aba58-4742-47f5-9418-24bb303b3811-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:25:25.656416 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:25.656413    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7b8aba58-4742-47f5-9418-24bb303b3811-console-oauth-config\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:25:25.656533 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:25.656422    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7b8aba58-4742-47f5-9418-24bb303b3811-oauth-serving-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:25:25.656533 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:25.656431    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7b8aba58-4742-47f5-9418-24bb303b3811-console-config\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:25:25.656533 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:25.656439    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b8aba58-4742-47f5-9418-24bb303b3811-console-serving-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:25:25.656533 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:25.656447    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w29vw\" (UniqueName: \"kubernetes.io/projected/7b8aba58-4742-47f5-9418-24bb303b3811-kube-api-access-w29vw\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:25:25.772843 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:25.772774    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:25.873626 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:25.873601    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:26.328622 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:26.328586    2565 generic.go:356] "Generic (PLEG): container finished" podID="7b8aba58-4742-47f5-9418-24bb303b3811" containerID="6fbd6866e61e53f9ae75793faf0fa93485e0af664609524be6e840a1469eb6e6" exitCode=0
Sep 16 02:25:26.329011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:26.328635    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-857964cff9-rrkm5"
Sep 16 02:25:26.329011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:26.328673    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-857964cff9-rrkm5" event={"ID":"7b8aba58-4742-47f5-9418-24bb303b3811","Type":"ContainerDied","Data":"6fbd6866e61e53f9ae75793faf0fa93485e0af664609524be6e840a1469eb6e6"}
Sep 16 02:25:26.329011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:26.328731    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-857964cff9-rrkm5" event={"ID":"7b8aba58-4742-47f5-9418-24bb303b3811","Type":"ContainerDied","Data":"a1ffe7361ab520e7b3e77d0ab83dbf4d5109a67e4758e11ea8b4a1d17173851e"}
Sep 16 02:25:26.329011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:26.328757    2565 scope.go:117] "RemoveContainer" containerID="6fbd6866e61e53f9ae75793faf0fa93485e0af664609524be6e840a1469eb6e6"
Sep 16 02:25:26.338918 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:26.338897    2565 scope.go:117] "RemoveContainer" containerID="6fbd6866e61e53f9ae75793faf0fa93485e0af664609524be6e840a1469eb6e6"
Sep 16 02:25:26.339204 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:25:26.339187    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fbd6866e61e53f9ae75793faf0fa93485e0af664609524be6e840a1469eb6e6\": container with ID starting with 6fbd6866e61e53f9ae75793faf0fa93485e0af664609524be6e840a1469eb6e6 not found: ID does not exist" containerID="6fbd6866e61e53f9ae75793faf0fa93485e0af664609524be6e840a1469eb6e6"
Sep 16 02:25:26.339258 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:26.339211    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fbd6866e61e53f9ae75793faf0fa93485e0af664609524be6e840a1469eb6e6"} err="failed to get container status \"6fbd6866e61e53f9ae75793faf0fa93485e0af664609524be6e840a1469eb6e6\": rpc error: code = NotFound desc = could not find container \"6fbd6866e61e53f9ae75793faf0fa93485e0af664609524be6e840a1469eb6e6\": container with ID starting with 6fbd6866e61e53f9ae75793faf0fa93485e0af664609524be6e840a1469eb6e6 not found: ID does not exist"
Sep 16 02:25:26.352194 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:26.352166    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-857964cff9-rrkm5"]
Sep 16 02:25:26.354701 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:26.354674    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-857964cff9-rrkm5"]
Sep 16 02:25:26.390590 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:26.390568    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b8aba58-4742-47f5-9418-24bb303b3811" path="/var/lib/kubelet/pods/7b8aba58-4742-47f5-9418-24bb303b3811/volumes"
Sep 16 02:25:29.157425 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:29.157390    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:29.257825 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:29.257798    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:31.550596 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:31.550542    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:31.651444 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:31.651413    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:35.154510 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:35.154460    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:35.254939 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:35.254907    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:37.374604 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:37.374569    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:37.475505 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:37.475476    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:37.548421 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:37.548389    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:53.350458 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:53.350421    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:53.477733 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:53.477700    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:55.692551 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:55.692514    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:25:55.793665 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:25:55.793633    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:26:06.332616 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:06.332544    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:26:06.436771 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:06.436742    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:26:06.533836 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:06.533760    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:26:07.181575 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:07.181536    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:26:07.246064 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:07.246031    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:26:24.537466 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:24.537416    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:26:24.636324 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:24.636293    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:26:25.032305 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:25.032275    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:26:36.977127 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:36.977086    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:26:37.868226 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:37.868167    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:26:38.286238 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:38.286194    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:26:44.376343 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:44.376313    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:26:44.399265 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:44.399148    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-mqw6l"]
Sep 16 02:26:44.399540 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:44.399525    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b8aba58-4742-47f5-9418-24bb303b3811" containerName="console"
Sep 16 02:26:44.399595 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:44.399550    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b8aba58-4742-47f5-9418-24bb303b3811" containerName="console"
Sep 16 02:26:44.399636 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:44.399610    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b8aba58-4742-47f5-9418-24bb303b3811" containerName="console"
Sep 16 02:26:44.402425 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:44.402407    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-mqw6l"
Sep 16 02:26:44.404814 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:44.404796    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rvmxp\""
Sep 16 02:26:44.404814 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:44.404802    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 16 02:26:44.404965 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:44.404826    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 16 02:26:44.404965 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:44.404803    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 16 02:26:44.409608 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:44.409577    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-mqw6l"]
Sep 16 02:26:44.458861 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:44.458828    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc0ca3a6-8e41-4128-87ff-660be0af5024-metrics-certs\") pod \"maas-controller-75dc6cbdf-mqw6l\" (UID: \"bc0ca3a6-8e41-4128-87ff-660be0af5024\") " pod="opendatahub/maas-controller-75dc6cbdf-mqw6l"
Sep 16 02:26:44.459051 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:44.458915    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqt5v\" (UniqueName: \"kubernetes.io/projected/bc0ca3a6-8e41-4128-87ff-660be0af5024-kube-api-access-jqt5v\") pod \"maas-controller-75dc6cbdf-mqw6l\" (UID: \"bc0ca3a6-8e41-4128-87ff-660be0af5024\") " pod="opendatahub/maas-controller-75dc6cbdf-mqw6l"
Sep 16 02:26:44.459051 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:44.458965    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc0ca3a6-8e41-4128-87ff-660be0af5024-webhook-cert\") pod \"maas-controller-75dc6cbdf-mqw6l\" (UID: \"bc0ca3a6-8e41-4128-87ff-660be0af5024\") " pod="opendatahub/maas-controller-75dc6cbdf-mqw6l"
Sep 16 02:26:44.476435 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:44.476411    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:26:44.559909 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:44.559879    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc0ca3a6-8e41-4128-87ff-660be0af5024-metrics-certs\") pod \"maas-controller-75dc6cbdf-mqw6l\" (UID: \"bc0ca3a6-8e41-4128-87ff-660be0af5024\") " pod="opendatahub/maas-controller-75dc6cbdf-mqw6l"
Sep 16 02:26:44.560053 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:44.559931    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqt5v\" (UniqueName: \"kubernetes.io/projected/bc0ca3a6-8e41-4128-87ff-660be0af5024-kube-api-access-jqt5v\") pod \"maas-controller-75dc6cbdf-mqw6l\" (UID: \"bc0ca3a6-8e41-4128-87ff-660be0af5024\") " pod="opendatahub/maas-controller-75dc6cbdf-mqw6l"
Sep 16 02:26:44.560053 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:44.559974    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc0ca3a6-8e41-4128-87ff-660be0af5024-webhook-cert\") pod \"maas-controller-75dc6cbdf-mqw6l\" (UID: \"bc0ca3a6-8e41-4128-87ff-660be0af5024\") " pod="opendatahub/maas-controller-75dc6cbdf-mqw6l"
Sep 16 02:26:44.560167 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:26:44.560116    2565 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 16 02:26:44.560220 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:26:44.560205    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc0ca3a6-8e41-4128-87ff-660be0af5024-webhook-cert podName:bc0ca3a6-8e41-4128-87ff-660be0af5024 nodeName:}" failed. No retries permitted until 2026-09-16 02:26:45.060184216 +0000 UTC m=+483.110528707 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/bc0ca3a6-8e41-4128-87ff-660be0af5024-webhook-cert") pod "maas-controller-75dc6cbdf-mqw6l" (UID: "bc0ca3a6-8e41-4128-87ff-660be0af5024") : secret "maas-controller-webhook-cert" not found
Sep 16 02:26:44.562272 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:44.562242    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc0ca3a6-8e41-4128-87ff-660be0af5024-metrics-certs\") pod \"maas-controller-75dc6cbdf-mqw6l\" (UID: \"bc0ca3a6-8e41-4128-87ff-660be0af5024\") " pod="opendatahub/maas-controller-75dc6cbdf-mqw6l"
Sep 16 02:26:44.570210 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:44.570190    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqt5v\" (UniqueName: \"kubernetes.io/projected/bc0ca3a6-8e41-4128-87ff-660be0af5024-kube-api-access-jqt5v\") pod \"maas-controller-75dc6cbdf-mqw6l\" (UID: \"bc0ca3a6-8e41-4128-87ff-660be0af5024\") " pod="opendatahub/maas-controller-75dc6cbdf-mqw6l"
Sep 16 02:26:44.576974 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:44.576946    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:26:44.681734 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:44.681685    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:26:45.064484 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:45.064413    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc0ca3a6-8e41-4128-87ff-660be0af5024-webhook-cert\") pod \"maas-controller-75dc6cbdf-mqw6l\" (UID: \"bc0ca3a6-8e41-4128-87ff-660be0af5024\") " pod="opendatahub/maas-controller-75dc6cbdf-mqw6l"
Sep 16 02:26:45.066713 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:45.066690    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc0ca3a6-8e41-4128-87ff-660be0af5024-webhook-cert\") pod \"maas-controller-75dc6cbdf-mqw6l\" (UID: \"bc0ca3a6-8e41-4128-87ff-660be0af5024\") " pod="opendatahub/maas-controller-75dc6cbdf-mqw6l"
Sep 16 02:26:45.313948 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:45.313919    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-mqw6l"
Sep 16 02:26:45.581715 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:45.581691    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-mqw6l"]
Sep 16 02:26:45.583408 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:26:45.583381    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc0ca3a6_8e41_4128_87ff_660be0af5024.slice/crio-b50a698fa7432bf906fd4bb591aa8ef8dac1ac5fdaa9ef72160f4f1af9b3c65b WatchSource:0}: Error finding container b50a698fa7432bf906fd4bb591aa8ef8dac1ac5fdaa9ef72160f4f1af9b3c65b: Status 404 returned error can't find the container with id b50a698fa7432bf906fd4bb591aa8ef8dac1ac5fdaa9ef72160f4f1af9b3c65b
Sep 16 02:26:45.727566 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:45.727527    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-mqw6l" event={"ID":"bc0ca3a6-8e41-4128-87ff-660be0af5024","Type":"ContainerStarted","Data":"b50a698fa7432bf906fd4bb591aa8ef8dac1ac5fdaa9ef72160f4f1af9b3c65b"}
Sep 16 02:26:47.684164 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:47.684125    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:26:47.783834 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:47.783799    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:26:48.744041 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:48.743994    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-mqw6l" event={"ID":"bc0ca3a6-8e41-4128-87ff-660be0af5024","Type":"ContainerStarted","Data":"86cdbd4de80a39dc950acaffe444a4298a1788de0e6a3926a08f5590026d79d2"}
Sep 16 02:26:48.744518 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:48.744148    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75dc6cbdf-mqw6l"
Sep 16 02:26:48.761148 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:48.761107    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75dc6cbdf-mqw6l" podStartSLOduration=2.46763912 podStartE2EDuration="4.761091575s" totalImagesPullingTime="2.293452455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:26:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:26:48.759060919 +0000 UTC m=+486.809405460" watchObservedRunningTime="2026-09-16 02:26:48.761091575 +0000 UTC m=+486.811436064"
Sep 16 02:26:49.768433 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:49.768392    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:26:49.870633 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:49.870598    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:26:51.987228 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:51.987194    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:26:52.116314 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:52.116282    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:26:52.767318 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:52.767283    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:26:58.642727 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:58.642693    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-mqw6l"]
Sep 16 02:26:58.643175 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:58.642927    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-75dc6cbdf-mqw6l" podUID="bc0ca3a6-8e41-4128-87ff-660be0af5024" containerName="manager" containerID="cri-o://86cdbd4de80a39dc950acaffe444a4298a1788de0e6a3926a08f5590026d79d2" gracePeriod=30
Sep 16 02:26:58.644700 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:58.644677    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75dc6cbdf-mqw6l"
Sep 16 02:26:58.796142 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:58.796114    2565 generic.go:356] "Generic (PLEG): container finished" podID="bc0ca3a6-8e41-4128-87ff-660be0af5024" containerID="86cdbd4de80a39dc950acaffe444a4298a1788de0e6a3926a08f5590026d79d2" exitCode=0
Sep 16 02:26:58.796300 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:58.796190    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-mqw6l" event={"ID":"bc0ca3a6-8e41-4128-87ff-660be0af5024","Type":"ContainerDied","Data":"86cdbd4de80a39dc950acaffe444a4298a1788de0e6a3926a08f5590026d79d2"}
Sep 16 02:26:58.889237 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:58.889212    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-mqw6l"
Sep 16 02:26:58.977292 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:58.977269    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc0ca3a6-8e41-4128-87ff-660be0af5024-metrics-certs\") pod \"bc0ca3a6-8e41-4128-87ff-660be0af5024\" (UID: \"bc0ca3a6-8e41-4128-87ff-660be0af5024\") "
Sep 16 02:26:58.977468 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:58.977312    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc0ca3a6-8e41-4128-87ff-660be0af5024-webhook-cert\") pod \"bc0ca3a6-8e41-4128-87ff-660be0af5024\" (UID: \"bc0ca3a6-8e41-4128-87ff-660be0af5024\") "
Sep 16 02:26:58.977468 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:58.977345    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqt5v\" (UniqueName: \"kubernetes.io/projected/bc0ca3a6-8e41-4128-87ff-660be0af5024-kube-api-access-jqt5v\") pod \"bc0ca3a6-8e41-4128-87ff-660be0af5024\" (UID: \"bc0ca3a6-8e41-4128-87ff-660be0af5024\") "
Sep 16 02:26:58.979425 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:58.979395    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc0ca3a6-8e41-4128-87ff-660be0af5024-kube-api-access-jqt5v" (OuterVolumeSpecName: "kube-api-access-jqt5v") pod "bc0ca3a6-8e41-4128-87ff-660be0af5024" (UID: "bc0ca3a6-8e41-4128-87ff-660be0af5024"). InnerVolumeSpecName "kube-api-access-jqt5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:26:58.979519 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:58.979465    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc0ca3a6-8e41-4128-87ff-660be0af5024-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "bc0ca3a6-8e41-4128-87ff-660be0af5024" (UID: "bc0ca3a6-8e41-4128-87ff-660be0af5024"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:26:58.979519 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:58.979475    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc0ca3a6-8e41-4128-87ff-660be0af5024-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "bc0ca3a6-8e41-4128-87ff-660be0af5024" (UID: "bc0ca3a6-8e41-4128-87ff-660be0af5024"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:26:59.078188 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:59.078160    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc0ca3a6-8e41-4128-87ff-660be0af5024-metrics-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:26:59.078188 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:59.078185    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc0ca3a6-8e41-4128-87ff-660be0af5024-webhook-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:26:59.078331 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:59.078194    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqt5v\" (UniqueName: \"kubernetes.io/projected/bc0ca3a6-8e41-4128-87ff-660be0af5024-kube-api-access-jqt5v\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:26:59.803593 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:59.803552    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-mqw6l" event={"ID":"bc0ca3a6-8e41-4128-87ff-660be0af5024","Type":"ContainerDied","Data":"b50a698fa7432bf906fd4bb591aa8ef8dac1ac5fdaa9ef72160f4f1af9b3c65b"}
Sep 16 02:26:59.803593 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:59.803578    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-mqw6l"
Sep 16 02:26:59.804082 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:59.803632    2565 scope.go:117] "RemoveContainer" containerID="86cdbd4de80a39dc950acaffe444a4298a1788de0e6a3926a08f5590026d79d2"
Sep 16 02:26:59.824185 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:59.824158    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-mqw6l"]
Sep 16 02:26:59.827575 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:26:59.827548    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-mqw6l"]
Sep 16 02:27:00.390496 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:00.390456    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc0ca3a6-8e41-4128-87ff-660be0af5024" path="/var/lib/kubelet/pods/bc0ca3a6-8e41-4128-87ff-660be0af5024/volumes"
Sep 16 02:27:17.481020 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:17.480980    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:27:17.580383 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:17.580331    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:27:18.899228 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:18.899191    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:27:19.000118 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:19.000087    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:27:19.275812 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:19.275781    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:27:19.419115 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:19.419078    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:27:19.471835 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:19.471806    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-59smc"]
Sep 16 02:27:19.472140 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:19.472128    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc0ca3a6-8e41-4128-87ff-660be0af5024" containerName="manager"
Sep 16 02:27:19.472183 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:19.472141    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc0ca3a6-8e41-4128-87ff-660be0af5024" containerName="manager"
Sep 16 02:27:19.472222 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:19.472196    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc0ca3a6-8e41-4128-87ff-660be0af5024" containerName="manager"
Sep 16 02:27:19.475122 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:19.475107    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-59smc"
Sep 16 02:27:19.477404 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:19.477384    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 16 02:27:19.477504 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:19.477401    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-7v8jt\""
Sep 16 02:27:19.484283 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:19.484259    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-59smc"]
Sep 16 02:27:19.500506 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:19.494948    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:27:19.518282 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:19.518256    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-d4lm4"]
Sep 16 02:27:19.521556 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:19.521539    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-d4lm4"
Sep 16 02:27:19.531147 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:19.531127    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-d4lm4"]
Sep 16 02:27:19.539287 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:19.539267    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/832ce981-1849-48af-8055-de074371b570-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-59smc\" (UID: \"832ce981-1849-48af-8055-de074371b570\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-59smc"
Sep 16 02:27:19.539392 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:19.539344    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfwjl\" (UniqueName: \"kubernetes.io/projected/832ce981-1849-48af-8055-de074371b570-kube-api-access-kfwjl\") pod \"payload-pre-processing-59fbc47bf8-59smc\" (UID: \"832ce981-1849-48af-8055-de074371b570\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-59smc"
Sep 16 02:27:19.555738 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:19.555701    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:27:19.640403 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:19.640375    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/718f78fd-3112-4d9b-bd97-a6e9c201412c-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-d4lm4\" (UID: \"718f78fd-3112-4d9b-bd97-a6e9c201412c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-d4lm4"
Sep 16 02:27:19.640535 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:19.640423    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pqlr\" (UniqueName: \"kubernetes.io/projected/718f78fd-3112-4d9b-bd97-a6e9c201412c-kube-api-access-4pqlr\") pod \"payload-processing-5b54b7fbb7-d4lm4\" (UID: \"718f78fd-3112-4d9b-bd97-a6e9c201412c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-d4lm4"
Sep 16 02:27:19.640535 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:19.640448    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfwjl\" (UniqueName: \"kubernetes.io/projected/832ce981-1849-48af-8055-de074371b570-kube-api-access-kfwjl\") pod \"payload-pre-processing-59fbc47bf8-59smc\" (UID: \"832ce981-1849-48af-8055-de074371b570\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-59smc"
Sep 16 02:27:19.640535 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:19.640486    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/832ce981-1849-48af-8055-de074371b570-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-59smc\" (UID: \"832ce981-1849-48af-8055-de074371b570\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-59smc"
Sep 16 02:27:19.641060 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:19.641043    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/832ce981-1849-48af-8055-de074371b570-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-59smc\" (UID: \"832ce981-1849-48af-8055-de074371b570\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-59smc"
Sep 16 02:27:19.647370 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:19.647340    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfwjl\" (UniqueName: \"kubernetes.io/projected/832ce981-1849-48af-8055-de074371b570-kube-api-access-kfwjl\") pod \"payload-pre-processing-59fbc47bf8-59smc\" (UID: \"832ce981-1849-48af-8055-de074371b570\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-59smc"
Sep 16 02:27:19.741608 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:19.741583    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pqlr\" (UniqueName: \"kubernetes.io/projected/718f78fd-3112-4d9b-bd97-a6e9c201412c-kube-api-access-4pqlr\") pod \"payload-processing-5b54b7fbb7-d4lm4\" (UID: \"718f78fd-3112-4d9b-bd97-a6e9c201412c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-d4lm4"
Sep 16 02:27:19.741738 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:19.741652    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/718f78fd-3112-4d9b-bd97-a6e9c201412c-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-d4lm4\" (UID: \"718f78fd-3112-4d9b-bd97-a6e9c201412c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-d4lm4"
Sep 16 02:27:19.742212 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:19.742192    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/718f78fd-3112-4d9b-bd97-a6e9c201412c-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-d4lm4\" (UID: \"718f78fd-3112-4d9b-bd97-a6e9c201412c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-d4lm4"
Sep 16 02:27:19.749844 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:19.749824    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pqlr\" (UniqueName: \"kubernetes.io/projected/718f78fd-3112-4d9b-bd97-a6e9c201412c-kube-api-access-4pqlr\") pod \"payload-processing-5b54b7fbb7-d4lm4\" (UID: \"718f78fd-3112-4d9b-bd97-a6e9c201412c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-d4lm4"
Sep 16 02:27:19.785843 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:19.785788    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-59smc"
Sep 16 02:27:19.833673 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:19.833642    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-d4lm4"
Sep 16 02:27:20.060831 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:20.060805    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-59smc"]
Sep 16 02:27:20.061981 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:27:20.061954    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod832ce981_1849_48af_8055_de074371b570.slice/crio-7f663df8c58c8e5146ef4266ca888c3d0a19367544755e4b3ef0398fecd022e4 WatchSource:0}: Error finding container 7f663df8c58c8e5146ef4266ca888c3d0a19367544755e4b3ef0398fecd022e4: Status 404 returned error can't find the container with id 7f663df8c58c8e5146ef4266ca888c3d0a19367544755e4b3ef0398fecd022e4
Sep 16 02:27:20.108834 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:20.108809    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-d4lm4"]
Sep 16 02:27:20.110117 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:27:20.110093    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod718f78fd_3112_4d9b_bd97_a6e9c201412c.slice/crio-a713ebd21936fea180484c2198674c4104d0bdd57cf60f0c0bd078bd3a5ad862 WatchSource:0}: Error finding container a713ebd21936fea180484c2198674c4104d0bdd57cf60f0c0bd078bd3a5ad862: Status 404 returned error can't find the container with id a713ebd21936fea180484c2198674c4104d0bdd57cf60f0c0bd078bd3a5ad862
Sep 16 02:27:20.913165 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:20.913080    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-d4lm4" event={"ID":"718f78fd-3112-4d9b-bd97-a6e9c201412c","Type":"ContainerStarted","Data":"a713ebd21936fea180484c2198674c4104d0bdd57cf60f0c0bd078bd3a5ad862"}
Sep 16 02:27:20.914631 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:20.914593    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-59smc" event={"ID":"832ce981-1849-48af-8055-de074371b570","Type":"ContainerStarted","Data":"7f663df8c58c8e5146ef4266ca888c3d0a19367544755e4b3ef0398fecd022e4"}
Sep 16 02:27:21.921259 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:21.921222    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-d4lm4" event={"ID":"718f78fd-3112-4d9b-bd97-a6e9c201412c","Type":"ContainerStarted","Data":"6dc7dafe951ea096e127c5ebe7e7017645d75500e6ce61d6a86e633abae2f7b1"}
Sep 16 02:27:21.921710 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:21.921307    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-d4lm4"
Sep 16 02:27:21.922936 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:21.922909    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-59smc" event={"ID":"832ce981-1849-48af-8055-de074371b570","Type":"ContainerStarted","Data":"29496a93137f88b39a1835bf99c27b31278fa6687d7d30e8adbfdbf36c5a700d"}
Sep 16 02:27:21.923055 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:21.922962    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-59smc"
Sep 16 02:27:21.935675 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:21.935628    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-d4lm4" podStartSLOduration=1.6206725789999998 podStartE2EDuration="2.935609876s" totalImagesPullingTime="1.314937297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:27:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:27:21.934958135 +0000 UTC m=+519.985302655" watchObservedRunningTime="2026-09-16 02:27:21.935609876 +0000 UTC m=+519.985954371"
Sep 16 02:27:21.949623 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:21.949578    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-59smc" podStartSLOduration=1.5891299079999999 podStartE2EDuration="2.94956401s" totalImagesPullingTime="1.360434102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:27:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:27:21.947976264 +0000 UTC m=+519.998320785" watchObservedRunningTime="2026-09-16 02:27:21.94956401 +0000 UTC m=+519.999908506"
Sep 16 02:27:29.840144 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:29.840109    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:27:29.958974 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:29.958938    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:27:32.930327 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:32.930286    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-d4lm4"
Sep 16 02:27:32.930745 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:32.930409    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-59smc"
Sep 16 02:27:37.065248 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:37.065176    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:27:47.174239 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:47.174205    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:27:50.781498 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:27:50.781461    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:28:03.047432 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:03.047394    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:28:10.546584 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:10.546553    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9"]
Sep 16 02:28:10.550035 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:10.550017    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9"
Sep 16 02:28:10.553569 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:10.553322    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 16 02:28:10.553569 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:10.553407    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 16 02:28:10.553569 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:10.553556    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 16 02:28:10.553826 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:10.553573    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-f9flb\""
Sep 16 02:28:10.560606 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:10.560582    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9"]
Sep 16 02:28:10.577116 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:10.577088    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:28:10.657511 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:10.657477    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be79e25a-8c26-4e69-a1e8-edec8150b38f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9\" (UID: \"be79e25a-8c26-4e69-a1e8-edec8150b38f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9"
Sep 16 02:28:10.657675 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:10.657531    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be79e25a-8c26-4e69-a1e8-edec8150b38f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9\" (UID: \"be79e25a-8c26-4e69-a1e8-edec8150b38f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9"
Sep 16 02:28:10.657675 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:10.657555    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be79e25a-8c26-4e69-a1e8-edec8150b38f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9\" (UID: \"be79e25a-8c26-4e69-a1e8-edec8150b38f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9"
Sep 16 02:28:10.657675 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:10.657574    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdm92\" (UniqueName: \"kubernetes.io/projected/be79e25a-8c26-4e69-a1e8-edec8150b38f-kube-api-access-hdm92\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9\" (UID: \"be79e25a-8c26-4e69-a1e8-edec8150b38f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9"
Sep 16 02:28:10.657675 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:10.657602    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be79e25a-8c26-4e69-a1e8-edec8150b38f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9\" (UID: \"be79e25a-8c26-4e69-a1e8-edec8150b38f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9"
Sep 16 02:28:10.657675 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:10.657642    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be79e25a-8c26-4e69-a1e8-edec8150b38f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9\" (UID: \"be79e25a-8c26-4e69-a1e8-edec8150b38f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9"
Sep 16 02:28:10.758831 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:10.758792    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be79e25a-8c26-4e69-a1e8-edec8150b38f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9\" (UID: \"be79e25a-8c26-4e69-a1e8-edec8150b38f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9"
Sep 16 02:28:10.759008 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:10.758847    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be79e25a-8c26-4e69-a1e8-edec8150b38f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9\" (UID: \"be79e25a-8c26-4e69-a1e8-edec8150b38f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9"
Sep 16 02:28:10.759008 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:10.758880    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be79e25a-8c26-4e69-a1e8-edec8150b38f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9\" (UID: \"be79e25a-8c26-4e69-a1e8-edec8150b38f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9"
Sep 16 02:28:10.759008 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:10.758899    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdm92\" (UniqueName: \"kubernetes.io/projected/be79e25a-8c26-4e69-a1e8-edec8150b38f-kube-api-access-hdm92\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9\" (UID: \"be79e25a-8c26-4e69-a1e8-edec8150b38f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9"
Sep 16 02:28:10.759008 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:10.758932    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be79e25a-8c26-4e69-a1e8-edec8150b38f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9\" (UID: \"be79e25a-8c26-4e69-a1e8-edec8150b38f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9"
Sep 16 02:28:10.759008 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:10.758976    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be79e25a-8c26-4e69-a1e8-edec8150b38f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9\" (UID: \"be79e25a-8c26-4e69-a1e8-edec8150b38f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9"
Sep 16 02:28:10.759376 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:10.759329    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be79e25a-8c26-4e69-a1e8-edec8150b38f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9\" (UID: \"be79e25a-8c26-4e69-a1e8-edec8150b38f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9"
Sep 16 02:28:10.759542 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:10.759395    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be79e25a-8c26-4e69-a1e8-edec8150b38f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9\" (UID: \"be79e25a-8c26-4e69-a1e8-edec8150b38f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9"
Sep 16 02:28:10.759542 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:10.759418    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be79e25a-8c26-4e69-a1e8-edec8150b38f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9\" (UID: \"be79e25a-8c26-4e69-a1e8-edec8150b38f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9"
Sep 16 02:28:10.761178 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:10.761152    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be79e25a-8c26-4e69-a1e8-edec8150b38f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9\" (UID: \"be79e25a-8c26-4e69-a1e8-edec8150b38f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9"
Sep 16 02:28:10.761498 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:10.761483    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be79e25a-8c26-4e69-a1e8-edec8150b38f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9\" (UID: \"be79e25a-8c26-4e69-a1e8-edec8150b38f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9"
Sep 16 02:28:10.765862 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:10.765837    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdm92\" (UniqueName: \"kubernetes.io/projected/be79e25a-8c26-4e69-a1e8-edec8150b38f-kube-api-access-hdm92\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9\" (UID: \"be79e25a-8c26-4e69-a1e8-edec8150b38f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9"
Sep 16 02:28:10.862768 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:10.862687    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9"
Sep 16 02:28:11.133114 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:11.133088    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9"]
Sep 16 02:28:11.134933 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:28:11.134905    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe79e25a_8c26_4e69_a1e8_edec8150b38f.slice/crio-3a340526d6cb54743946982d17c644c48f68f5a5d5ca8a41e140512fbb16ee0c WatchSource:0}: Error finding container 3a340526d6cb54743946982d17c644c48f68f5a5d5ca8a41e140512fbb16ee0c: Status 404 returned error can't find the container with id 3a340526d6cb54743946982d17c644c48f68f5a5d5ca8a41e140512fbb16ee0c
Sep 16 02:28:11.178738 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:11.178705    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9" event={"ID":"be79e25a-8c26-4e69-a1e8-edec8150b38f","Type":"ContainerStarted","Data":"3a340526d6cb54743946982d17c644c48f68f5a5d5ca8a41e140512fbb16ee0c"}
Sep 16 02:28:12.184804 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:12.184767    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9" event={"ID":"be79e25a-8c26-4e69-a1e8-edec8150b38f","Type":"ContainerStarted","Data":"d09c48b5165ac0d0be294b5d99a4332d5b411d2edc6df58eca8919062bbee7cb"}
Sep 16 02:28:12.207085 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:12.207028    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9" podStartSLOduration=1.287402629 podStartE2EDuration="2.207013048s" totalImagesPullingTime="919.610419ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:28:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:28:12.205331524 +0000 UTC m=+570.255676018" watchObservedRunningTime="2026-09-16 02:28:12.207013048 +0000 UTC m=+570.257357562"
Sep 16 02:28:15.942109 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:15.942076    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ql6q7"]
Sep 16 02:28:15.945687 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:15.945663    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql6q7"
Sep 16 02:28:15.948106 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:15.948083    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 16 02:28:15.956172 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:15.956148    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ql6q7"]
Sep 16 02:28:15.970888 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:15.970865    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:28:16.101899 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:16.101866    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7edb806-2a77-4db9-87ed-00cdce67618b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql6q7\" (UID: \"a7edb806-2a77-4db9-87ed-00cdce67618b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql6q7"
Sep 16 02:28:16.102048 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:16.101905    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlwzw\" (UniqueName: \"kubernetes.io/projected/a7edb806-2a77-4db9-87ed-00cdce67618b-kube-api-access-tlwzw\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql6q7\" (UID: \"a7edb806-2a77-4db9-87ed-00cdce67618b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql6q7"
Sep 16 02:28:16.102048 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:16.101937    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7edb806-2a77-4db9-87ed-00cdce67618b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql6q7\" (UID: \"a7edb806-2a77-4db9-87ed-00cdce67618b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql6q7"
Sep 16 02:28:16.102048 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:16.102011    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7edb806-2a77-4db9-87ed-00cdce67618b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql6q7\" (UID: \"a7edb806-2a77-4db9-87ed-00cdce67618b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql6q7"
Sep 16 02:28:16.102178 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:16.102104    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7edb806-2a77-4db9-87ed-00cdce67618b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql6q7\" (UID: \"a7edb806-2a77-4db9-87ed-00cdce67618b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql6q7"
Sep 16 02:28:16.102178 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:16.102125    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7edb806-2a77-4db9-87ed-00cdce67618b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql6q7\" (UID: \"a7edb806-2a77-4db9-87ed-00cdce67618b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql6q7"
Sep 16 02:28:16.202674 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:16.202588    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7edb806-2a77-4db9-87ed-00cdce67618b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql6q7\" (UID: \"a7edb806-2a77-4db9-87ed-00cdce67618b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql6q7"
Sep 16 02:28:16.202674 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:16.202640    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlwzw\" (UniqueName: \"kubernetes.io/projected/a7edb806-2a77-4db9-87ed-00cdce67618b-kube-api-access-tlwzw\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql6q7\" (UID: \"a7edb806-2a77-4db9-87ed-00cdce67618b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql6q7"
Sep 16 02:28:16.202674 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:16.202660    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7edb806-2a77-4db9-87ed-00cdce67618b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql6q7\" (UID: \"a7edb806-2a77-4db9-87ed-00cdce67618b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql6q7"
Sep 16 02:28:16.202942 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:16.202700    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7edb806-2a77-4db9-87ed-00cdce67618b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql6q7\" (UID: \"a7edb806-2a77-4db9-87ed-00cdce67618b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql6q7"
Sep 16 02:28:16.202942 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:16.202930    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7edb806-2a77-4db9-87ed-00cdce67618b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql6q7\" (UID: \"a7edb806-2a77-4db9-87ed-00cdce67618b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql6q7"
Sep 16 02:28:16.203243 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:16.202967    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7edb806-2a77-4db9-87ed-00cdce67618b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql6q7\" (UID: \"a7edb806-2a77-4db9-87ed-00cdce67618b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql6q7"
Sep 16 02:28:16.203243 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:16.203059    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7edb806-2a77-4db9-87ed-00cdce67618b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql6q7\" (UID: \"a7edb806-2a77-4db9-87ed-00cdce67618b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql6q7"
Sep 16 02:28:16.203334 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:16.203251    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7edb806-2a77-4db9-87ed-00cdce67618b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql6q7\" (UID: \"a7edb806-2a77-4db9-87ed-00cdce67618b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql6q7"
Sep 16 02:28:16.203334 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:16.203310    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7edb806-2a77-4db9-87ed-00cdce67618b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql6q7\" (UID: \"a7edb806-2a77-4db9-87ed-00cdce67618b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql6q7"
Sep 16 02:28:16.205119 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:16.205075    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7edb806-2a77-4db9-87ed-00cdce67618b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql6q7\" (UID: \"a7edb806-2a77-4db9-87ed-00cdce67618b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql6q7"
Sep 16 02:28:16.205424 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:16.205403    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7edb806-2a77-4db9-87ed-00cdce67618b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql6q7\" (UID: \"a7edb806-2a77-4db9-87ed-00cdce67618b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql6q7"
Sep 16 02:28:16.209790 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:16.209760    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlwzw\" (UniqueName: \"kubernetes.io/projected/a7edb806-2a77-4db9-87ed-00cdce67618b-kube-api-access-tlwzw\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql6q7\" (UID: \"a7edb806-2a77-4db9-87ed-00cdce67618b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql6q7"
Sep 16 02:28:16.257543 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:16.257510    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql6q7"
Sep 16 02:28:16.527458 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:16.527431    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ql6q7"]
Sep 16 02:28:16.529344 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:28:16.529317    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7edb806_2a77_4db9_87ed_00cdce67618b.slice/crio-fc37998aae06c48027cccd2b8967679df72581a7c197146f75b02e26a3321b85 WatchSource:0}: Error finding container fc37998aae06c48027cccd2b8967679df72581a7c197146f75b02e26a3321b85: Status 404 returned error can't find the container with id fc37998aae06c48027cccd2b8967679df72581a7c197146f75b02e26a3321b85
Sep 16 02:28:17.214113 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:17.214075    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql6q7" event={"ID":"a7edb806-2a77-4db9-87ed-00cdce67618b","Type":"ContainerStarted","Data":"8a8635b7278c4b1dcb06b2fc1774417a273b0a884cdbf45c7a4a6b64886d3d60"}
Sep 16 02:28:17.214587 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:17.214126    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql6q7" event={"ID":"a7edb806-2a77-4db9-87ed-00cdce67618b","Type":"ContainerStarted","Data":"fc37998aae06c48027cccd2b8967679df72581a7c197146f75b02e26a3321b85"}
Sep 16 02:28:17.231061 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:17.231009    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql6q7" podStartSLOduration=2.063794955 podStartE2EDuration="2.230995007s" totalImagesPullingTime="167.200052ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:28:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:28:17.228856078 +0000 UTC m=+575.279200572" watchObservedRunningTime="2026-09-16 02:28:17.230995007 +0000 UTC m=+575.281339530"
Sep 16 02:28:20.863481 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:20.863452    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9"
Sep 16 02:28:20.863830 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:20.863499    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9"
Sep 16 02:28:20.875397 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:20.875356    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9"
Sep 16 02:28:21.244750 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:21.244725    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flq5l9"
Sep 16 02:28:22.856506 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:22.856474    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:28:26.257647 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:26.257619    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql6q7"
Sep 16 02:28:26.258127 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:26.257679    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql6q7"
Sep 16 02:28:26.270326 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:26.270298    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql6q7"
Sep 16 02:28:27.281565 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:27.281532    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql6q7"
Sep 16 02:28:33.740413 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:33.740354    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:28:42.425589 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:42.425556    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:28:42.524877 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:28:42.524840    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:29:40.461579 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:40.461538    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:29:40.564108 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:40.564076    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-d4lm4"]
Sep 16 02:29:40.564389 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:40.564332    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-5b54b7fbb7-d4lm4" podUID="718f78fd-3112-4d9b-bd97-a6e9c201412c" containerName="payload-processing" containerID="cri-o://6dc7dafe951ea096e127c5ebe7e7017645d75500e6ce61d6a86e633abae2f7b1" gracePeriod=30
Sep 16 02:29:40.711016 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:40.710980    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-59smc"]
Sep 16 02:29:40.711213 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:40.711176    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-59smc" podUID="832ce981-1849-48af-8055-de074371b570" containerName="payload-pre-processing" containerID="cri-o://29496a93137f88b39a1835bf99c27b31278fa6687d7d30e8adbfdbf36c5a700d" gracePeriod=30
Sep 16 02:29:40.744681 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:40.744654    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:29:40.835234 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:40.835169    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-d4lm4"
Sep 16 02:29:40.953394 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:40.953344    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-59smc"
Sep 16 02:29:40.993065 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:40.992996    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pqlr\" (UniqueName: \"kubernetes.io/projected/718f78fd-3112-4d9b-bd97-a6e9c201412c-kube-api-access-4pqlr\") pod \"718f78fd-3112-4d9b-bd97-a6e9c201412c\" (UID: \"718f78fd-3112-4d9b-bd97-a6e9c201412c\") "
Sep 16 02:29:40.993177 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:40.993094    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/718f78fd-3112-4d9b-bd97-a6e9c201412c-plugins-config-volume\") pod \"718f78fd-3112-4d9b-bd97-a6e9c201412c\" (UID: \"718f78fd-3112-4d9b-bd97-a6e9c201412c\") "
Sep 16 02:29:40.993470 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:40.993442    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/718f78fd-3112-4d9b-bd97-a6e9c201412c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "718f78fd-3112-4d9b-bd97-a6e9c201412c" (UID: "718f78fd-3112-4d9b-bd97-a6e9c201412c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:29:40.995427 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:40.995402    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/718f78fd-3112-4d9b-bd97-a6e9c201412c-kube-api-access-4pqlr" (OuterVolumeSpecName: "kube-api-access-4pqlr") pod "718f78fd-3112-4d9b-bd97-a6e9c201412c" (UID: "718f78fd-3112-4d9b-bd97-a6e9c201412c"). InnerVolumeSpecName "kube-api-access-4pqlr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:29:41.039408 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.039347    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:29:41.094100 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.094077    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfwjl\" (UniqueName: \"kubernetes.io/projected/832ce981-1849-48af-8055-de074371b570-kube-api-access-kfwjl\") pod \"832ce981-1849-48af-8055-de074371b570\" (UID: \"832ce981-1849-48af-8055-de074371b570\") "
Sep 16 02:29:41.094208 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.094181    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/832ce981-1849-48af-8055-de074371b570-plugins-config-volume\") pod \"832ce981-1849-48af-8055-de074371b570\" (UID: \"832ce981-1849-48af-8055-de074371b570\") "
Sep 16 02:29:41.094330 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.094319    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pqlr\" (UniqueName: \"kubernetes.io/projected/718f78fd-3112-4d9b-bd97-a6e9c201412c-kube-api-access-4pqlr\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:29:41.094396 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.094331    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/718f78fd-3112-4d9b-bd97-a6e9c201412c-plugins-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:29:41.094572 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.094550    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/832ce981-1849-48af-8055-de074371b570-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "832ce981-1849-48af-8055-de074371b570" (UID: "832ce981-1849-48af-8055-de074371b570"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:29:41.096008 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.095991    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/832ce981-1849-48af-8055-de074371b570-kube-api-access-kfwjl" (OuterVolumeSpecName: "kube-api-access-kfwjl") pod "832ce981-1849-48af-8055-de074371b570" (UID: "832ce981-1849-48af-8055-de074371b570"). InnerVolumeSpecName "kube-api-access-kfwjl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:29:41.195781 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.195741    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/832ce981-1849-48af-8055-de074371b570-plugins-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:29:41.195781 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.195776    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfwjl\" (UniqueName: \"kubernetes.io/projected/832ce981-1849-48af-8055-de074371b570-kube-api-access-kfwjl\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:29:41.641375 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.641327    2565 generic.go:356] "Generic (PLEG): container finished" podID="718f78fd-3112-4d9b-bd97-a6e9c201412c" containerID="6dc7dafe951ea096e127c5ebe7e7017645d75500e6ce61d6a86e633abae2f7b1" exitCode=0
Sep 16 02:29:41.641770 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.641388    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-d4lm4"
Sep 16 02:29:41.641770 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.641399    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-d4lm4" event={"ID":"718f78fd-3112-4d9b-bd97-a6e9c201412c","Type":"ContainerDied","Data":"6dc7dafe951ea096e127c5ebe7e7017645d75500e6ce61d6a86e633abae2f7b1"}
Sep 16 02:29:41.641770 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.641455    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-d4lm4" event={"ID":"718f78fd-3112-4d9b-bd97-a6e9c201412c","Type":"ContainerDied","Data":"a713ebd21936fea180484c2198674c4104d0bdd57cf60f0c0bd078bd3a5ad862"}
Sep 16 02:29:41.641770 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.641481    2565 scope.go:117] "RemoveContainer" containerID="6dc7dafe951ea096e127c5ebe7e7017645d75500e6ce61d6a86e633abae2f7b1"
Sep 16 02:29:41.642956 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.642930    2565 generic.go:356] "Generic (PLEG): container finished" podID="832ce981-1849-48af-8055-de074371b570" containerID="29496a93137f88b39a1835bf99c27b31278fa6687d7d30e8adbfdbf36c5a700d" exitCode=0
Sep 16 02:29:41.643077 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.642967    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-59smc"
Sep 16 02:29:41.643077 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.643031    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-59smc" event={"ID":"832ce981-1849-48af-8055-de074371b570","Type":"ContainerDied","Data":"29496a93137f88b39a1835bf99c27b31278fa6687d7d30e8adbfdbf36c5a700d"}
Sep 16 02:29:41.643198 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.643080    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-59smc" event={"ID":"832ce981-1849-48af-8055-de074371b570","Type":"ContainerDied","Data":"7f663df8c58c8e5146ef4266ca888c3d0a19367544755e4b3ef0398fecd022e4"}
Sep 16 02:29:41.654102 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.654084    2565 scope.go:117] "RemoveContainer" containerID="6dc7dafe951ea096e127c5ebe7e7017645d75500e6ce61d6a86e633abae2f7b1"
Sep 16 02:29:41.654696 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:29:41.654673    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dc7dafe951ea096e127c5ebe7e7017645d75500e6ce61d6a86e633abae2f7b1\": container with ID starting with 6dc7dafe951ea096e127c5ebe7e7017645d75500e6ce61d6a86e633abae2f7b1 not found: ID does not exist" containerID="6dc7dafe951ea096e127c5ebe7e7017645d75500e6ce61d6a86e633abae2f7b1"
Sep 16 02:29:41.654793 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.654707    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dc7dafe951ea096e127c5ebe7e7017645d75500e6ce61d6a86e633abae2f7b1"} err="failed to get container status \"6dc7dafe951ea096e127c5ebe7e7017645d75500e6ce61d6a86e633abae2f7b1\": rpc error: code = NotFound desc = could not find container \"6dc7dafe951ea096e127c5ebe7e7017645d75500e6ce61d6a86e633abae2f7b1\": container with ID starting with 6dc7dafe951ea096e127c5ebe7e7017645d75500e6ce61d6a86e633abae2f7b1 not found: ID does not exist"
Sep 16 02:29:41.654793 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.654729    2565 scope.go:117] "RemoveContainer" containerID="29496a93137f88b39a1835bf99c27b31278fa6687d7d30e8adbfdbf36c5a700d"
Sep 16 02:29:41.662864 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.662847    2565 scope.go:117] "RemoveContainer" containerID="29496a93137f88b39a1835bf99c27b31278fa6687d7d30e8adbfdbf36c5a700d"
Sep 16 02:29:41.663118 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:29:41.663096    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29496a93137f88b39a1835bf99c27b31278fa6687d7d30e8adbfdbf36c5a700d\": container with ID starting with 29496a93137f88b39a1835bf99c27b31278fa6687d7d30e8adbfdbf36c5a700d not found: ID does not exist" containerID="29496a93137f88b39a1835bf99c27b31278fa6687d7d30e8adbfdbf36c5a700d"
Sep 16 02:29:41.663164 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.663123    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29496a93137f88b39a1835bf99c27b31278fa6687d7d30e8adbfdbf36c5a700d"} err="failed to get container status \"29496a93137f88b39a1835bf99c27b31278fa6687d7d30e8adbfdbf36c5a700d\": rpc error: code = NotFound desc = could not find container \"29496a93137f88b39a1835bf99c27b31278fa6687d7d30e8adbfdbf36c5a700d\": container with ID starting with 29496a93137f88b39a1835bf99c27b31278fa6687d7d30e8adbfdbf36c5a700d not found: ID does not exist"
Sep 16 02:29:41.669024 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.669000    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-59smc"]
Sep 16 02:29:41.671934 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.671913    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-59smc"]
Sep 16 02:29:41.680820 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.680794    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-d4lm4"]
Sep 16 02:29:41.693951 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.693931    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-d4lm4"]
Sep 16 02:29:41.717440 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.717420    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6f594795b-82vx5"]
Sep 16 02:29:41.717781 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.717759    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="718f78fd-3112-4d9b-bd97-a6e9c201412c" containerName="payload-processing"
Sep 16 02:29:41.717834 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.717782    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="718f78fd-3112-4d9b-bd97-a6e9c201412c" containerName="payload-processing"
Sep 16 02:29:41.717834 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.717800    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="832ce981-1849-48af-8055-de074371b570" containerName="payload-pre-processing"
Sep 16 02:29:41.717834 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.717807    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="832ce981-1849-48af-8055-de074371b570" containerName="payload-pre-processing"
Sep 16 02:29:41.717929 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.717862    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="832ce981-1849-48af-8055-de074371b570" containerName="payload-pre-processing"
Sep 16 02:29:41.717929 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.717873    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="718f78fd-3112-4d9b-bd97-a6e9c201412c" containerName="payload-processing"
Sep 16 02:29:41.721987 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.721973    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f594795b-82vx5"
Sep 16 02:29:41.724135 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.724109    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 16 02:29:41.724231 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.724184    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rvmxp\""
Sep 16 02:29:41.724231 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.724221    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 16 02:29:41.724345 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.724224    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 16 02:29:41.730813 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.730790    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f594795b-82vx5"]
Sep 16 02:29:41.902512 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.902446    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c308ccb-4eba-44e8-b72e-68eb989e071e-metrics-certs\") pod \"maas-controller-6f594795b-82vx5\" (UID: \"8c308ccb-4eba-44e8-b72e-68eb989e071e\") " pod="opendatahub/maas-controller-6f594795b-82vx5"
Sep 16 02:29:41.902612 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.902513    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c308ccb-4eba-44e8-b72e-68eb989e071e-webhook-cert\") pod \"maas-controller-6f594795b-82vx5\" (UID: \"8c308ccb-4eba-44e8-b72e-68eb989e071e\") " pod="opendatahub/maas-controller-6f594795b-82vx5"
Sep 16 02:29:41.902612 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:41.902573    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwdgr\" (UniqueName: \"kubernetes.io/projected/8c308ccb-4eba-44e8-b72e-68eb989e071e-kube-api-access-wwdgr\") pod \"maas-controller-6f594795b-82vx5\" (UID: \"8c308ccb-4eba-44e8-b72e-68eb989e071e\") " pod="opendatahub/maas-controller-6f594795b-82vx5"
Sep 16 02:29:42.003462 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:42.003438    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c308ccb-4eba-44e8-b72e-68eb989e071e-webhook-cert\") pod \"maas-controller-6f594795b-82vx5\" (UID: \"8c308ccb-4eba-44e8-b72e-68eb989e071e\") " pod="opendatahub/maas-controller-6f594795b-82vx5"
Sep 16 02:29:42.003548 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:42.003480    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwdgr\" (UniqueName: \"kubernetes.io/projected/8c308ccb-4eba-44e8-b72e-68eb989e071e-kube-api-access-wwdgr\") pod \"maas-controller-6f594795b-82vx5\" (UID: \"8c308ccb-4eba-44e8-b72e-68eb989e071e\") " pod="opendatahub/maas-controller-6f594795b-82vx5"
Sep 16 02:29:42.003548 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:42.003519    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c308ccb-4eba-44e8-b72e-68eb989e071e-metrics-certs\") pod \"maas-controller-6f594795b-82vx5\" (UID: \"8c308ccb-4eba-44e8-b72e-68eb989e071e\") " pod="opendatahub/maas-controller-6f594795b-82vx5"
Sep 16 02:29:42.005903 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:42.005874    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c308ccb-4eba-44e8-b72e-68eb989e071e-metrics-certs\") pod \"maas-controller-6f594795b-82vx5\" (UID: \"8c308ccb-4eba-44e8-b72e-68eb989e071e\") " pod="opendatahub/maas-controller-6f594795b-82vx5"
Sep 16 02:29:42.006004 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:42.005941    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c308ccb-4eba-44e8-b72e-68eb989e071e-webhook-cert\") pod \"maas-controller-6f594795b-82vx5\" (UID: \"8c308ccb-4eba-44e8-b72e-68eb989e071e\") " pod="opendatahub/maas-controller-6f594795b-82vx5"
Sep 16 02:29:42.010705 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:42.010683    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwdgr\" (UniqueName: \"kubernetes.io/projected/8c308ccb-4eba-44e8-b72e-68eb989e071e-kube-api-access-wwdgr\") pod \"maas-controller-6f594795b-82vx5\" (UID: \"8c308ccb-4eba-44e8-b72e-68eb989e071e\") " pod="opendatahub/maas-controller-6f594795b-82vx5"
Sep 16 02:29:42.032596 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:42.032573    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f594795b-82vx5"
Sep 16 02:29:42.300591 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:42.300566    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f594795b-82vx5"]
Sep 16 02:29:42.301941 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:29:42.301917    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c308ccb_4eba_44e8_b72e_68eb989e071e.slice/crio-047295c7b65e0a363495ce8d5dec09008756b139742ec28aff451b44d89ed104 WatchSource:0}: Error finding container 047295c7b65e0a363495ce8d5dec09008756b139742ec28aff451b44d89ed104: Status 404 returned error can't find the container with id 047295c7b65e0a363495ce8d5dec09008756b139742ec28aff451b44d89ed104
Sep 16 02:29:42.303156 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:42.303141    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 02:29:42.390237 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:42.390214    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="718f78fd-3112-4d9b-bd97-a6e9c201412c" path="/var/lib/kubelet/pods/718f78fd-3112-4d9b-bd97-a6e9c201412c/volumes"
Sep 16 02:29:42.390592 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:42.390578    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="832ce981-1849-48af-8055-de074371b570" path="/var/lib/kubelet/pods/832ce981-1849-48af-8055-de074371b570/volumes"
Sep 16 02:29:42.648490 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:42.648429    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f594795b-82vx5" event={"ID":"8c308ccb-4eba-44e8-b72e-68eb989e071e","Type":"ContainerStarted","Data":"047295c7b65e0a363495ce8d5dec09008756b139742ec28aff451b44d89ed104"}
Sep 16 02:29:42.834839 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:42.834813    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 16 02:29:43.655068 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:43.655033    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f594795b-82vx5" event={"ID":"8c308ccb-4eba-44e8-b72e-68eb989e071e","Type":"ContainerStarted","Data":"ee67ed90a0e093aa8b5829b5450dca49fc99583f96404576aa8c03dfe7e9aa2e"}
Sep 16 02:29:43.655477 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:43.655183    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6f594795b-82vx5"
Sep 16 02:29:43.672251 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:43.672203    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6f594795b-82vx5" podStartSLOduration=2.143011963 podStartE2EDuration="2.672189401s" totalImagesPullingTime="529.177438ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:29:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:29:43.669761905 +0000 UTC m=+661.720106421" watchObservedRunningTime="2026-09-16 02:29:43.672189401 +0000 UTC m=+661.722533894"
Sep 16 02:29:54.662404 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:54.662350    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6f594795b-82vx5"
Sep 16 02:29:54.943337 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:54.943259    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-857878477c-cxpg6"]
Sep 16 02:29:54.946820 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:54.946798    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-857878477c-cxpg6"
Sep 16 02:29:54.948977 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:54.948957    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\""
Sep 16 02:29:54.949084 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:54.948963    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-6757b\""
Sep 16 02:29:54.953794 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:54.953761    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-857878477c-cxpg6"]
Sep 16 02:29:55.004339 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:55.004314    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzmst\" (UniqueName: \"kubernetes.io/projected/72f78dae-b039-4d1c-80df-693b790370ee-kube-api-access-dzmst\") pod \"ai-gateway-controller-857878477c-cxpg6\" (UID: \"72f78dae-b039-4d1c-80df-693b790370ee\") " pod="opendatahub/ai-gateway-controller-857878477c-cxpg6"
Sep 16 02:29:55.105094 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:55.105067    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzmst\" (UniqueName: \"kubernetes.io/projected/72f78dae-b039-4d1c-80df-693b790370ee-kube-api-access-dzmst\") pod \"ai-gateway-controller-857878477c-cxpg6\" (UID: \"72f78dae-b039-4d1c-80df-693b790370ee\") " pod="opendatahub/ai-gateway-controller-857878477c-cxpg6"
Sep 16 02:29:55.112182 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:55.112153    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzmst\" (UniqueName: \"kubernetes.io/projected/72f78dae-b039-4d1c-80df-693b790370ee-kube-api-access-dzmst\") pod \"ai-gateway-controller-857878477c-cxpg6\" (UID: \"72f78dae-b039-4d1c-80df-693b790370ee\") " pod="opendatahub/ai-gateway-controller-857878477c-cxpg6"
Sep 16 02:29:55.257855 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:55.257796    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-857878477c-cxpg6"
Sep 16 02:29:55.528246 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:55.528223    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-857878477c-cxpg6"]
Sep 16 02:29:55.529803 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:29:55.529763    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72f78dae_b039_4d1c_80df_693b790370ee.slice/crio-d43b1513c0d6d66dbd3f3c66692484f65b4d58e339ef48351b12d8c973a82737 WatchSource:0}: Error finding container d43b1513c0d6d66dbd3f3c66692484f65b4d58e339ef48351b12d8c973a82737: Status 404 returned error can't find the container with id d43b1513c0d6d66dbd3f3c66692484f65b4d58e339ef48351b12d8c973a82737
Sep 16 02:29:55.733313 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:55.733284    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-857878477c-cxpg6" event={"ID":"72f78dae-b039-4d1c-80df-693b790370ee","Type":"ContainerStarted","Data":"d43b1513c0d6d66dbd3f3c66692484f65b4d58e339ef48351b12d8c973a82737"}
Sep 16 02:29:57.423106 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:57.423078    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8"]
Sep 16 02:29:57.426571 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:57.426554    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8"
Sep 16 02:29:57.428893 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:57.428725    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-7v8jt\""
Sep 16 02:29:57.428893 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:57.428771    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 16 02:29:57.433513 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:57.433471    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:29:57.436171 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:57.436151    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8"]
Sep 16 02:29:57.524709 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:57.524680    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62shh\" (UniqueName: \"kubernetes.io/projected/4ea77906-c510-4fe3-97c7-ecf122c3a86a-kube-api-access-62shh\") pod \"payload-pre-processing-6cd864bc95-vrcw8\" (UID: \"4ea77906-c510-4fe3-97c7-ecf122c3a86a\") " pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8"
Sep 16 02:29:57.524833 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:57.524751    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ea77906-c510-4fe3-97c7-ecf122c3a86a-plugins-config-volume\") pod \"payload-pre-processing-6cd864bc95-vrcw8\" (UID: \"4ea77906-c510-4fe3-97c7-ecf122c3a86a\") " pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8"
Sep 16 02:29:57.525413 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:57.525392    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:29:57.625679 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:57.625650    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ea77906-c510-4fe3-97c7-ecf122c3a86a-plugins-config-volume\") pod \"payload-pre-processing-6cd864bc95-vrcw8\" (UID: \"4ea77906-c510-4fe3-97c7-ecf122c3a86a\") " pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8"
Sep 16 02:29:57.625815 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:57.625701    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62shh\" (UniqueName: \"kubernetes.io/projected/4ea77906-c510-4fe3-97c7-ecf122c3a86a-kube-api-access-62shh\") pod \"payload-pre-processing-6cd864bc95-vrcw8\" (UID: \"4ea77906-c510-4fe3-97c7-ecf122c3a86a\") " pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8"
Sep 16 02:29:57.626561 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:57.626543    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ea77906-c510-4fe3-97c7-ecf122c3a86a-plugins-config-volume\") pod \"payload-pre-processing-6cd864bc95-vrcw8\" (UID: \"4ea77906-c510-4fe3-97c7-ecf122c3a86a\") " pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8"
Sep 16 02:29:57.632796 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:57.632774    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62shh\" (UniqueName: \"kubernetes.io/projected/4ea77906-c510-4fe3-97c7-ecf122c3a86a-kube-api-access-62shh\") pod \"payload-pre-processing-6cd864bc95-vrcw8\" (UID: \"4ea77906-c510-4fe3-97c7-ecf122c3a86a\") " pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8"
Sep 16 02:29:57.739048 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:57.738992    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8"
Sep 16 02:29:57.745603 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:57.745571    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-857878477c-cxpg6" event={"ID":"72f78dae-b039-4d1c-80df-693b790370ee","Type":"ContainerStarted","Data":"5130364ea997a19944707ef7e38f8d798bfa3fe8d2c6ca8bdf63e3e4085fda28"}
Sep 16 02:29:57.745720 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:57.745687    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-857878477c-cxpg6"
Sep 16 02:29:57.759735 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:57.759689    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-857878477c-cxpg6" podStartSLOduration=2.293715581 podStartE2EDuration="3.759674292s" totalImagesPullingTime="1.465958711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:29:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:29:57.758928615 +0000 UTC m=+675.809273132" watchObservedRunningTime="2026-09-16 02:29:57.759674292 +0000 UTC m=+675.810018784"
Sep 16 02:29:58.009875 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:58.009851    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8"]
Sep 16 02:29:58.010992 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:29:58.010966    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ea77906_c510_4fe3_97c7_ecf122c3a86a.slice/crio-ed8a49edb56c78bb97e4a48ae62e00fe26b191adbd271f60a6fa42a491e94e66 WatchSource:0}: Error finding container ed8a49edb56c78bb97e4a48ae62e00fe26b191adbd271f60a6fa42a491e94e66: Status 404 returned error can't find the container with id ed8a49edb56c78bb97e4a48ae62e00fe26b191adbd271f60a6fa42a491e94e66
Sep 16 02:29:58.757829 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:58.757796    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8" event={"ID":"4ea77906-c510-4fe3-97c7-ecf122c3a86a","Type":"ContainerStarted","Data":"ed8a49edb56c78bb97e4a48ae62e00fe26b191adbd271f60a6fa42a491e94e66"}
Sep 16 02:29:59.764125 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:59.764092    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8" event={"ID":"4ea77906-c510-4fe3-97c7-ecf122c3a86a","Type":"ContainerStarted","Data":"26c0f2fc0cec5e74dd42ceddc303c7b324d7ad12aa2025540cf3f83306621025"}
Sep 16 02:29:59.764551 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:59.764223    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8"
Sep 16 02:29:59.781073 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:29:59.781029    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8" podStartSLOduration=1.726167962 podStartE2EDuration="2.78101439s" totalImagesPullingTime="1.054846428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:29:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:29:59.778961413 +0000 UTC m=+677.829305924" watchObservedRunningTime="2026-09-16 02:29:59.78101439 +0000 UTC m=+677.831358882"
Sep 16 02:30:00.132815 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:00.132726    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29825430-nmbbs"]
Sep 16 02:30:00.139040 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:00.139004    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825430-nmbbs"
Sep 16 02:30:00.141681 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:00.141649    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29825430-nmbbs"]
Sep 16 02:30:00.143021 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:00.142972    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w8hnp\""
Sep 16 02:30:00.153821 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:00.153799    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825430-nmbbs"
Sep 16 02:30:00.422031 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:00.421849    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29825430-nmbbs"]
Sep 16 02:30:00.424576 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:30:00.424540    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e5155df_2e12_4eb3_9943_c6b9e9aba65a.slice/crio-a80c5f28a0c27022fb64a2471d426611a693e8ffd48819a2142702f5b30c80bc WatchSource:0}: Error finding container a80c5f28a0c27022fb64a2471d426611a693e8ffd48819a2142702f5b30c80bc: Status 404 returned error can't find the container with id a80c5f28a0c27022fb64a2471d426611a693e8ffd48819a2142702f5b30c80bc
Sep 16 02:30:00.770233 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:00.770146    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825430-nmbbs" event={"ID":"3e5155df-2e12-4eb3-9943-c6b9e9aba65a","Type":"ContainerStarted","Data":"a80c5f28a0c27022fb64a2471d426611a693e8ffd48819a2142702f5b30c80bc"}
Sep 16 02:30:03.789701 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:03.789673    2565 generic.go:356] "Generic (PLEG): container finished" podID="3e5155df-2e12-4eb3-9943-c6b9e9aba65a" containerID="533aa85d4a351e91db994219f4820cfea5e1dba3babad0459073bb93661b1de3" exitCode=0
Sep 16 02:30:03.790030 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:03.789756    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825430-nmbbs" event={"ID":"3e5155df-2e12-4eb3-9943-c6b9e9aba65a","Type":"ContainerDied","Data":"533aa85d4a351e91db994219f4820cfea5e1dba3babad0459073bb93661b1de3"}
Sep 16 02:30:04.927759 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:04.927736    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825430-nmbbs"
Sep 16 02:30:05.801507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:05.801472    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825430-nmbbs"
Sep 16 02:30:05.801678 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:05.801511    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825430-nmbbs" event={"ID":"3e5155df-2e12-4eb3-9943-c6b9e9aba65a","Type":"ContainerDied","Data":"a80c5f28a0c27022fb64a2471d426611a693e8ffd48819a2142702f5b30c80bc"}
Sep 16 02:30:05.801678 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:05.801564    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a80c5f28a0c27022fb64a2471d426611a693e8ffd48819a2142702f5b30c80bc"
Sep 16 02:30:08.760396 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:08.760349    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-857878477c-cxpg6"
Sep 16 02:30:10.772462 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:10.772428    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8"
Sep 16 02:30:10.772890 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:10.772762    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8" secret="" err="secret \"payload-processing-dockercfg-7v8jt\" not found"
Sep 16 02:30:16.404336 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:16.404303    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:16.504778 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:16.504747    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:22.647882 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:22.647840    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-857878477c-cxpg6"]
Sep 16 02:30:22.648349 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:22.648088    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/ai-gateway-controller-857878477c-cxpg6" podUID="72f78dae-b039-4d1c-80df-693b790370ee" containerName="manager" containerID="cri-o://5130364ea997a19944707ef7e38f8d798bfa3fe8d2c6ca8bdf63e3e4085fda28" gracePeriod=30
Sep 16 02:30:22.889584 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:22.889553    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-857878477c-cxpg6"
Sep 16 02:30:22.891989 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:22.891965    2565 generic.go:356] "Generic (PLEG): container finished" podID="72f78dae-b039-4d1c-80df-693b790370ee" containerID="5130364ea997a19944707ef7e38f8d798bfa3fe8d2c6ca8bdf63e3e4085fda28" exitCode=0
Sep 16 02:30:22.892100 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:22.892001    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-857878477c-cxpg6"
Sep 16 02:30:22.892100 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:22.892004    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-857878477c-cxpg6" event={"ID":"72f78dae-b039-4d1c-80df-693b790370ee","Type":"ContainerDied","Data":"5130364ea997a19944707ef7e38f8d798bfa3fe8d2c6ca8bdf63e3e4085fda28"}
Sep 16 02:30:22.892176 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:22.892106    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-857878477c-cxpg6" event={"ID":"72f78dae-b039-4d1c-80df-693b790370ee","Type":"ContainerDied","Data":"d43b1513c0d6d66dbd3f3c66692484f65b4d58e339ef48351b12d8c973a82737"}
Sep 16 02:30:22.892176 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:22.892128    2565 scope.go:117] "RemoveContainer" containerID="5130364ea997a19944707ef7e38f8d798bfa3fe8d2c6ca8bdf63e3e4085fda28"
Sep 16 02:30:22.900327 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:22.900303    2565 scope.go:117] "RemoveContainer" containerID="5130364ea997a19944707ef7e38f8d798bfa3fe8d2c6ca8bdf63e3e4085fda28"
Sep 16 02:30:22.900620 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:30:22.900600    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5130364ea997a19944707ef7e38f8d798bfa3fe8d2c6ca8bdf63e3e4085fda28\": container with ID starting with 5130364ea997a19944707ef7e38f8d798bfa3fe8d2c6ca8bdf63e3e4085fda28 not found: ID does not exist" containerID="5130364ea997a19944707ef7e38f8d798bfa3fe8d2c6ca8bdf63e3e4085fda28"
Sep 16 02:30:22.900674 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:22.900630    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5130364ea997a19944707ef7e38f8d798bfa3fe8d2c6ca8bdf63e3e4085fda28"} err="failed to get container status \"5130364ea997a19944707ef7e38f8d798bfa3fe8d2c6ca8bdf63e3e4085fda28\": rpc error: code = NotFound desc = could not find container \"5130364ea997a19944707ef7e38f8d798bfa3fe8d2c6ca8bdf63e3e4085fda28\": container with ID starting with 5130364ea997a19944707ef7e38f8d798bfa3fe8d2c6ca8bdf63e3e4085fda28 not found: ID does not exist"
Sep 16 02:30:23.046738 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:23.046704    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzmst\" (UniqueName: \"kubernetes.io/projected/72f78dae-b039-4d1c-80df-693b790370ee-kube-api-access-dzmst\") pod \"72f78dae-b039-4d1c-80df-693b790370ee\" (UID: \"72f78dae-b039-4d1c-80df-693b790370ee\") "
Sep 16 02:30:23.048744 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:23.048718    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72f78dae-b039-4d1c-80df-693b790370ee-kube-api-access-dzmst" (OuterVolumeSpecName: "kube-api-access-dzmst") pod "72f78dae-b039-4d1c-80df-693b790370ee" (UID: "72f78dae-b039-4d1c-80df-693b790370ee"). InnerVolumeSpecName "kube-api-access-dzmst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:30:23.148416 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:23.148353    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzmst\" (UniqueName: \"kubernetes.io/projected/72f78dae-b039-4d1c-80df-693b790370ee-kube-api-access-dzmst\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:30:23.212733 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:23.212698    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-857878477c-cxpg6"]
Sep 16 02:30:23.216553 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:23.216522    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/ai-gateway-controller-857878477c-cxpg6"]
Sep 16 02:30:23.869702 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:23.869642    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:24.221452 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:24.221419    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:24.392240 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:24.392204    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72f78dae-b039-4d1c-80df-693b790370ee" path="/var/lib/kubelet/pods/72f78dae-b039-4d1c-80df-693b790370ee/volumes"
Sep 16 02:30:25.374372 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:25.374331    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:25.474461 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:25.474433    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:26.564640 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:26.564603    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:26.664900 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:26.664851    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:46.782483 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:46.782442    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:46.833716 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:46.833683    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:47.089071 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.088989    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"]
Sep 16 02:30:47.089541 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.089516    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e5155df-2e12-4eb3-9943-c6b9e9aba65a" containerName="cleanup"
Sep 16 02:30:47.089541 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.089535    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e5155df-2e12-4eb3-9943-c6b9e9aba65a" containerName="cleanup"
Sep 16 02:30:47.089706 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.089549    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72f78dae-b039-4d1c-80df-693b790370ee" containerName="manager"
Sep 16 02:30:47.089706 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.089555    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="72f78dae-b039-4d1c-80df-693b790370ee" containerName="manager"
Sep 16 02:30:47.089706 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.089623    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e5155df-2e12-4eb3-9943-c6b9e9aba65a" containerName="cleanup"
Sep 16 02:30:47.089706 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.089632    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="72f78dae-b039-4d1c-80df-693b790370ee" containerName="manager"
Sep 16 02:30:47.093951 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.093933    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:47.096336 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.096318    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-6dfb47-openshift-default-dockercfg-7nssp\""
Sep 16 02:30:47.107830 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.107808    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"]
Sep 16 02:30:47.115745 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.115715    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:47.146393 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.146348    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"]
Sep 16 02:30:47.149845 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.149827    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:47.152397 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.152373    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-a3d7eb-openshift-default-dockercfg-vkz9g\""
Sep 16 02:30:47.159219 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.159191    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d57bf4a3-5179-4b37-8542-0017543e6b1d-istio-token\") pod \"e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") " pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:47.159570 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.159544    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d57bf4a3-5179-4b37-8542-0017543e6b1d-workload-certs\") pod \"e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") " pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:47.159689 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.159599    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp946\" (UniqueName: \"kubernetes.io/projected/d57bf4a3-5179-4b37-8542-0017543e6b1d-kube-api-access-kp946\") pod \"e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") " pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:47.159689 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.159631    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d57bf4a3-5179-4b37-8542-0017543e6b1d-workload-socket\") pod \"e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") " pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:47.159689 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.159659    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d57bf4a3-5179-4b37-8542-0017543e6b1d-istio-data\") pod \"e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") " pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:47.159689 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.159683    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d57bf4a3-5179-4b37-8542-0017543e6b1d-istiod-ca-cert\") pod \"e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") " pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:47.159909 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.159726    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d57bf4a3-5179-4b37-8542-0017543e6b1d-istio-podinfo\") pod \"e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") " pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:47.159909 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.159758    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d57bf4a3-5179-4b37-8542-0017543e6b1d-credential-socket\") pod \"e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") " pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:47.159909 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.159785    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d57bf4a3-5179-4b37-8542-0017543e6b1d-istio-envoy\") pod \"e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") " pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:47.161549 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.161527    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"]
Sep 16 02:30:47.186089 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.186061    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:47.260694 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.260671    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-credential-socket\") pod \"e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") " pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:47.260819 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.260701    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-istio-token\") pod \"e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") " pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:47.260819 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.260720    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-workload-certs\") pod \"e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") " pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:47.260819 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.260763    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp946\" (UniqueName: \"kubernetes.io/projected/d57bf4a3-5179-4b37-8542-0017543e6b1d-kube-api-access-kp946\") pod \"e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") " pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:47.260819 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.260784    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d57bf4a3-5179-4b37-8542-0017543e6b1d-workload-socket\") pod \"e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") " pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:47.260819 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.260803    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d57bf4a3-5179-4b37-8542-0017543e6b1d-istio-data\") pod \"e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") " pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:47.260819 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.260818    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d57bf4a3-5179-4b37-8542-0017543e6b1d-istiod-ca-cert\") pod \"e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") " pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:47.261130 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.260839    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-istio-data\") pod \"e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") " pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:47.261130 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.260865    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d57bf4a3-5179-4b37-8542-0017543e6b1d-istio-podinfo\") pod \"e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") " pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:47.261130 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.260888    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzcxb\" (UniqueName: \"kubernetes.io/projected/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-kube-api-access-kzcxb\") pod \"e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") " pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:47.261130 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.260921    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d57bf4a3-5179-4b37-8542-0017543e6b1d-credential-socket\") pod \"e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") " pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:47.261130 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.260948    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d57bf4a3-5179-4b37-8542-0017543e6b1d-istio-envoy\") pod \"e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") " pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:47.261130 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.260975    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-istiod-ca-cert\") pod \"e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") " pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:47.261130 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.261002    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-istio-envoy\") pod \"e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") " pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:47.261130 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.261031    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d57bf4a3-5179-4b37-8542-0017543e6b1d-istio-token\") pod \"e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") " pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:47.261130 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.261105    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-istio-podinfo\") pod \"e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") " pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:47.261607 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.261143    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d57bf4a3-5179-4b37-8542-0017543e6b1d-workload-certs\") pod \"e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") " pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:47.261607 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.261196    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-workload-socket\") pod \"e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") " pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:47.261607 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.261222    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d57bf4a3-5179-4b37-8542-0017543e6b1d-workload-socket\") pod \"e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") " pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:47.261607 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.261561    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d57bf4a3-5179-4b37-8542-0017543e6b1d-workload-certs\") pod \"e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") " pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:47.261607 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.261586    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d57bf4a3-5179-4b37-8542-0017543e6b1d-credential-socket\") pod \"e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") " pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:47.261892 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.261726    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d57bf4a3-5179-4b37-8542-0017543e6b1d-istio-data\") pod \"e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") " pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:47.262013 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.261994    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d57bf4a3-5179-4b37-8542-0017543e6b1d-istiod-ca-cert\") pod \"e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") " pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:47.263165 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.263146    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d57bf4a3-5179-4b37-8542-0017543e6b1d-istio-envoy\") pod \"e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") " pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:47.263449 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.263424    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d57bf4a3-5179-4b37-8542-0017543e6b1d-istio-podinfo\") pod \"e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") " pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:47.273838 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.273812    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d57bf4a3-5179-4b37-8542-0017543e6b1d-istio-token\") pod \"e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") " pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:47.276177 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.276149    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp946\" (UniqueName: \"kubernetes.io/projected/d57bf4a3-5179-4b37-8542-0017543e6b1d-kube-api-access-kp946\") pod \"e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") " pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:47.304621 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.304595    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:47.361885 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.361809    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-istio-podinfo\") pod \"e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") " pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:47.361885 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.361851    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-workload-socket\") pod \"e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") " pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:47.361885 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.361873    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-credential-socket\") pod \"e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") " pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:47.362151 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.361899    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-istio-token\") pod \"e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") " pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:47.362151 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.361928    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-workload-certs\") pod \"e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") " pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:47.362151 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.361983    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-istio-data\") pod \"e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") " pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:47.362151 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.362015    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzcxb\" (UniqueName: \"kubernetes.io/projected/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-kube-api-access-kzcxb\") pod \"e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") " pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:47.362151 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.362074    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-istiod-ca-cert\") pod \"e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") " pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:47.362151 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.362104    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-istio-envoy\") pod \"e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") " pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:47.362492 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.362275    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-workload-socket\") pod \"e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") " pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:47.362492 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.362346    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-credential-socket\") pod \"e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") " pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:47.362601 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.362518    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-istio-data\") pod \"e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") " pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:47.362804 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.362779    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-workload-certs\") pod \"e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") " pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:47.363057 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.363036    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-istiod-ca-cert\") pod \"e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") " pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:47.364585 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.364562    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-istio-podinfo\") pod \"e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") " pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:47.364780 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.364762    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-istio-envoy\") pod \"e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") " pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:47.370736 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.370705    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-istio-token\") pod \"e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") " pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:47.370887 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.370851    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzcxb\" (UniqueName: \"kubernetes.io/projected/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-kube-api-access-kzcxb\") pod \"e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") " pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:47.397428 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.397398    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:47.403290 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.403270    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:47.463750 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.463723    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:47.500279 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.500256    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:47.598238 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.598212    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:47.679943 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.679920    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"]
Sep 16 02:30:47.680947 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:30:47.680923    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd57bf4a3_5179_4b37_8542_0017543e6b1d.slice/crio-bbaddcb92b88b338e2c168d46d37be43f86cd0c40f13f2cebcbc33be9de54363 WatchSource:0}: Error finding container bbaddcb92b88b338e2c168d46d37be43f86cd0c40f13f2cebcbc33be9de54363: Status 404 returned error can't find the container with id bbaddcb92b88b338e2c168d46d37be43f86cd0c40f13f2cebcbc33be9de54363
Sep 16 02:30:47.683127 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.683096    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:30:47.683228 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.683159    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:30:47.683228 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.683188    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:30:47.740034 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.740014    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"]
Sep 16 02:30:47.740774 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:30:47.740754    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod334f809c_9853_46bc_a0d9_2dd32e2ef6f5.slice/crio-7dd563d42ea2772ed46412a6acc3dfe9f65c533ebf6415087e13551f03865f41 WatchSource:0}: Error finding container 7dd563d42ea2772ed46412a6acc3dfe9f65c533ebf6415087e13551f03865f41: Status 404 returned error can't find the container with id 7dd563d42ea2772ed46412a6acc3dfe9f65c533ebf6415087e13551f03865f41
Sep 16 02:30:47.743322 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.743297    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:30:47.743413 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.743349    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:30:47.743413 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:47.743403    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:30:48.027229 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:48.027131    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k" event={"ID":"334f809c-9853-46bc-a0d9-2dd32e2ef6f5","Type":"ContainerStarted","Data":"bd18e62193f69576c767035b9b11706e18da929dd010af52cc4e3ac7fd259618"}
Sep 16 02:30:48.027229 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:48.027192    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k" event={"ID":"334f809c-9853-46bc-a0d9-2dd32e2ef6f5","Type":"ContainerStarted","Data":"7dd563d42ea2772ed46412a6acc3dfe9f65c533ebf6415087e13551f03865f41"}
Sep 16 02:30:48.029108 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:48.029075    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp" event={"ID":"d57bf4a3-5179-4b37-8542-0017543e6b1d","Type":"ContainerStarted","Data":"db5e6ea0126444102fc3e5f4f067ce99620b9e1bb40f18bccf47e84570576d4b"}
Sep 16 02:30:48.029212 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:48.029134    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp" event={"ID":"d57bf4a3-5179-4b37-8542-0017543e6b1d","Type":"ContainerStarted","Data":"bbaddcb92b88b338e2c168d46d37be43f86cd0c40f13f2cebcbc33be9de54363"}
Sep 16 02:30:48.048055 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:48.048005    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k" podStartSLOduration=1.047985083 podStartE2EDuration="1.047985083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:30:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:30:48.045788267 +0000 UTC m=+726.096132782" watchObservedRunningTime="2026-09-16 02:30:48.047985083 +0000 UTC m=+726.098329574"
Sep 16 02:30:48.066643 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:48.066590    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp" podStartSLOduration=1.066572473 podStartE2EDuration="1.066572473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:30:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:30:48.062321135 +0000 UTC m=+726.112665649" watchObservedRunningTime="2026-09-16 02:30:48.066572473 +0000 UTC m=+726.116916967"
Sep 16 02:30:48.403657 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:48.403584    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:48.408620 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:48.408596    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:48.465195 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:48.465170    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:48.477037 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:48.477000    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:49.035180 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:49.035066    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:49.035180 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:49.035126    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:49.035964 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:49.035942    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:30:49.036057 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:49.036025    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:30:50.027742 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:50.027698    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:50.131240 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:50.131054    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:50.226342 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:50.226307    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:50.335227 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:50.335125    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:50.431286 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:50.431254    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:51.273586 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:51.273552    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:51.327134 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:51.327092    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:51.540553 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:51.540459    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:51.721898 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:51.721868    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:51.805918 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:51.805819    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:51.807555 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:51.807524    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw"]
Sep 16 02:30:51.811085 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:51.811067    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw"
Sep 16 02:30:51.813607 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:51.813587    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-6dfb47\""
Sep 16 02:30:51.819983 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:51.819961    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw"]
Sep 16 02:30:51.852161 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:51.852139    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2"]
Sep 16 02:30:51.855391 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:51.855354    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2"
Sep 16 02:30:51.857814 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:51.857797    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-6dfb47-dockercfg-crgdk\""
Sep 16 02:30:51.865061 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:51.865033    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2"]
Sep 16 02:30:51.904536 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:51.904517    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70c5b344-e0dd-4985-8134-c55b208b6c37-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw\" (UID: \"70c5b344-e0dd-4985-8134-c55b208b6c37\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw"
Sep 16 02:30:51.904636 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:51.904559    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxnw2\" (UniqueName: \"kubernetes.io/projected/70c5b344-e0dd-4985-8134-c55b208b6c37-kube-api-access-wxnw2\") pod \"payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw\" (UID: \"70c5b344-e0dd-4985-8134-c55b208b6c37\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw"
Sep 16 02:30:52.005538 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:52.005500    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70c5b344-e0dd-4985-8134-c55b208b6c37-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw\" (UID: \"70c5b344-e0dd-4985-8134-c55b208b6c37\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw"
Sep 16 02:30:52.005729 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:52.005558    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxnw2\" (UniqueName: \"kubernetes.io/projected/70c5b344-e0dd-4985-8134-c55b208b6c37-kube-api-access-wxnw2\") pod \"payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw\" (UID: \"70c5b344-e0dd-4985-8134-c55b208b6c37\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw"
Sep 16 02:30:52.005729 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:52.005692    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx554\" (UniqueName: \"kubernetes.io/projected/a4247e84-84fc-4968-8dd6-7ec1fa644715-kube-api-access-qx554\") pod \"payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2\" (UID: \"a4247e84-84fc-4968-8dd6-7ec1fa644715\") " pod="openshift-ingress/payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2"
Sep 16 02:30:52.005861 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:52.005837    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4247e84-84fc-4968-8dd6-7ec1fa644715-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2\" (UID: \"a4247e84-84fc-4968-8dd6-7ec1fa644715\") " pod="openshift-ingress/payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2"
Sep 16 02:30:52.006593 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:52.006570    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70c5b344-e0dd-4985-8134-c55b208b6c37-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw\" (UID: \"70c5b344-e0dd-4985-8134-c55b208b6c37\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw"
Sep 16 02:30:52.013136 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:52.013117    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxnw2\" (UniqueName: \"kubernetes.io/projected/70c5b344-e0dd-4985-8134-c55b208b6c37-kube-api-access-wxnw2\") pod \"payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw\" (UID: \"70c5b344-e0dd-4985-8134-c55b208b6c37\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw"
Sep 16 02:30:52.106852 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:52.106787    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4247e84-84fc-4968-8dd6-7ec1fa644715-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2\" (UID: \"a4247e84-84fc-4968-8dd6-7ec1fa644715\") " pod="openshift-ingress/payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2"
Sep 16 02:30:52.106964 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:52.106855    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx554\" (UniqueName: \"kubernetes.io/projected/a4247e84-84fc-4968-8dd6-7ec1fa644715-kube-api-access-qx554\") pod \"payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2\" (UID: \"a4247e84-84fc-4968-8dd6-7ec1fa644715\") " pod="openshift-ingress/payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2"
Sep 16 02:30:52.107475 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:52.107456    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4247e84-84fc-4968-8dd6-7ec1fa644715-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2\" (UID: \"a4247e84-84fc-4968-8dd6-7ec1fa644715\") " pod="openshift-ingress/payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2"
Sep 16 02:30:52.114100 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:52.114079    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx554\" (UniqueName: \"kubernetes.io/projected/a4247e84-84fc-4968-8dd6-7ec1fa644715-kube-api-access-qx554\") pod \"payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2\" (UID: \"a4247e84-84fc-4968-8dd6-7ec1fa644715\") " pod="openshift-ingress/payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2"
Sep 16 02:30:52.123771 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:52.123750    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw"
Sep 16 02:30:52.166159 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:52.166121    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2"
Sep 16 02:30:52.245985 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:52.245959    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:52.298026 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:52.298002    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:52.396351 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:52.396329    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw"]
Sep 16 02:30:52.397619 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:30:52.397596    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70c5b344_e0dd_4985_8134_c55b208b6c37.slice/crio-11c5920b77135c94ecc60c134ecee411c3f7b8cd687e09b8cec99f5ef3d8a014 WatchSource:0}: Error finding container 11c5920b77135c94ecc60c134ecee411c3f7b8cd687e09b8cec99f5ef3d8a014: Status 404 returned error can't find the container with id 11c5920b77135c94ecc60c134ecee411c3f7b8cd687e09b8cec99f5ef3d8a014
Sep 16 02:30:52.447655 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:52.447635    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2"]
Sep 16 02:30:52.449244 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:30:52.449223    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4247e84_84fc_4968_8dd6_7ec1fa644715.slice/crio-9f69e5944709b08a10deea0c21fb2e9fcc231cdc22f2123cbc555e62943bb6f5 WatchSource:0}: Error finding container 9f69e5944709b08a10deea0c21fb2e9fcc231cdc22f2123cbc555e62943bb6f5: Status 404 returned error can't find the container with id 9f69e5944709b08a10deea0c21fb2e9fcc231cdc22f2123cbc555e62943bb6f5
Sep 16 02:30:52.536744 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:52.536718    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:52.783349 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:52.783317    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:52.880523 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:52.880489    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:52.890927 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:52.890893    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp"]
Sep 16 02:30:52.894774 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:52.894758    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp"
Sep 16 02:30:52.896998 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:52.896980    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w3-a3d7eb-dockercfg-wc7gg\""
Sep 16 02:30:52.896998 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:52.896993    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w3-a3d7eb\""
Sep 16 02:30:52.903279 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:52.903007    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp"]
Sep 16 02:30:52.908520 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:52.908498    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x"]
Sep 16 02:30:52.912308 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:52.912290    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x"
Sep 16 02:30:52.921002 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:52.920978    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x"]
Sep 16 02:30:53.016182 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.016148    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f695ebef-9866-4bd7-ad23-d7be65d9a083-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x\" (UID: \"f695ebef-9866-4bd7-ad23-d7be65d9a083\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x"
Sep 16 02:30:53.016333 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.016212    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rncv\" (UniqueName: \"kubernetes.io/projected/f695ebef-9866-4bd7-ad23-d7be65d9a083-kube-api-access-4rncv\") pod \"payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x\" (UID: \"f695ebef-9866-4bd7-ad23-d7be65d9a083\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x"
Sep 16 02:30:53.016333 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.016264    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6769937-1cc2-45ad-bae0-499d85de3043-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp\" (UID: \"d6769937-1cc2-45ad-bae0-499d85de3043\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp"
Sep 16 02:30:53.016461 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.016397    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w6lw\" (UniqueName: \"kubernetes.io/projected/d6769937-1cc2-45ad-bae0-499d85de3043-kube-api-access-7w6lw\") pod \"payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp\" (UID: \"d6769937-1cc2-45ad-bae0-499d85de3043\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp"
Sep 16 02:30:53.060558 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.060464    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw" event={"ID":"70c5b344-e0dd-4985-8134-c55b208b6c37","Type":"ContainerStarted","Data":"48af6aa067677ecd7c55c9d875beb23f0f758e9114f87680a0c6287e22fc1ea2"}
Sep 16 02:30:53.060734 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.060713    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw"
Sep 16 02:30:53.060809 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.060765    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw" event={"ID":"70c5b344-e0dd-4985-8134-c55b208b6c37","Type":"ContainerStarted","Data":"11c5920b77135c94ecc60c134ecee411c3f7b8cd687e09b8cec99f5ef3d8a014"}
Sep 16 02:30:53.062417 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.062391    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2" event={"ID":"a4247e84-84fc-4968-8dd6-7ec1fa644715","Type":"ContainerStarted","Data":"470360e3c9018fea122998bdfb7d94b609a410d246cbec2a6a79eae3c91fc443"}
Sep 16 02:30:53.062550 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.062436    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2" event={"ID":"a4247e84-84fc-4968-8dd6-7ec1fa644715","Type":"ContainerStarted","Data":"9f69e5944709b08a10deea0c21fb2e9fcc231cdc22f2123cbc555e62943bb6f5"}
Sep 16 02:30:53.062550 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.062471    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2"
Sep 16 02:30:53.077774 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.077719    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw" podStartSLOduration=2.077701435 podStartE2EDuration="2.077701435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:30:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:30:53.074273403 +0000 UTC m=+731.124617922" watchObservedRunningTime="2026-09-16 02:30:53.077701435 +0000 UTC m=+731.128045932"
Sep 16 02:30:53.090834 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.090796    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2" podStartSLOduration=2.090779222 podStartE2EDuration="2.090779222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:30:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:30:53.088839876 +0000 UTC m=+731.139184397" watchObservedRunningTime="2026-09-16 02:30:53.090779222 +0000 UTC m=+731.141123735"
Sep 16 02:30:53.117239 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.117217    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w6lw\" (UniqueName: \"kubernetes.io/projected/d6769937-1cc2-45ad-bae0-499d85de3043-kube-api-access-7w6lw\") pod \"payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp\" (UID: \"d6769937-1cc2-45ad-bae0-499d85de3043\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp"
Sep 16 02:30:53.117356 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.117273    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f695ebef-9866-4bd7-ad23-d7be65d9a083-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x\" (UID: \"f695ebef-9866-4bd7-ad23-d7be65d9a083\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x"
Sep 16 02:30:53.117356 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.117337    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rncv\" (UniqueName: \"kubernetes.io/projected/f695ebef-9866-4bd7-ad23-d7be65d9a083-kube-api-access-4rncv\") pod \"payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x\" (UID: \"f695ebef-9866-4bd7-ad23-d7be65d9a083\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x"
Sep 16 02:30:53.117570 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.117543    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6769937-1cc2-45ad-bae0-499d85de3043-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp\" (UID: \"d6769937-1cc2-45ad-bae0-499d85de3043\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp"
Sep 16 02:30:53.118123 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.118101    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f695ebef-9866-4bd7-ad23-d7be65d9a083-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x\" (UID: \"f695ebef-9866-4bd7-ad23-d7be65d9a083\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x"
Sep 16 02:30:53.118180 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.118162    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6769937-1cc2-45ad-bae0-499d85de3043-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp\" (UID: \"d6769937-1cc2-45ad-bae0-499d85de3043\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp"
Sep 16 02:30:53.133493 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.133460    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w6lw\" (UniqueName: \"kubernetes.io/projected/d6769937-1cc2-45ad-bae0-499d85de3043-kube-api-access-7w6lw\") pod \"payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp\" (UID: \"d6769937-1cc2-45ad-bae0-499d85de3043\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp"
Sep 16 02:30:53.134295 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.134272    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rncv\" (UniqueName: \"kubernetes.io/projected/f695ebef-9866-4bd7-ad23-d7be65d9a083-kube-api-access-4rncv\") pod \"payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x\" (UID: \"f695ebef-9866-4bd7-ad23-d7be65d9a083\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x"
Sep 16 02:30:53.164425 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.164394    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:53.207348 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.207320    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp"
Sep 16 02:30:53.223820 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.223803    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x"
Sep 16 02:30:53.267257 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.265732    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:53.419739 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.419712    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:53.497626 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.497599    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp"]
Sep 16 02:30:53.498918 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:30:53.498891    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6769937_1cc2_45ad_bae0_499d85de3043.slice/crio-b2caae5bbaf88f834c8db786af7530d4a06a4866831f931a023e299280c21905 WatchSource:0}: Error finding container b2caae5bbaf88f834c8db786af7530d4a06a4866831f931a023e299280c21905: Status 404 returned error can't find the container with id b2caae5bbaf88f834c8db786af7530d4a06a4866831f931a023e299280c21905
Sep 16 02:30:53.513274 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.513250    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x"]
Sep 16 02:30:53.514115 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:30:53.514091    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf695ebef_9866_4bd7_ad23_d7be65d9a083.slice/crio-cb5ada7e8e7c1beb8fe4cebd1e85563699b2c609c7eff6faf360d55c7fc1492b WatchSource:0}: Error finding container cb5ada7e8e7c1beb8fe4cebd1e85563699b2c609c7eff6faf360d55c7fc1492b: Status 404 returned error can't find the container with id cb5ada7e8e7c1beb8fe4cebd1e85563699b2c609c7eff6faf360d55c7fc1492b
Sep 16 02:30:53.712736 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.712639    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:53.806520 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.806473    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:53.846049 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.846021    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz"]
Sep 16 02:30:53.849492 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.849475    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz"
Sep 16 02:30:53.851691 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.851657    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-5b59aa-dockercfg-kp9gx\""
Sep 16 02:30:53.851817 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.851769    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-5b59aa\""
Sep 16 02:30:53.859657 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.859630    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz"]
Sep 16 02:30:53.928879 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.928645    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5zwv\" (UniqueName: \"kubernetes.io/projected/c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d-kube-api-access-p5zwv\") pod \"payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz\" (UID: \"c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz"
Sep 16 02:30:53.928879 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:53.928780    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz\" (UID: \"c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz"
Sep 16 02:30:54.030204 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:54.030136    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz\" (UID: \"c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz"
Sep 16 02:30:54.030327 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:54.030214    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5zwv\" (UniqueName: \"kubernetes.io/projected/c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d-kube-api-access-p5zwv\") pod \"payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz\" (UID: \"c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz"
Sep 16 02:30:54.030840 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:54.030821    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz\" (UID: \"c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz"
Sep 16 02:30:54.040077 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:54.040051    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5zwv\" (UniqueName: \"kubernetes.io/projected/c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d-kube-api-access-p5zwv\") pod \"payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz\" (UID: \"c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz"
Sep 16 02:30:54.060628 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:54.060606    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:54.070332 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:54.070308    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp" event={"ID":"d6769937-1cc2-45ad-bae0-499d85de3043","Type":"ContainerStarted","Data":"3f2b027a03dbd8d692f5793888a2173b902a5b7518edaa70e36ac885a2079062"}
Sep 16 02:30:54.070454 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:54.070370    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp" event={"ID":"d6769937-1cc2-45ad-bae0-499d85de3043","Type":"ContainerStarted","Data":"b2caae5bbaf88f834c8db786af7530d4a06a4866831f931a023e299280c21905"}
Sep 16 02:30:54.070454 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:54.070404    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp"
Sep 16 02:30:54.072040 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:54.072014    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x" event={"ID":"f695ebef-9866-4bd7-ad23-d7be65d9a083","Type":"ContainerStarted","Data":"3828a9f36d0338b0d36e09a4ad727cf872d8f17642e83e7dfa7583df04993cb0"}
Sep 16 02:30:54.072131 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:54.072067    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x" event={"ID":"f695ebef-9866-4bd7-ad23-d7be65d9a083","Type":"ContainerStarted","Data":"cb5ada7e8e7c1beb8fe4cebd1e85563699b2c609c7eff6faf360d55c7fc1492b"}
Sep 16 02:30:54.088738 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:54.088688    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp" podStartSLOduration=2.088665278 podStartE2EDuration="2.088665278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:30:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:30:54.086415548 +0000 UTC m=+732.136760062" watchObservedRunningTime="2026-09-16 02:30:54.088665278 +0000 UTC m=+732.139009770"
Sep 16 02:30:54.103337 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:54.103295    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x" podStartSLOduration=2.103280351 podStartE2EDuration="2.103280351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:30:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:30:54.101373299 +0000 UTC m=+732.151717810" watchObservedRunningTime="2026-09-16 02:30:54.103280351 +0000 UTC m=+732.153624881"
Sep 16 02:30:54.162067 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:54.162043    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz"
Sep 16 02:30:54.433641 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:54.433594    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz"]
Sep 16 02:30:54.435092 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:30:54.435066    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc29f678b_5e9d_4ca6_96ae_ec9a71e9a09d.slice/crio-0d7cb777c325b1b9ebc1da8d22cad4f54dde59d715f2109ddae8fcb98d265e67 WatchSource:0}: Error finding container 0d7cb777c325b1b9ebc1da8d22cad4f54dde59d715f2109ddae8fcb98d265e67: Status 404 returned error can't find the container with id 0d7cb777c325b1b9ebc1da8d22cad4f54dde59d715f2109ddae8fcb98d265e67
Sep 16 02:30:54.927488 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:54.927453    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:30:55.079353 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:55.079315    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz" event={"ID":"c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d","Type":"ContainerStarted","Data":"92c5e7734106feb01076e71401529bdbcc3c9fa2c45bfde9b222c8c27fc236ae"}
Sep 16 02:30:55.079543 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:55.079440    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz" event={"ID":"c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d","Type":"ContainerStarted","Data":"0d7cb777c325b1b9ebc1da8d22cad4f54dde59d715f2109ddae8fcb98d265e67"}
Sep 16 02:30:55.079676 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:55.079647    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz"
Sep 16 02:30:55.079816 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:55.079699    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x"
Sep 16 02:30:55.096812 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:55.096773    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz" podStartSLOduration=2.09675959 podStartE2EDuration="2.09675959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:30:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:30:55.094129043 +0000 UTC m=+733.144473560" watchObservedRunningTime="2026-09-16 02:30:55.09675959 +0000 UTC m=+733.147104088"
Sep 16 02:30:55.542838 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:30:55.542805    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:04.076184 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:04.076144    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw"
Sep 16 02:31:04.077108 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:04.077084    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2"
Sep 16 02:31:04.440796 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:04.440767    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:04.538559 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:04.538529    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:04.671412 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:04.671330    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:05.082640 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:05.082548    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp"
Sep 16 02:31:06.087050 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:06.087018    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x"
Sep 16 02:31:06.087433 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:06.087214    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz"
Sep 16 02:31:08.165556 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:08.165528    2565 generic.go:356] "Generic (PLEG): container finished" podID="334f809c-9853-46bc-a0d9-2dd32e2ef6f5" containerID="bd18e62193f69576c767035b9b11706e18da929dd010af52cc4e3ac7fd259618" exitCode=0
Sep 16 02:31:08.166000 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:08.165607    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k" event={"ID":"334f809c-9853-46bc-a0d9-2dd32e2ef6f5","Type":"ContainerDied","Data":"bd18e62193f69576c767035b9b11706e18da929dd010af52cc4e3ac7fd259618"}
Sep 16 02:31:08.166072 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:08.166023    2565 scope.go:117] "RemoveContainer" containerID="bd18e62193f69576c767035b9b11706e18da929dd010af52cc4e3ac7fd259618"
Sep 16 02:31:08.167156 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:08.167123    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:31:08.167273 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:08.167202    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:31:08.167273 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:08.167255    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:31:08.167433 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:08.167415    2565 generic.go:356] "Generic (PLEG): container finished" podID="d57bf4a3-5179-4b37-8542-0017543e6b1d" containerID="db5e6ea0126444102fc3e5f4f067ce99620b9e1bb40f18bccf47e84570576d4b" exitCode=0
Sep 16 02:31:08.167509 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:08.167487    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp" event={"ID":"d57bf4a3-5179-4b37-8542-0017543e6b1d","Type":"ContainerDied","Data":"db5e6ea0126444102fc3e5f4f067ce99620b9e1bb40f18bccf47e84570576d4b"}
Sep 16 02:31:08.167812 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:08.167799    2565 scope.go:117] "RemoveContainer" containerID="db5e6ea0126444102fc3e5f4f067ce99620b9e1bb40f18bccf47e84570576d4b"
Sep 16 02:31:08.168769 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:08.168745    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:31:08.168848 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:08.168804    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:31:08.168848 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:08.168839    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:31:09.181459 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:09.181415    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k" event={"ID":"334f809c-9853-46bc-a0d9-2dd32e2ef6f5","Type":"ContainerStarted","Data":"626a2b2f141344ff3a7785fbf5f45a7a175e730f9d6efcc3dbbc5d99076041f3"}
Sep 16 02:31:09.185104 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:09.184974    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp" event={"ID":"d57bf4a3-5179-4b37-8542-0017543e6b1d","Type":"ContainerStarted","Data":"ba52cdf9d344f9c33056acbec8293faea4903ab17510e7fb5cdfbed8b12dfd29"}
Sep 16 02:31:09.403715 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:09.403673    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:31:09.403925 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:09.403897    2565 patch_prober.go:28] interesting pod/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 16 02:31:09.403979 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:09.403956    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp" podUID="d57bf4a3-5179-4b37-8542-0017543e6b1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 16 02:31:09.465853 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:09.465029    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:31:09.465853 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:09.465453    2565 patch_prober.go:28] interesting pod/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 16 02:31:09.465853 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:09.465503    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k" podUID="334f809c-9853-46bc-a0d9-2dd32e2ef6f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 16 02:31:10.143758 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:10.143725    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:10.208287 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:10.208251    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:10.285514 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:10.285470    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:10.380301 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:10.380237    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:10.403682 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:10.403600    2565 patch_prober.go:28] interesting pod/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 16 02:31:10.403682 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:10.403649    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp" podUID="d57bf4a3-5179-4b37-8542-0017543e6b1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 16 02:31:10.465022 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:10.464980    2565 patch_prober.go:28] interesting pod/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 16 02:31:10.465200 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:10.465041    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k" podUID="334f809c-9853-46bc-a0d9-2dd32e2ef6f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 16 02:31:10.510996 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:10.510966    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:11.403887 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:11.403849    2565 patch_prober.go:28] interesting pod/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 16 02:31:11.404231 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:11.403906    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp" podUID="d57bf4a3-5179-4b37-8542-0017543e6b1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 16 02:31:11.464354 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:11.464312    2565 patch_prober.go:28] interesting pod/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 16 02:31:11.464548 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:11.464395    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k" podUID="334f809c-9853-46bc-a0d9-2dd32e2ef6f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 16 02:31:12.156347 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:12.156303    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:12.404161 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:12.404119    2565 patch_prober.go:28] interesting pod/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 16 02:31:12.404654 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:12.404172    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp" podUID="d57bf4a3-5179-4b37-8542-0017543e6b1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 16 02:31:12.465480 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:12.465388    2565 patch_prober.go:28] interesting pod/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 16 02:31:12.465480 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:12.465455    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k" podUID="334f809c-9853-46bc-a0d9-2dd32e2ef6f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 16 02:31:13.404589 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:13.404554    2565 patch_prober.go:28] interesting pod/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 16 02:31:13.405073 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:13.404601    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp" podUID="d57bf4a3-5179-4b37-8542-0017543e6b1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 16 02:31:13.465104 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:13.465069    2565 patch_prober.go:28] interesting pod/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 16 02:31:13.465388 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:13.465336    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k" podUID="334f809c-9853-46bc-a0d9-2dd32e2ef6f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 16 02:31:13.916964 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:13.916932    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:14.505236 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:14.505196    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:31:14.505724 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:14.505627    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:31:14.507873 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:14.507842    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:31:14.637240 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:14.637211    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:31:14.638657 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:14.638637    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:31:14.639954 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:14.639936    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:31:14.941866 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:14.941829    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:15.042502 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:15.042470    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:15.313683 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:15.313597    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:15.441774 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:15.441730    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:15.533553 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:15.533522    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:15.626256 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:15.626152    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:15.687299 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:15.687263    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:15.886708 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:15.886618    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:15.987148 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:15.987118    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:16.788952 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:16.788914    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:16.889122 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:16.889087    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:17.832561 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:17.832525    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:18.433156 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:18.433123    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:18.528966 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:18.528927    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:18.594909 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:18.594876    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:19.234833 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:19.234798    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:20.150866 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:20.150829    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:20.471076 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:20.471041    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:20.738254 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:20.738180    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:20.838787 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:20.838754    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:20.943622 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:20.943584    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:21.041860 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:21.041796    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:21.140622 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:21.140583    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:21.266761 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:21.266724    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:21.378297 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:21.378209    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:25.780794 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:25.780761    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:30.257777 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:30.257740    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:35.385014 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:35.384975    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8" secret="" err="secret \"payload-processing-dockercfg-7v8jt\" not found"
Sep 16 02:31:42.858122 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:42.858078    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:43.296662 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:43.296624    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:43.717092 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:43.717052    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:44.332052 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:44.332011    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:44.927544 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:44.927514    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:57.046494 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:57.046448    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:31:57.096003 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:31:57.095973    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:32:03.470434 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:03.470399    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:32:12.768493 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:12.768411    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:32:26.856503 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:26.856470    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"]
Sep 16 02:32:26.858967 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:26.858951    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"
Sep 16 02:32:26.862161 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:26.862134    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-5b59aa\"/\"kube-root-ca.crt\""
Sep 16 02:32:26.862334 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:26.862142    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-5b59aa\"/\"premium-w0-5b59aa-kserve-self-signed-certs\""
Sep 16 02:32:26.862475 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:26.862142    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-5b59aa\"/\"openshift-service-ca.crt\""
Sep 16 02:32:26.862475 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:26.862174    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-5b59aa\"/\"default-dockercfg-w688b\""
Sep 16 02:32:26.869434 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:26.869412    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"]
Sep 16 02:32:26.883936 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:26.883908    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:32:26.989781 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:26.989731    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3f1e719-d68a-4163-b3b6-40402dc2942f-dshm\") pod \"premium-w0-5b59aa-kserve-f6cfb9485-kwmvr\" (UID: \"a3f1e719-d68a-4163-b3b6-40402dc2942f\") " pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"
Sep 16 02:32:26.989964 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:26.989807    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76ncf\" (UniqueName: \"kubernetes.io/projected/a3f1e719-d68a-4163-b3b6-40402dc2942f-kube-api-access-76ncf\") pod \"premium-w0-5b59aa-kserve-f6cfb9485-kwmvr\" (UID: \"a3f1e719-d68a-4163-b3b6-40402dc2942f\") " pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"
Sep 16 02:32:26.989964 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:26.989840    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3f1e719-d68a-4163-b3b6-40402dc2942f-home\") pod \"premium-w0-5b59aa-kserve-f6cfb9485-kwmvr\" (UID: \"a3f1e719-d68a-4163-b3b6-40402dc2942f\") " pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"
Sep 16 02:32:26.989964 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:26.989866    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3f1e719-d68a-4163-b3b6-40402dc2942f-tmp-dir\") pod \"premium-w0-5b59aa-kserve-f6cfb9485-kwmvr\" (UID: \"a3f1e719-d68a-4163-b3b6-40402dc2942f\") " pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"
Sep 16 02:32:26.989964 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:26.989889    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3f1e719-d68a-4163-b3b6-40402dc2942f-tls-certs\") pod \"premium-w0-5b59aa-kserve-f6cfb9485-kwmvr\" (UID: \"a3f1e719-d68a-4163-b3b6-40402dc2942f\") " pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"
Sep 16 02:32:26.989964 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:26.989916    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3f1e719-d68a-4163-b3b6-40402dc2942f-model-cache\") pod \"premium-w0-5b59aa-kserve-f6cfb9485-kwmvr\" (UID: \"a3f1e719-d68a-4163-b3b6-40402dc2942f\") " pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"
Sep 16 02:32:27.090649 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:27.090614    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3f1e719-d68a-4163-b3b6-40402dc2942f-dshm\") pod \"premium-w0-5b59aa-kserve-f6cfb9485-kwmvr\" (UID: \"a3f1e719-d68a-4163-b3b6-40402dc2942f\") " pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"
Sep 16 02:32:27.090900 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:27.090673    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76ncf\" (UniqueName: \"kubernetes.io/projected/a3f1e719-d68a-4163-b3b6-40402dc2942f-kube-api-access-76ncf\") pod \"premium-w0-5b59aa-kserve-f6cfb9485-kwmvr\" (UID: \"a3f1e719-d68a-4163-b3b6-40402dc2942f\") " pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"
Sep 16 02:32:27.090900 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:27.090704    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3f1e719-d68a-4163-b3b6-40402dc2942f-home\") pod \"premium-w0-5b59aa-kserve-f6cfb9485-kwmvr\" (UID: \"a3f1e719-d68a-4163-b3b6-40402dc2942f\") " pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"
Sep 16 02:32:27.090900 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:27.090738    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3f1e719-d68a-4163-b3b6-40402dc2942f-tmp-dir\") pod \"premium-w0-5b59aa-kserve-f6cfb9485-kwmvr\" (UID: \"a3f1e719-d68a-4163-b3b6-40402dc2942f\") " pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"
Sep 16 02:32:27.090900 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:27.090764    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3f1e719-d68a-4163-b3b6-40402dc2942f-tls-certs\") pod \"premium-w0-5b59aa-kserve-f6cfb9485-kwmvr\" (UID: \"a3f1e719-d68a-4163-b3b6-40402dc2942f\") " pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"
Sep 16 02:32:27.090900 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:27.090792    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3f1e719-d68a-4163-b3b6-40402dc2942f-model-cache\") pod \"premium-w0-5b59aa-kserve-f6cfb9485-kwmvr\" (UID: \"a3f1e719-d68a-4163-b3b6-40402dc2942f\") " pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"
Sep 16 02:32:27.091220 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:27.091121    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3f1e719-d68a-4163-b3b6-40402dc2942f-home\") pod \"premium-w0-5b59aa-kserve-f6cfb9485-kwmvr\" (UID: \"a3f1e719-d68a-4163-b3b6-40402dc2942f\") " pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"
Sep 16 02:32:27.091220 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:27.091154    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3f1e719-d68a-4163-b3b6-40402dc2942f-tmp-dir\") pod \"premium-w0-5b59aa-kserve-f6cfb9485-kwmvr\" (UID: \"a3f1e719-d68a-4163-b3b6-40402dc2942f\") " pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"
Sep 16 02:32:27.091220 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:27.091201    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3f1e719-d68a-4163-b3b6-40402dc2942f-model-cache\") pod \"premium-w0-5b59aa-kserve-f6cfb9485-kwmvr\" (UID: \"a3f1e719-d68a-4163-b3b6-40402dc2942f\") " pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"
Sep 16 02:32:27.093030 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:27.093009    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3f1e719-d68a-4163-b3b6-40402dc2942f-dshm\") pod \"premium-w0-5b59aa-kserve-f6cfb9485-kwmvr\" (UID: \"a3f1e719-d68a-4163-b3b6-40402dc2942f\") " pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"
Sep 16 02:32:27.093173 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:27.093156    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3f1e719-d68a-4163-b3b6-40402dc2942f-tls-certs\") pod \"premium-w0-5b59aa-kserve-f6cfb9485-kwmvr\" (UID: \"a3f1e719-d68a-4163-b3b6-40402dc2942f\") " pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"
Sep 16 02:32:27.098012 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:27.097992    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76ncf\" (UniqueName: \"kubernetes.io/projected/a3f1e719-d68a-4163-b3b6-40402dc2942f-kube-api-access-76ncf\") pod \"premium-w0-5b59aa-kserve-f6cfb9485-kwmvr\" (UID: \"a3f1e719-d68a-4163-b3b6-40402dc2942f\") " pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"
Sep 16 02:32:27.171101 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:27.171059    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"
Sep 16 02:32:27.440085 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:27.440057    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"]
Sep 16 02:32:27.441407 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:32:27.441381    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3f1e719_d68a_4163_b3b6_40402dc2942f.slice/crio-8e0c62b32b0c4ffa1fd2600e8bc8f94f4588546b80aa8ea331e1b84d07fb0e8c WatchSource:0}: Error finding container 8e0c62b32b0c4ffa1fd2600e8bc8f94f4588546b80aa8ea331e1b84d07fb0e8c: Status 404 returned error can't find the container with id 8e0c62b32b0c4ffa1fd2600e8bc8f94f4588546b80aa8ea331e1b84d07fb0e8c
Sep 16 02:32:27.642150 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:27.642110    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr" event={"ID":"a3f1e719-d68a-4163-b3b6-40402dc2942f","Type":"ContainerStarted","Data":"39ea520db8a17f018387b51e2056fd78db774ec62bd16e761c1f62dc58498838"}
Sep 16 02:32:27.642300 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:27.642158    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr" event={"ID":"a3f1e719-d68a-4163-b3b6-40402dc2942f","Type":"ContainerStarted","Data":"8e0c62b32b0c4ffa1fd2600e8bc8f94f4588546b80aa8ea331e1b84d07fb0e8c"}
Sep 16 02:32:27.658526 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:27.658477    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr" podStartSLOduration=1.6584613099999999 podStartE2EDuration="1.65846131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:32:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:32:27.656714178 +0000 UTC m=+825.707058691" watchObservedRunningTime="2026-09-16 02:32:27.65846131 +0000 UTC m=+825.708805861"
Sep 16 02:32:37.171243 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:37.171202    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"
Sep 16 02:32:37.171867 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:37.171261    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"
Sep 16 02:32:37.184405 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:37.184375    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"
Sep 16 02:32:37.713454 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:37.713423    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"
Sep 16 02:32:51.385101 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:32:51.385067    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8" secret="" err="secret \"payload-processing-dockercfg-7v8jt\" not found"
Sep 16 02:33:23.576292 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:33:23.576251    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:33:36.777660 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:33:36.777578    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:34:02.254980 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:02.254946    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"]
Sep 16 02:34:02.258489 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:02.258465    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"
Sep 16 02:34:02.261095 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:02.261055    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-5b59aa\"/\"distinct-w0-5b59aa-kserve-self-signed-certs\""
Sep 16 02:34:02.273232 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:02.273178    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"]
Sep 16 02:34:02.284713 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:02.284682    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:34:02.395862 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:02.395828    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37e86c7e-6ff5-4d65-aa01-79835818282d-tls-certs\") pod \"distinct-w0-5b59aa-kserve-66bf97b884-xdrc5\" (UID: \"37e86c7e-6ff5-4d65-aa01-79835818282d\") " pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"
Sep 16 02:34:02.396034 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:02.395868    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37e86c7e-6ff5-4d65-aa01-79835818282d-home\") pod \"distinct-w0-5b59aa-kserve-66bf97b884-xdrc5\" (UID: \"37e86c7e-6ff5-4d65-aa01-79835818282d\") " pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"
Sep 16 02:34:02.396034 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:02.395910    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37e86c7e-6ff5-4d65-aa01-79835818282d-tmp-dir\") pod \"distinct-w0-5b59aa-kserve-66bf97b884-xdrc5\" (UID: \"37e86c7e-6ff5-4d65-aa01-79835818282d\") " pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"
Sep 16 02:34:02.396034 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:02.395992    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37e86c7e-6ff5-4d65-aa01-79835818282d-model-cache\") pod \"distinct-w0-5b59aa-kserve-66bf97b884-xdrc5\" (UID: \"37e86c7e-6ff5-4d65-aa01-79835818282d\") " pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"
Sep 16 02:34:02.396034 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:02.396033    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37e86c7e-6ff5-4d65-aa01-79835818282d-dshm\") pod \"distinct-w0-5b59aa-kserve-66bf97b884-xdrc5\" (UID: \"37e86c7e-6ff5-4d65-aa01-79835818282d\") " pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"
Sep 16 02:34:02.396197 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:02.396053    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6l8w\" (UniqueName: \"kubernetes.io/projected/37e86c7e-6ff5-4d65-aa01-79835818282d-kube-api-access-w6l8w\") pod \"distinct-w0-5b59aa-kserve-66bf97b884-xdrc5\" (UID: \"37e86c7e-6ff5-4d65-aa01-79835818282d\") " pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"
Sep 16 02:34:02.496958 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:02.496925    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37e86c7e-6ff5-4d65-aa01-79835818282d-tmp-dir\") pod \"distinct-w0-5b59aa-kserve-66bf97b884-xdrc5\" (UID: \"37e86c7e-6ff5-4d65-aa01-79835818282d\") " pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"
Sep 16 02:34:02.497111 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:02.497003    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37e86c7e-6ff5-4d65-aa01-79835818282d-model-cache\") pod \"distinct-w0-5b59aa-kserve-66bf97b884-xdrc5\" (UID: \"37e86c7e-6ff5-4d65-aa01-79835818282d\") " pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"
Sep 16 02:34:02.497111 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:02.497051    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37e86c7e-6ff5-4d65-aa01-79835818282d-dshm\") pod \"distinct-w0-5b59aa-kserve-66bf97b884-xdrc5\" (UID: \"37e86c7e-6ff5-4d65-aa01-79835818282d\") " pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"
Sep 16 02:34:02.497111 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:02.497077    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6l8w\" (UniqueName: \"kubernetes.io/projected/37e86c7e-6ff5-4d65-aa01-79835818282d-kube-api-access-w6l8w\") pod \"distinct-w0-5b59aa-kserve-66bf97b884-xdrc5\" (UID: \"37e86c7e-6ff5-4d65-aa01-79835818282d\") " pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"
Sep 16 02:34:02.497235 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:02.497121    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37e86c7e-6ff5-4d65-aa01-79835818282d-tls-certs\") pod \"distinct-w0-5b59aa-kserve-66bf97b884-xdrc5\" (UID: \"37e86c7e-6ff5-4d65-aa01-79835818282d\") " pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"
Sep 16 02:34:02.497235 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:02.497150    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37e86c7e-6ff5-4d65-aa01-79835818282d-home\") pod \"distinct-w0-5b59aa-kserve-66bf97b884-xdrc5\" (UID: \"37e86c7e-6ff5-4d65-aa01-79835818282d\") " pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"
Sep 16 02:34:02.497451 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:02.497431    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37e86c7e-6ff5-4d65-aa01-79835818282d-tmp-dir\") pod \"distinct-w0-5b59aa-kserve-66bf97b884-xdrc5\" (UID: \"37e86c7e-6ff5-4d65-aa01-79835818282d\") " pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"
Sep 16 02:34:02.497509 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:02.497467    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37e86c7e-6ff5-4d65-aa01-79835818282d-model-cache\") pod \"distinct-w0-5b59aa-kserve-66bf97b884-xdrc5\" (UID: \"37e86c7e-6ff5-4d65-aa01-79835818282d\") " pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"
Sep 16 02:34:02.497509 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:02.497484    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37e86c7e-6ff5-4d65-aa01-79835818282d-home\") pod \"distinct-w0-5b59aa-kserve-66bf97b884-xdrc5\" (UID: \"37e86c7e-6ff5-4d65-aa01-79835818282d\") " pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"
Sep 16 02:34:02.499335 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:02.499314    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37e86c7e-6ff5-4d65-aa01-79835818282d-dshm\") pod \"distinct-w0-5b59aa-kserve-66bf97b884-xdrc5\" (UID: \"37e86c7e-6ff5-4d65-aa01-79835818282d\") " pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"
Sep 16 02:34:02.499729 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:02.499707    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37e86c7e-6ff5-4d65-aa01-79835818282d-tls-certs\") pod \"distinct-w0-5b59aa-kserve-66bf97b884-xdrc5\" (UID: \"37e86c7e-6ff5-4d65-aa01-79835818282d\") " pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"
Sep 16 02:34:02.506234 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:02.506022    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6l8w\" (UniqueName: \"kubernetes.io/projected/37e86c7e-6ff5-4d65-aa01-79835818282d-kube-api-access-w6l8w\") pod \"distinct-w0-5b59aa-kserve-66bf97b884-xdrc5\" (UID: \"37e86c7e-6ff5-4d65-aa01-79835818282d\") " pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"
Sep 16 02:34:02.581540 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:02.581512    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"
Sep 16 02:34:02.853021 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:02.852994    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"]
Sep 16 02:34:02.854173 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:34:02.854145    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37e86c7e_6ff5_4d65_aa01_79835818282d.slice/crio-5d1a99be204452a8a200d0b242480e9dbbe051474a75abe72694881cfeecd039 WatchSource:0}: Error finding container 5d1a99be204452a8a200d0b242480e9dbbe051474a75abe72694881cfeecd039: Status 404 returned error can't find the container with id 5d1a99be204452a8a200d0b242480e9dbbe051474a75abe72694881cfeecd039
Sep 16 02:34:03.223106 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:03.223073    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5" event={"ID":"37e86c7e-6ff5-4d65-aa01-79835818282d","Type":"ContainerStarted","Data":"52a5cafb8402d8870ac3d9f41f0bfaf7459be824f5d1a16d08c8b4a36f9e322d"}
Sep 16 02:34:03.223276 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:03.223120    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5" event={"ID":"37e86c7e-6ff5-4d65-aa01-79835818282d","Type":"ContainerStarted","Data":"5d1a99be204452a8a200d0b242480e9dbbe051474a75abe72694881cfeecd039"}
Sep 16 02:34:03.238255 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:03.238205    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5" podStartSLOduration=1.238191209 podStartE2EDuration="1.238191209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:34:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:34:03.237407013 +0000 UTC m=+921.287751507" watchObservedRunningTime="2026-09-16 02:34:03.238191209 +0000 UTC m=+921.288535730"
Sep 16 02:34:03.385000 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:03.384971    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8" secret="" err="secret \"payload-processing-dockercfg-7v8jt\" not found"
Sep 16 02:34:09.251991 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:09.251962    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:34:12.582503 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:12.582469    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"
Sep 16 02:34:12.582875 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:12.582514    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"
Sep 16 02:34:12.595088 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:12.595058    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"
Sep 16 02:34:13.293111 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:13.293082    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"
Sep 16 02:34:14.830736 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:14.830702    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:34:14.886218 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:14.886179    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:34:39.279167 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:39.279137    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:34:42.453828 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:42.453776    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:34:47.325754 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:47.325714    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:34:47.424711 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:47.424681    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:34:47.742240 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:47.742205    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:34:53.352432 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:53.352404    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:34:53.413324 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:53.413298    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:34:53.583355 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:53.583326    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:34:53.839274 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:53.839247    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"]
Sep 16 02:34:53.843117 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:53.843095    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:53.845307 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:53.845286    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-06e75986-openshift-default-dockercfg-59rck\""
Sep 16 02:34:53.855326 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:53.855303    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"]
Sep 16 02:34:53.861802 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:53.861770    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:34:53.960579 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:53.960543    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c1e59a8-8244-4053-b71d-a20a52780adb-istio-podinfo\") pod \"e2e-ait-06e75986-openshift-default-7964f68676-st2jq\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") " pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:53.960757 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:53.960585    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c1e59a8-8244-4053-b71d-a20a52780adb-istio-data\") pod \"e2e-ait-06e75986-openshift-default-7964f68676-st2jq\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") " pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:53.960757 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:53.960672    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1e59a8-8244-4053-b71d-a20a52780adb-credential-socket\") pod \"e2e-ait-06e75986-openshift-default-7964f68676-st2jq\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") " pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:53.960757 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:53.960724    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c1e59a8-8244-4053-b71d-a20a52780adb-workload-certs\") pod \"e2e-ait-06e75986-openshift-default-7964f68676-st2jq\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") " pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:53.960909 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:53.960785    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbccl\" (UniqueName: \"kubernetes.io/projected/6c1e59a8-8244-4053-b71d-a20a52780adb-kube-api-access-wbccl\") pod \"e2e-ait-06e75986-openshift-default-7964f68676-st2jq\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") " pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:53.960909 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:53.960824    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1e59a8-8244-4053-b71d-a20a52780adb-workload-socket\") pod \"e2e-ait-06e75986-openshift-default-7964f68676-st2jq\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") " pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:53.960909 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:53.960870    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c1e59a8-8244-4053-b71d-a20a52780adb-istio-token\") pod \"e2e-ait-06e75986-openshift-default-7964f68676-st2jq\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") " pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:53.961034 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:53.960946    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c1e59a8-8244-4053-b71d-a20a52780adb-istio-envoy\") pod \"e2e-ait-06e75986-openshift-default-7964f68676-st2jq\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") " pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:53.961034 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:53.960971    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c1e59a8-8244-4053-b71d-a20a52780adb-istiod-ca-cert\") pod \"e2e-ait-06e75986-openshift-default-7964f68676-st2jq\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") " pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:54.061843 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:54.061813    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c1e59a8-8244-4053-b71d-a20a52780adb-istio-envoy\") pod \"e2e-ait-06e75986-openshift-default-7964f68676-st2jq\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") " pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:54.062033 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:54.061854    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c1e59a8-8244-4053-b71d-a20a52780adb-istiod-ca-cert\") pod \"e2e-ait-06e75986-openshift-default-7964f68676-st2jq\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") " pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:54.062033 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:54.061883    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c1e59a8-8244-4053-b71d-a20a52780adb-istio-podinfo\") pod \"e2e-ait-06e75986-openshift-default-7964f68676-st2jq\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") " pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:54.062033 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:54.061909    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c1e59a8-8244-4053-b71d-a20a52780adb-istio-data\") pod \"e2e-ait-06e75986-openshift-default-7964f68676-st2jq\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") " pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:54.062033 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:54.061965    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1e59a8-8244-4053-b71d-a20a52780adb-credential-socket\") pod \"e2e-ait-06e75986-openshift-default-7964f68676-st2jq\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") " pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:54.062033 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:54.061988    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c1e59a8-8244-4053-b71d-a20a52780adb-workload-certs\") pod \"e2e-ait-06e75986-openshift-default-7964f68676-st2jq\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") " pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:54.062302 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:54.062063    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbccl\" (UniqueName: \"kubernetes.io/projected/6c1e59a8-8244-4053-b71d-a20a52780adb-kube-api-access-wbccl\") pod \"e2e-ait-06e75986-openshift-default-7964f68676-st2jq\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") " pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:54.062302 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:54.062127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1e59a8-8244-4053-b71d-a20a52780adb-workload-socket\") pod \"e2e-ait-06e75986-openshift-default-7964f68676-st2jq\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") " pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:54.062302 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:54.062153    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c1e59a8-8244-4053-b71d-a20a52780adb-istio-token\") pod \"e2e-ait-06e75986-openshift-default-7964f68676-st2jq\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") " pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:54.062552 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:54.062390    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c1e59a8-8244-4053-b71d-a20a52780adb-istio-data\") pod \"e2e-ait-06e75986-openshift-default-7964f68676-st2jq\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") " pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:54.062552 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:54.062456    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1e59a8-8244-4053-b71d-a20a52780adb-credential-socket\") pod \"e2e-ait-06e75986-openshift-default-7964f68676-st2jq\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") " pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:54.062632 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:54.062577    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c1e59a8-8244-4053-b71d-a20a52780adb-workload-certs\") pod \"e2e-ait-06e75986-openshift-default-7964f68676-st2jq\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") " pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:54.062667 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:54.062636    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1e59a8-8244-4053-b71d-a20a52780adb-workload-socket\") pod \"e2e-ait-06e75986-openshift-default-7964f68676-st2jq\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") " pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:54.062750 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:54.062726    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c1e59a8-8244-4053-b71d-a20a52780adb-istiod-ca-cert\") pod \"e2e-ait-06e75986-openshift-default-7964f68676-st2jq\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") " pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:54.064164 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:54.064146    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c1e59a8-8244-4053-b71d-a20a52780adb-istio-envoy\") pod \"e2e-ait-06e75986-openshift-default-7964f68676-st2jq\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") " pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:54.064438 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:54.064421    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c1e59a8-8244-4053-b71d-a20a52780adb-istio-podinfo\") pod \"e2e-ait-06e75986-openshift-default-7964f68676-st2jq\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") " pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:54.069326 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:54.069306    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c1e59a8-8244-4053-b71d-a20a52780adb-istio-token\") pod \"e2e-ait-06e75986-openshift-default-7964f68676-st2jq\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") " pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:54.069548 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:54.069530    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbccl\" (UniqueName: \"kubernetes.io/projected/6c1e59a8-8244-4053-b71d-a20a52780adb-kube-api-access-wbccl\") pod \"e2e-ait-06e75986-openshift-default-7964f68676-st2jq\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") " pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:54.155012 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:54.154985    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:54.328620 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:54.328583    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:34:54.427581 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:54.427554    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"]
Sep 16 02:34:54.428957 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:34:54.428930    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c1e59a8_8244_4053_b71d_a20a52780adb.slice/crio-2d69b5b21464d15b71eb9adc002c9c585a532408656d87ff55bf06cd1c944f99 WatchSource:0}: Error finding container 2d69b5b21464d15b71eb9adc002c9c585a532408656d87ff55bf06cd1c944f99: Status 404 returned error can't find the container with id 2d69b5b21464d15b71eb9adc002c9c585a532408656d87ff55bf06cd1c944f99
Sep 16 02:34:54.431337 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:54.431309    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:34:54.431429 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:54.431392    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:34:54.431429 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:54.431424    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:34:54.517499 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:54.517441    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq" event={"ID":"6c1e59a8-8244-4053-b71d-a20a52780adb","Type":"ContainerStarted","Data":"f2b9fabfd12e024e3ddb30a7d6f4366bc088bb99a59b72a5e6e86ccc3f183255"}
Sep 16 02:34:54.517635 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:54.517529    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq" event={"ID":"6c1e59a8-8244-4053-b71d-a20a52780adb","Type":"ContainerStarted","Data":"2d69b5b21464d15b71eb9adc002c9c585a532408656d87ff55bf06cd1c944f99"}
Sep 16 02:34:54.539270 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:54.539210    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq" podStartSLOduration=1.539188198 podStartE2EDuration="1.539188198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:34:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:34:54.535470087 +0000 UTC m=+972.585814601" watchObservedRunningTime="2026-09-16 02:34:54.539188198 +0000 UTC m=+972.589532695"
Sep 16 02:34:55.155703 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:55.155664    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:55.160681 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:55.160657    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:55.492805 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:55.492724    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:34:55.523012 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:55.522986    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:55.523906 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:55.523884    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:34:55.869790 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:55.869700    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:34:55.987936 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:55.987906    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:34:56.429261 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:56.429227    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:34:56.573411 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:56.573375    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:34:57.049275 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:57.049241    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:34:57.660516 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:57.660462    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:34:58.520952 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:58.520922    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:34:58.612095 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:58.612048    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:34:58.731493 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:58.731458    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:34:58.941411 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:58.941353    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:34:59.045406 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:59.045356    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:34:59.320082 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:34:59.319947    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:00.036734 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:00.036694    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:05.055241 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:05.055138    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:05.146940 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:05.146897    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6dfb47-54bmp"]
Sep 16 02:35:05.154862 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:05.154834    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6dfb47-54bmp"
Sep 16 02:35:05.157544 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:05.157519    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w8hnp\""
Sep 16 02:35:05.157801 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:05.157768    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 02:35:05.164070 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:05.164042    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6dfb47-54bmp"]
Sep 16 02:35:05.276426 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:05.276339    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cda2717e-8588-465c-99bc-bca7d90c6890-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-6dfb47-54bmp\" (UID: \"cda2717e-8588-465c-99bc-bca7d90c6890\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6dfb47-54bmp"
Sep 16 02:35:05.324496 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:05.324384    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:05.377725 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:05.377685    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cda2717e-8588-465c-99bc-bca7d90c6890-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-6dfb47-54bmp\" (UID: \"cda2717e-8588-465c-99bc-bca7d90c6890\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6dfb47-54bmp"
Sep 16 02:35:05.378327 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:05.378308    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cda2717e-8588-465c-99bc-bca7d90c6890-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-6dfb47-54bmp\" (UID: \"cda2717e-8588-465c-99bc-bca7d90c6890\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6dfb47-54bmp"
Sep 16 02:35:05.471455 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:05.471420    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6dfb47-54bmp"
Sep 16 02:35:05.742976 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:05.742948    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6dfb47-54bmp"]
Sep 16 02:35:05.745657 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:35:05.745628    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcda2717e_8588_465c_99bc_bca7d90c6890.slice/crio-978e497efa5e20f6496ab655842c96b6e02fc5696651dc04506ce82547efc455 WatchSource:0}: Error finding container 978e497efa5e20f6496ab655842c96b6e02fc5696651dc04506ce82547efc455: Status 404 returned error can't find the container with id 978e497efa5e20f6496ab655842c96b6e02fc5696651dc04506ce82547efc455
Sep 16 02:35:06.114514 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:06.114476    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:06.587430 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:06.587398    2565 generic.go:356] "Generic (PLEG): container finished" podID="cda2717e-8588-465c-99bc-bca7d90c6890" containerID="aa8143a603c1d71e0be052f235683ef6899534c903c0cc925c91e7532a759384" exitCode=0
Sep 16 02:35:06.587617 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:06.587446    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6dfb47-54bmp" event={"ID":"cda2717e-8588-465c-99bc-bca7d90c6890","Type":"ContainerDied","Data":"aa8143a603c1d71e0be052f235683ef6899534c903c0cc925c91e7532a759384"}
Sep 16 02:35:06.587617 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:06.587492    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6dfb47-54bmp" event={"ID":"cda2717e-8588-465c-99bc-bca7d90c6890","Type":"ContainerStarted","Data":"978e497efa5e20f6496ab655842c96b6e02fc5696651dc04506ce82547efc455"}
Sep 16 02:35:07.034583 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:07.034548    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:07.676230 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:07.676198    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:07.728796 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:07.728772    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6dfb47-54bmp"
Sep 16 02:35:07.904188 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:07.904113    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cda2717e-8588-465c-99bc-bca7d90c6890-maas-api-service-ca\") pod \"cda2717e-8588-465c-99bc-bca7d90c6890\" (UID: \"cda2717e-8588-465c-99bc-bca7d90c6890\") "
Sep 16 02:35:07.904551 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:07.904531    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cda2717e-8588-465c-99bc-bca7d90c6890-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cda2717e-8588-465c-99bc-bca7d90c6890" (UID: "cda2717e-8588-465c-99bc-bca7d90c6890"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:35:08.005298 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:08.005264    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cda2717e-8588-465c-99bc-bca7d90c6890-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:08.417188 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:08.417154    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:08.601458 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:08.601432    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6dfb47-54bmp"
Sep 16 02:35:08.601618 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:08.601469    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6dfb47-54bmp" event={"ID":"cda2717e-8588-465c-99bc-bca7d90c6890","Type":"ContainerDied","Data":"978e497efa5e20f6496ab655842c96b6e02fc5696651dc04506ce82547efc455"}
Sep 16 02:35:08.601618 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:08.601522    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="978e497efa5e20f6496ab655842c96b6e02fc5696651dc04506ce82547efc455"
Sep 16 02:35:09.010477 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:09.010426    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:09.629693 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:09.629655    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:10.438753 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:10.438701    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:11.099178 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:11.099140    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-06e75986-kwt7g"]
Sep 16 02:35:11.099644 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:11.099630    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cda2717e-8588-465c-99bc-bca7d90c6890" containerName="revoke-keys"
Sep 16 02:35:11.099709 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:11.099646    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cda2717e-8588-465c-99bc-bca7d90c6890" containerName="revoke-keys"
Sep 16 02:35:11.099747 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:11.099711    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cda2717e-8588-465c-99bc-bca7d90c6890" containerName="revoke-keys"
Sep 16 02:35:11.102902 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:11.102886    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-06e75986-kwt7g"
Sep 16 02:35:11.105257 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:11.105233    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w8hnp\""
Sep 16 02:35:11.105383 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:11.105232    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 02:35:11.111075 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:11.111002    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-06e75986-kwt7g"]
Sep 16 02:35:11.132652 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:11.132627    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03b20481-0e4c-41f4-8644-27f672c849e0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-06e75986-kwt7g\" (UID: \"03b20481-0e4c-41f4-8644-27f672c849e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-06e75986-kwt7g"
Sep 16 02:35:11.233257 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:11.233221    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03b20481-0e4c-41f4-8644-27f672c849e0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-06e75986-kwt7g\" (UID: \"03b20481-0e4c-41f4-8644-27f672c849e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-06e75986-kwt7g"
Sep 16 02:35:11.233913 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:11.233892    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03b20481-0e4c-41f4-8644-27f672c849e0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-06e75986-kwt7g\" (UID: \"03b20481-0e4c-41f4-8644-27f672c849e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-06e75986-kwt7g"
Sep 16 02:35:11.254966 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:11.254931    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:11.416119 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:11.416087    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-06e75986-kwt7g"
Sep 16 02:35:11.707871 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:11.707844    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-06e75986-kwt7g"]
Sep 16 02:35:11.709568 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:35:11.709542    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03b20481_0e4c_41f4_8644_27f672c849e0.slice/crio-c667165829ab55bb7bb48ce5a840e3b2acc94a86beb194d3bab6081816a82b2c WatchSource:0}: Error finding container c667165829ab55bb7bb48ce5a840e3b2acc94a86beb194d3bab6081816a82b2c: Status 404 returned error can't find the container with id c667165829ab55bb7bb48ce5a840e3b2acc94a86beb194d3bab6081816a82b2c
Sep 16 02:35:12.388335 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:12.388235    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:12.627065 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:12.627030    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-06e75986-kwt7g" event={"ID":"03b20481-0e4c-41f4-8644-27f672c849e0","Type":"ContainerStarted","Data":"ed2b4bdf803c4e8ce3000bde151d81cca7fec03643fcf7d84bae139c5ade6795"}
Sep 16 02:35:12.627226 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:12.627082    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-06e75986-kwt7g" event={"ID":"03b20481-0e4c-41f4-8644-27f672c849e0","Type":"ContainerStarted","Data":"c667165829ab55bb7bb48ce5a840e3b2acc94a86beb194d3bab6081816a82b2c"}
Sep 16 02:35:12.642716 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:12.642624    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-06e75986-kwt7g" podStartSLOduration=1.642608886 podStartE2EDuration="1.642608886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:35:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:35:12.640065234 +0000 UTC m=+990.690409728" watchObservedRunningTime="2026-09-16 02:35:12.642608886 +0000 UTC m=+990.692953379"
Sep 16 02:35:13.056356 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:13.056295    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:13.634846 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:13.634813    2565 generic.go:356] "Generic (PLEG): container finished" podID="03b20481-0e4c-41f4-8644-27f672c849e0" containerID="ed2b4bdf803c4e8ce3000bde151d81cca7fec03643fcf7d84bae139c5ade6795" exitCode=0
Sep 16 02:35:13.635037 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:13.634906    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-06e75986-kwt7g" event={"ID":"03b20481-0e4c-41f4-8644-27f672c849e0","Type":"ContainerDied","Data":"ed2b4bdf803c4e8ce3000bde151d81cca7fec03643fcf7d84bae139c5ade6795"}
Sep 16 02:35:13.957322 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:13.957261    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:14.385308 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:14.385216    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8" secret="" err="secret \"payload-processing-dockercfg-7v8jt\" not found"
Sep 16 02:35:14.640544 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:14.640445    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:14.831741 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:14.831715    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-06e75986-kwt7g"
Sep 16 02:35:14.874502 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:14.874473    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03b20481-0e4c-41f4-8644-27f672c849e0-maas-api-service-ca\") pod \"03b20481-0e4c-41f4-8644-27f672c849e0\" (UID: \"03b20481-0e4c-41f4-8644-27f672c849e0\") "
Sep 16 02:35:14.875196 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:14.875156    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03b20481-0e4c-41f4-8644-27f672c849e0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "03b20481-0e4c-41f4-8644-27f672c849e0" (UID: "03b20481-0e4c-41f4-8644-27f672c849e0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:35:14.975655 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:14.975623    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03b20481-0e4c-41f4-8644-27f672c849e0-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:15.337120 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:15.337029    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:15.651866 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:15.651778    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-06e75986-kwt7g"
Sep 16 02:35:15.651866 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:15.651828    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-06e75986-kwt7g" event={"ID":"03b20481-0e4c-41f4-8644-27f672c849e0","Type":"ContainerDied","Data":"c667165829ab55bb7bb48ce5a840e3b2acc94a86beb194d3bab6081816a82b2c"}
Sep 16 02:35:15.652408 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:15.651899    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c667165829ab55bb7bb48ce5a840e3b2acc94a86beb194d3bab6081816a82b2c"
Sep 16 02:35:15.914151 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:15.914088    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:15.945027 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:15.944998    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2"]
Sep 16 02:35:15.945253 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:15.945229    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2" podUID="a4247e84-84fc-4968-8dd6-7ec1fa644715" containerName="payload-processing" containerID="cri-o://470360e3c9018fea122998bdfb7d94b609a410d246cbec2a6a79eae3c91fc443" gracePeriod=30
Sep 16 02:35:15.951696 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:15.951670    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw"]
Sep 16 02:35:15.951906 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:15.951879    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw" podUID="70c5b344-e0dd-4985-8134-c55b208b6c37" containerName="payload-pre-processing" containerID="cri-o://48af6aa067677ecd7c55c9d875beb23f0f758e9114f87680a0c6287e22fc1ea2" gracePeriod=30
Sep 16 02:35:15.989658 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:15.989628    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:16.044486 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.044463    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:16.081378 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.081310    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6dfb47-54bmp"]
Sep 16 02:35:16.086918 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.086888    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6dfb47-54bmp"]
Sep 16 02:35:16.103571 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.103538    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:16.272982 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.272958    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw"
Sep 16 02:35:16.276219 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.276197    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2"
Sep 16 02:35:16.293195 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.293165    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70c5b344-e0dd-4985-8134-c55b208b6c37-plugins-config-volume\") pod \"70c5b344-e0dd-4985-8134-c55b208b6c37\" (UID: \"70c5b344-e0dd-4985-8134-c55b208b6c37\") "
Sep 16 02:35:16.293321 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.293206    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxnw2\" (UniqueName: \"kubernetes.io/projected/70c5b344-e0dd-4985-8134-c55b208b6c37-kube-api-access-wxnw2\") pod \"70c5b344-e0dd-4985-8134-c55b208b6c37\" (UID: \"70c5b344-e0dd-4985-8134-c55b208b6c37\") "
Sep 16 02:35:16.293321 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.293230    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qx554\" (UniqueName: \"kubernetes.io/projected/a4247e84-84fc-4968-8dd6-7ec1fa644715-kube-api-access-qx554\") pod \"a4247e84-84fc-4968-8dd6-7ec1fa644715\" (UID: \"a4247e84-84fc-4968-8dd6-7ec1fa644715\") "
Sep 16 02:35:16.293463 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.293334    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4247e84-84fc-4968-8dd6-7ec1fa644715-plugins-config-volume\") pod \"a4247e84-84fc-4968-8dd6-7ec1fa644715\" (UID: \"a4247e84-84fc-4968-8dd6-7ec1fa644715\") "
Sep 16 02:35:16.293666 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.293643    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70c5b344-e0dd-4985-8134-c55b208b6c37-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "70c5b344-e0dd-4985-8134-c55b208b6c37" (UID: "70c5b344-e0dd-4985-8134-c55b208b6c37"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:35:16.293736 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.293683    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4247e84-84fc-4968-8dd6-7ec1fa644715-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a4247e84-84fc-4968-8dd6-7ec1fa644715" (UID: "a4247e84-84fc-4968-8dd6-7ec1fa644715"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:35:16.293736 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.293729    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70c5b344-e0dd-4985-8134-c55b208b6c37-plugins-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:16.295202 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.295178    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70c5b344-e0dd-4985-8134-c55b208b6c37-kube-api-access-wxnw2" (OuterVolumeSpecName: "kube-api-access-wxnw2") pod "70c5b344-e0dd-4985-8134-c55b208b6c37" (UID: "70c5b344-e0dd-4985-8134-c55b208b6c37"). InnerVolumeSpecName "kube-api-access-wxnw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:35:16.295314 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.295278    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4247e84-84fc-4968-8dd6-7ec1fa644715-kube-api-access-qx554" (OuterVolumeSpecName: "kube-api-access-qx554") pod "a4247e84-84fc-4968-8dd6-7ec1fa644715" (UID: "a4247e84-84fc-4968-8dd6-7ec1fa644715"). InnerVolumeSpecName "kube-api-access-qx554". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:35:16.391671 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.391633    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cda2717e-8588-465c-99bc-bca7d90c6890" path="/var/lib/kubelet/pods/cda2717e-8588-465c-99bc-bca7d90c6890/volumes"
Sep 16 02:35:16.394194 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.394172    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4247e84-84fc-4968-8dd6-7ec1fa644715-plugins-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:16.394194 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.394195    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxnw2\" (UniqueName: \"kubernetes.io/projected/70c5b344-e0dd-4985-8134-c55b208b6c37-kube-api-access-wxnw2\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:16.394403 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.394209    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qx554\" (UniqueName: \"kubernetes.io/projected/a4247e84-84fc-4968-8dd6-7ec1fa644715-kube-api-access-qx554\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:16.435853 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.435794    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:16.545597 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.545562    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:16.674431 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.674398    2565 generic.go:356] "Generic (PLEG): container finished" podID="a4247e84-84fc-4968-8dd6-7ec1fa644715" containerID="470360e3c9018fea122998bdfb7d94b609a410d246cbec2a6a79eae3c91fc443" exitCode=0
Sep 16 02:35:16.674916 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.674517    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2"
Sep 16 02:35:16.674916 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.674540    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2" event={"ID":"a4247e84-84fc-4968-8dd6-7ec1fa644715","Type":"ContainerDied","Data":"470360e3c9018fea122998bdfb7d94b609a410d246cbec2a6a79eae3c91fc443"}
Sep 16 02:35:16.674916 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.674596    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2" event={"ID":"a4247e84-84fc-4968-8dd6-7ec1fa644715","Type":"ContainerDied","Data":"9f69e5944709b08a10deea0c21fb2e9fcc231cdc22f2123cbc555e62943bb6f5"}
Sep 16 02:35:16.674916 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.674623    2565 scope.go:117] "RemoveContainer" containerID="470360e3c9018fea122998bdfb7d94b609a410d246cbec2a6a79eae3c91fc443"
Sep 16 02:35:16.676301 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.676274    2565 generic.go:356] "Generic (PLEG): container finished" podID="70c5b344-e0dd-4985-8134-c55b208b6c37" containerID="48af6aa067677ecd7c55c9d875beb23f0f758e9114f87680a0c6287e22fc1ea2" exitCode=0
Sep 16 02:35:16.676469 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.676333    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw" event={"ID":"70c5b344-e0dd-4985-8134-c55b208b6c37","Type":"ContainerDied","Data":"48af6aa067677ecd7c55c9d875beb23f0f758e9114f87680a0c6287e22fc1ea2"}
Sep 16 02:35:16.676469 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.676393    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw" event={"ID":"70c5b344-e0dd-4985-8134-c55b208b6c37","Type":"ContainerDied","Data":"11c5920b77135c94ecc60c134ecee411c3f7b8cd687e09b8cec99f5ef3d8a014"}
Sep 16 02:35:16.676469 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.676438    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw"
Sep 16 02:35:16.684558 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.684541    2565 scope.go:117] "RemoveContainer" containerID="470360e3c9018fea122998bdfb7d94b609a410d246cbec2a6a79eae3c91fc443"
Sep 16 02:35:16.684876 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:35:16.684850    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"470360e3c9018fea122998bdfb7d94b609a410d246cbec2a6a79eae3c91fc443\": container with ID starting with 470360e3c9018fea122998bdfb7d94b609a410d246cbec2a6a79eae3c91fc443 not found: ID does not exist" containerID="470360e3c9018fea122998bdfb7d94b609a410d246cbec2a6a79eae3c91fc443"
Sep 16 02:35:16.684989 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.684882    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"470360e3c9018fea122998bdfb7d94b609a410d246cbec2a6a79eae3c91fc443"} err="failed to get container status \"470360e3c9018fea122998bdfb7d94b609a410d246cbec2a6a79eae3c91fc443\": rpc error: code = NotFound desc = could not find container \"470360e3c9018fea122998bdfb7d94b609a410d246cbec2a6a79eae3c91fc443\": container with ID starting with 470360e3c9018fea122998bdfb7d94b609a410d246cbec2a6a79eae3c91fc443 not found: ID does not exist"
Sep 16 02:35:16.684989 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.684898    2565 scope.go:117] "RemoveContainer" containerID="48af6aa067677ecd7c55c9d875beb23f0f758e9114f87680a0c6287e22fc1ea2"
Sep 16 02:35:16.693873 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.693853    2565 scope.go:117] "RemoveContainer" containerID="48af6aa067677ecd7c55c9d875beb23f0f758e9114f87680a0c6287e22fc1ea2"
Sep 16 02:35:16.694201 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:35:16.694179    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48af6aa067677ecd7c55c9d875beb23f0f758e9114f87680a0c6287e22fc1ea2\": container with ID starting with 48af6aa067677ecd7c55c9d875beb23f0f758e9114f87680a0c6287e22fc1ea2 not found: ID does not exist" containerID="48af6aa067677ecd7c55c9d875beb23f0f758e9114f87680a0c6287e22fc1ea2"
Sep 16 02:35:16.694279 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.694212    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48af6aa067677ecd7c55c9d875beb23f0f758e9114f87680a0c6287e22fc1ea2"} err="failed to get container status \"48af6aa067677ecd7c55c9d875beb23f0f758e9114f87680a0c6287e22fc1ea2\": rpc error: code = NotFound desc = could not find container \"48af6aa067677ecd7c55c9d875beb23f0f758e9114f87680a0c6287e22fc1ea2\": container with ID starting with 48af6aa067677ecd7c55c9d875beb23f0f758e9114f87680a0c6287e22fc1ea2 not found: ID does not exist"
Sep 16 02:35:16.697615 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.697592    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw"]
Sep 16 02:35:16.701518 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.701496    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw"]
Sep 16 02:35:16.713513 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.713491    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2"]
Sep 16 02:35:16.725097 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:16.717743    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2"]
Sep 16 02:35:17.140490 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:17.140433    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:18.031328 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:18.031290    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:18.393131 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:18.393055    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70c5b344-e0dd-4985-8134-c55b208b6c37" path="/var/lib/kubelet/pods/70c5b344-e0dd-4985-8134-c55b208b6c37/volumes"
Sep 16 02:35:18.393476 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:18.393457    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4247e84-84fc-4968-8dd6-7ec1fa644715" path="/var/lib/kubelet/pods/a4247e84-84fc-4968-8dd6-7ec1fa644715/volumes"
Sep 16 02:35:18.617213 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:18.617177    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:19.528182 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:19.528138    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:19.706184 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:19.706154    2565 generic.go:356] "Generic (PLEG): container finished" podID="6c1e59a8-8244-4053-b71d-a20a52780adb" containerID="f2b9fabfd12e024e3ddb30a7d6f4366bc088bb99a59b72a5e6e86ccc3f183255" exitCode=0
Sep 16 02:35:19.706345 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:19.706234    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq" event={"ID":"6c1e59a8-8244-4053-b71d-a20a52780adb","Type":"ContainerDied","Data":"f2b9fabfd12e024e3ddb30a7d6f4366bc088bb99a59b72a5e6e86ccc3f183255"}
Sep 16 02:35:19.706688 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:19.706670    2565 scope.go:117] "RemoveContainer" containerID="f2b9fabfd12e024e3ddb30a7d6f4366bc088bb99a59b72a5e6e86ccc3f183255"
Sep 16 02:35:19.707859 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:19.707835    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:35:19.707928 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:19.707898    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:35:19.707968 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:19.707929    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:35:20.714291 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:20.714258    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq" event={"ID":"6c1e59a8-8244-4053-b71d-a20a52780adb","Type":"ContainerStarted","Data":"377f4458e5bc79d5ff588182fd9bf03eb41f0f96c1678372b726dd5387b757ad"}
Sep 16 02:35:21.156004 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:21.155971    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:35:21.157234 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:21.157201    2565 patch_prober.go:28] interesting pod/e2e-ait-06e75986-openshift-default-7964f68676-st2jq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 16 02:35:21.157374 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:21.157261    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq" podUID="6c1e59a8-8244-4053-b71d-a20a52780adb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 16 02:35:21.705702 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:21.705672    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:21.773384 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:21.768817    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:21.824038 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:21.824002    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:21.890954 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:21.890923    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-06e75986-kwt7g"]
Sep 16 02:35:21.891526 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:21.891501    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:21.893509 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:21.893487    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-06e75986-kwt7g"]
Sep 16 02:35:21.962998 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:21.962913    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:22.021161 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:22.021126    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"]
Sep 16 02:35:22.035548 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:22.035514    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:22.155661 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:22.155615    2565 patch_prober.go:28] interesting pod/e2e-ait-06e75986-openshift-default-7964f68676-st2jq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 16 02:35:22.155867 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:22.155709    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq" podUID="6c1e59a8-8244-4053-b71d-a20a52780adb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 16 02:35:22.391693 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:22.391617    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03b20481-0e4c-41f4-8644-27f672c849e0" path="/var/lib/kubelet/pods/03b20481-0e4c-41f4-8644-27f672c849e0/volumes"
Sep 16 02:35:22.475948 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:22.475901    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:22.588003 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:22.587975    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:22.702857 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:22.702821    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:22.728107 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:22.728067    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq" podUID="6c1e59a8-8244-4053-b71d-a20a52780adb" containerName="istio-proxy" containerID="cri-o://377f4458e5bc79d5ff588182fd9bf03eb41f0f96c1678372b726dd5387b757ad" gracePeriod=30
Sep 16 02:35:22.818816 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:22.818788    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:22.921927 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:22.921894    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:22.962314 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:22.962219    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"]
Sep 16 02:35:22.962902 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:22.962876    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70c5b344-e0dd-4985-8134-c55b208b6c37" containerName="payload-pre-processing"
Sep 16 02:35:22.962902 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:22.962902    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="70c5b344-e0dd-4985-8134-c55b208b6c37" containerName="payload-pre-processing"
Sep 16 02:35:22.963061 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:22.962919    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4247e84-84fc-4968-8dd6-7ec1fa644715" containerName="payload-processing"
Sep 16 02:35:22.963061 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:22.962929    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4247e84-84fc-4968-8dd6-7ec1fa644715" containerName="payload-processing"
Sep 16 02:35:22.963061 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:22.962950    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03b20481-0e4c-41f4-8644-27f672c849e0" containerName="revoke-keys"
Sep 16 02:35:22.963061 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:22.962960    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="03b20481-0e4c-41f4-8644-27f672c849e0" containerName="revoke-keys"
Sep 16 02:35:22.963061 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:22.963061    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="70c5b344-e0dd-4985-8134-c55b208b6c37" containerName="payload-pre-processing"
Sep 16 02:35:22.963333 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:22.963075    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="03b20481-0e4c-41f4-8644-27f672c849e0" containerName="revoke-keys"
Sep 16 02:35:22.963333 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:22.963086    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4247e84-84fc-4968-8dd6-7ec1fa644715" containerName="payload-processing"
Sep 16 02:35:22.967202 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:22.967178    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:22.970676 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:22.970649    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-c40df7fa-gw-openshift-default-dockercfg-gws6n\""
Sep 16 02:35:22.983952 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:22.983930    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"]
Sep 16 02:35:23.002315 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.002280    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:23.053233 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.045725    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"]
Sep 16 02:35:23.053696 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.053666    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp" podUID="d57bf4a3-5179-4b37-8542-0017543e6b1d" containerName="istio-proxy" containerID="cri-o://ba52cdf9d344f9c33056acbec8293faea4903ab17510e7fb5cdfbed8b12dfd29" gracePeriod=30
Sep 16 02:35:23.059570 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.059545    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a2147ee-954e-4901-a0ea-7ff566e10a9e-istiod-ca-cert\") pod \"e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") " pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:23.059773 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.059751    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a2147ee-954e-4901-a0ea-7ff566e10a9e-credential-socket\") pod \"e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") " pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:23.059941 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.059916    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a2147ee-954e-4901-a0ea-7ff566e10a9e-istio-podinfo\") pod \"e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") " pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:23.060073 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.060056    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a2147ee-954e-4901-a0ea-7ff566e10a9e-workload-socket\") pod \"e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") " pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:23.060248 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.060219    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a2147ee-954e-4901-a0ea-7ff566e10a9e-workload-certs\") pod \"e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") " pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:23.060405 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.060388    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a2147ee-954e-4901-a0ea-7ff566e10a9e-istio-envoy\") pod \"e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") " pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:23.060592 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.060559    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a2147ee-954e-4901-a0ea-7ff566e10a9e-istio-token\") pod \"e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") " pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:23.060727 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.060709    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhkx2\" (UniqueName: \"kubernetes.io/projected/0a2147ee-954e-4901-a0ea-7ff566e10a9e-kube-api-access-xhkx2\") pod \"e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") " pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:23.060910 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.060877    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a2147ee-954e-4901-a0ea-7ff566e10a9e-istio-data\") pod \"e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") " pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:23.067636 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.067616    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:23.161876 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.161826    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a2147ee-954e-4901-a0ea-7ff566e10a9e-istio-envoy\") pod \"e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") " pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:23.162071 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.161924    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a2147ee-954e-4901-a0ea-7ff566e10a9e-istio-token\") pod \"e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") " pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:23.162071 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.161953    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhkx2\" (UniqueName: \"kubernetes.io/projected/0a2147ee-954e-4901-a0ea-7ff566e10a9e-kube-api-access-xhkx2\") pod \"e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") " pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:23.162071 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.162012    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a2147ee-954e-4901-a0ea-7ff566e10a9e-istio-data\") pod \"e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") " pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:23.162257 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.162099    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a2147ee-954e-4901-a0ea-7ff566e10a9e-istiod-ca-cert\") pod \"e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") " pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:23.162257 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.162131    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a2147ee-954e-4901-a0ea-7ff566e10a9e-credential-socket\") pod \"e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") " pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:23.162257 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.162178    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a2147ee-954e-4901-a0ea-7ff566e10a9e-istio-podinfo\") pod \"e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") " pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:23.162257 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.162208    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a2147ee-954e-4901-a0ea-7ff566e10a9e-workload-socket\") pod \"e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") " pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:23.162504 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.162262    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a2147ee-954e-4901-a0ea-7ff566e10a9e-workload-certs\") pod \"e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") " pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:23.164813 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.163024    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a2147ee-954e-4901-a0ea-7ff566e10a9e-workload-certs\") pod \"e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") " pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:23.164813 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.163702    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a2147ee-954e-4901-a0ea-7ff566e10a9e-istiod-ca-cert\") pod \"e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") " pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:23.164813 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.164429    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a2147ee-954e-4901-a0ea-7ff566e10a9e-istio-data\") pod \"e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") " pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:23.165531 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.165511    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a2147ee-954e-4901-a0ea-7ff566e10a9e-workload-socket\") pod \"e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") " pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:23.165951 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.165931    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a2147ee-954e-4901-a0ea-7ff566e10a9e-credential-socket\") pod \"e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") " pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:23.166101 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.166075    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:23.172341 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.172318    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a2147ee-954e-4901-a0ea-7ff566e10a9e-istio-podinfo\") pod \"e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") " pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:23.172728 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.172680    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a2147ee-954e-4901-a0ea-7ff566e10a9e-istio-envoy\") pod \"e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") " pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:23.174584 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.174554    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a2147ee-954e-4901-a0ea-7ff566e10a9e-istio-token\") pod \"e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") " pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:23.174751 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.174732    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhkx2\" (UniqueName: \"kubernetes.io/projected/0a2147ee-954e-4901-a0ea-7ff566e10a9e-kube-api-access-xhkx2\") pod \"e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") " pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:23.287226 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.287140    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:23.471733 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.471632    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:23.571793 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.571179    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"]
Sep 16 02:35:23.577923 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.577891    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:35:23.578029 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.577958    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:35:23.578029 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.577985    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:35:23.737651 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.737614    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd" event={"ID":"0a2147ee-954e-4901-a0ea-7ff566e10a9e","Type":"ContainerStarted","Data":"58759b338ffb1c78237404294f0a6b6af9df51153b82b47e16a4abd599107a58"}
Sep 16 02:35:23.737814 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.737683    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd" event={"ID":"0a2147ee-954e-4901-a0ea-7ff566e10a9e","Type":"ContainerStarted","Data":"f6edbbdb91e03d2c234192baf46361297ba11e72f67ac7e0e817895a162b6daf"}
Sep 16 02:35:23.757757 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:23.757700    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd" podStartSLOduration=1.7576787299999999 podStartE2EDuration="1.75767873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:35:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:35:23.755921387 +0000 UTC m=+1001.806265910" watchObservedRunningTime="2026-09-16 02:35:23.75767873 +0000 UTC m=+1001.808023224"
Sep 16 02:35:24.287749 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:24.287707    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:24.292910 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:24.292885    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:24.512132 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:24.512038    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:24.744012 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:24.743972    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:24.744832 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:24.744811    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:25.217888 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:25.217850    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:25.318046 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:25.318012    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:25.523733 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:25.523652    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:35:25.716219 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:25.716181    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:26.646012 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:26.645982    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:26.747255 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:26.747219    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:26.847888 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:26.847852    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:27.078799 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:27.078769    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:27.173758 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:27.173726    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:27.180810 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:27.180784    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8"]
Sep 16 02:35:27.183674 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:27.183650    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8"
Sep 16 02:35:27.187129 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:27.187109    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-c40df7fa-dockercfg-d5w66\""
Sep 16 02:35:27.187129 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:27.187123    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-c40df7fa\""
Sep 16 02:35:27.195539 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:27.195509    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8"]
Sep 16 02:35:27.316176 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:27.316141    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwwzs\" (UniqueName: \"kubernetes.io/projected/39b9061e-0b86-42dd-b965-3c6c2e6b9492-kube-api-access-mwwzs\") pod \"payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8\" (UID: \"39b9061e-0b86-42dd-b965-3c6c2e6b9492\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8"
Sep 16 02:35:27.316340 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:27.316226    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39b9061e-0b86-42dd-b965-3c6c2e6b9492-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8\" (UID: \"39b9061e-0b86-42dd-b965-3c6c2e6b9492\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8"
Sep 16 02:35:27.416858 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:27.416822    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39b9061e-0b86-42dd-b965-3c6c2e6b9492-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8\" (UID: \"39b9061e-0b86-42dd-b965-3c6c2e6b9492\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8"
Sep 16 02:35:27.417023 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:27.416950    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwwzs\" (UniqueName: \"kubernetes.io/projected/39b9061e-0b86-42dd-b965-3c6c2e6b9492-kube-api-access-mwwzs\") pod \"payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8\" (UID: \"39b9061e-0b86-42dd-b965-3c6c2e6b9492\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8"
Sep 16 02:35:27.417610 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:27.417590    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39b9061e-0b86-42dd-b965-3c6c2e6b9492-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8\" (UID: \"39b9061e-0b86-42dd-b965-3c6c2e6b9492\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8"
Sep 16 02:35:27.426914 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:27.426888    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwwzs\" (UniqueName: \"kubernetes.io/projected/39b9061e-0b86-42dd-b965-3c6c2e6b9492-kube-api-access-mwwzs\") pod \"payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8\" (UID: \"39b9061e-0b86-42dd-b965-3c6c2e6b9492\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8"
Sep 16 02:35:27.455034 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:27.455003    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:27.495553 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:27.495526    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8"
Sep 16 02:35:27.770106 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:27.770078    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8"]
Sep 16 02:35:27.771773 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:35:27.771747    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39b9061e_0b86_42dd_b965_3c6c2e6b9492.slice/crio-096d0047b4f215a39e54ae1053ee8cac756b3875917ee0a8ffd8f6bac31bda59 WatchSource:0}: Error finding container 096d0047b4f215a39e54ae1053ee8cac756b3875917ee0a8ffd8f6bac31bda59: Status 404 returned error can't find the container with id 096d0047b4f215a39e54ae1053ee8cac756b3875917ee0a8ffd8f6bac31bda59
Sep 16 02:35:28.218628 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.218599    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:28.307161 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.307121    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:35:28.425841 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.425816    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d57bf4a3-5179-4b37-8542-0017543e6b1d-istio-podinfo\") pod \"d57bf4a3-5179-4b37-8542-0017543e6b1d\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") "
Sep 16 02:35:28.425987 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.425858    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d57bf4a3-5179-4b37-8542-0017543e6b1d-workload-certs\") pod \"d57bf4a3-5179-4b37-8542-0017543e6b1d\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") "
Sep 16 02:35:28.425987 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.425925    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d57bf4a3-5179-4b37-8542-0017543e6b1d-istio-envoy\") pod \"d57bf4a3-5179-4b37-8542-0017543e6b1d\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") "
Sep 16 02:35:28.425987 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.425983    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d57bf4a3-5179-4b37-8542-0017543e6b1d-istio-token\") pod \"d57bf4a3-5179-4b37-8542-0017543e6b1d\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") "
Sep 16 02:35:28.426155 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.426021    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d57bf4a3-5179-4b37-8542-0017543e6b1d-workload-socket\") pod \"d57bf4a3-5179-4b37-8542-0017543e6b1d\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") "
Sep 16 02:35:28.426155 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.426045    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d57bf4a3-5179-4b37-8542-0017543e6b1d-istiod-ca-cert\") pod \"d57bf4a3-5179-4b37-8542-0017543e6b1d\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") "
Sep 16 02:35:28.426155 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.426072    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d57bf4a3-5179-4b37-8542-0017543e6b1d-istio-data\") pod \"d57bf4a3-5179-4b37-8542-0017543e6b1d\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") "
Sep 16 02:35:28.426155 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.426148    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d57bf4a3-5179-4b37-8542-0017543e6b1d-credential-socket\") pod \"d57bf4a3-5179-4b37-8542-0017543e6b1d\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") "
Sep 16 02:35:28.426347 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.426186    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kp946\" (UniqueName: \"kubernetes.io/projected/d57bf4a3-5179-4b37-8542-0017543e6b1d-kube-api-access-kp946\") pod \"d57bf4a3-5179-4b37-8542-0017543e6b1d\" (UID: \"d57bf4a3-5179-4b37-8542-0017543e6b1d\") "
Sep 16 02:35:28.426347 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.426198    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d57bf4a3-5179-4b37-8542-0017543e6b1d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d57bf4a3-5179-4b37-8542-0017543e6b1d" (UID: "d57bf4a3-5179-4b37-8542-0017543e6b1d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:35:28.426583 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.426530    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d57bf4a3-5179-4b37-8542-0017543e6b1d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d57bf4a3-5179-4b37-8542-0017543e6b1d" (UID: "d57bf4a3-5179-4b37-8542-0017543e6b1d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:35:28.426583 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.426555    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d57bf4a3-5179-4b37-8542-0017543e6b1d-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:28.426583 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.426563    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d57bf4a3-5179-4b37-8542-0017543e6b1d-istio-data" (OuterVolumeSpecName: "istio-data") pod "d57bf4a3-5179-4b37-8542-0017543e6b1d" (UID: "d57bf4a3-5179-4b37-8542-0017543e6b1d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:35:28.426876 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.426843    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d57bf4a3-5179-4b37-8542-0017543e6b1d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d57bf4a3-5179-4b37-8542-0017543e6b1d" (UID: "d57bf4a3-5179-4b37-8542-0017543e6b1d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:35:28.427063 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.426974    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d57bf4a3-5179-4b37-8542-0017543e6b1d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d57bf4a3-5179-4b37-8542-0017543e6b1d" (UID: "d57bf4a3-5179-4b37-8542-0017543e6b1d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:35:28.428482 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.428450    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d57bf4a3-5179-4b37-8542-0017543e6b1d-istio-token" (OuterVolumeSpecName: "istio-token") pod "d57bf4a3-5179-4b37-8542-0017543e6b1d" (UID: "d57bf4a3-5179-4b37-8542-0017543e6b1d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:35:28.428590 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.428502    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d57bf4a3-5179-4b37-8542-0017543e6b1d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d57bf4a3-5179-4b37-8542-0017543e6b1d" (UID: "d57bf4a3-5179-4b37-8542-0017543e6b1d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 02:35:28.428590 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.428515    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d57bf4a3-5179-4b37-8542-0017543e6b1d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d57bf4a3-5179-4b37-8542-0017543e6b1d" (UID: "d57bf4a3-5179-4b37-8542-0017543e6b1d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:35:28.428823 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.428802    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d57bf4a3-5179-4b37-8542-0017543e6b1d-kube-api-access-kp946" (OuterVolumeSpecName: "kube-api-access-kp946") pod "d57bf4a3-5179-4b37-8542-0017543e6b1d" (UID: "d57bf4a3-5179-4b37-8542-0017543e6b1d"). InnerVolumeSpecName "kube-api-access-kp946". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:35:28.527643 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.527612    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d57bf4a3-5179-4b37-8542-0017543e6b1d-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:28.527643 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.527636    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d57bf4a3-5179-4b37-8542-0017543e6b1d-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:28.527805 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.527651    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kp946\" (UniqueName: \"kubernetes.io/projected/d57bf4a3-5179-4b37-8542-0017543e6b1d-kube-api-access-kp946\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:28.527805 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.527665    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d57bf4a3-5179-4b37-8542-0017543e6b1d-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:28.527805 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.527677    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d57bf4a3-5179-4b37-8542-0017543e6b1d-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:28.527805 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.527688    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d57bf4a3-5179-4b37-8542-0017543e6b1d-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:28.527805 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.527699    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d57bf4a3-5179-4b37-8542-0017543e6b1d-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:28.527805 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.527710    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d57bf4a3-5179-4b37-8542-0017543e6b1d-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:28.770298 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.770204    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8" event={"ID":"39b9061e-0b86-42dd-b965-3c6c2e6b9492","Type":"ContainerStarted","Data":"241e74d75168798e66df4f039bcd71be42e210f072d4434ea2e61ea72928bdce"}
Sep 16 02:35:28.770298 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.770259    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8" event={"ID":"39b9061e-0b86-42dd-b965-3c6c2e6b9492","Type":"ContainerStarted","Data":"096d0047b4f215a39e54ae1053ee8cac756b3875917ee0a8ffd8f6bac31bda59"}
Sep 16 02:35:28.770787 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.770399    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8"
Sep 16 02:35:28.772068 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.772036    2565 generic.go:356] "Generic (PLEG): container finished" podID="d57bf4a3-5179-4b37-8542-0017543e6b1d" containerID="ba52cdf9d344f9c33056acbec8293faea4903ab17510e7fb5cdfbed8b12dfd29" exitCode=0
Sep 16 02:35:28.772205 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.772083    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"
Sep 16 02:35:28.772205 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.772124    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp" event={"ID":"d57bf4a3-5179-4b37-8542-0017543e6b1d","Type":"ContainerDied","Data":"ba52cdf9d344f9c33056acbec8293faea4903ab17510e7fb5cdfbed8b12dfd29"}
Sep 16 02:35:28.772205 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.772184    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp" event={"ID":"d57bf4a3-5179-4b37-8542-0017543e6b1d","Type":"ContainerDied","Data":"bbaddcb92b88b338e2c168d46d37be43f86cd0c40f13f2cebcbc33be9de54363"}
Sep 16 02:35:28.772380 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.772215    2565 scope.go:117] "RemoveContainer" containerID="ba52cdf9d344f9c33056acbec8293faea4903ab17510e7fb5cdfbed8b12dfd29"
Sep 16 02:35:28.782855 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.782837    2565 scope.go:117] "RemoveContainer" containerID="db5e6ea0126444102fc3e5f4f067ce99620b9e1bb40f18bccf47e84570576d4b"
Sep 16 02:35:28.792449 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.791640    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8" podStartSLOduration=1.791621604 podStartE2EDuration="1.791621604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:35:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:35:28.789664303 +0000 UTC m=+1006.840008817" watchObservedRunningTime="2026-09-16 02:35:28.791621604 +0000 UTC m=+1006.841966101"
Sep 16 02:35:28.793924 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.793666    2565 scope.go:117] "RemoveContainer" containerID="ba52cdf9d344f9c33056acbec8293faea4903ab17510e7fb5cdfbed8b12dfd29"
Sep 16 02:35:28.794031 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:35:28.793982    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba52cdf9d344f9c33056acbec8293faea4903ab17510e7fb5cdfbed8b12dfd29\": container with ID starting with ba52cdf9d344f9c33056acbec8293faea4903ab17510e7fb5cdfbed8b12dfd29 not found: ID does not exist" containerID="ba52cdf9d344f9c33056acbec8293faea4903ab17510e7fb5cdfbed8b12dfd29"
Sep 16 02:35:28.794031 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.794008    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba52cdf9d344f9c33056acbec8293faea4903ab17510e7fb5cdfbed8b12dfd29"} err="failed to get container status \"ba52cdf9d344f9c33056acbec8293faea4903ab17510e7fb5cdfbed8b12dfd29\": rpc error: code = NotFound desc = could not find container \"ba52cdf9d344f9c33056acbec8293faea4903ab17510e7fb5cdfbed8b12dfd29\": container with ID starting with ba52cdf9d344f9c33056acbec8293faea4903ab17510e7fb5cdfbed8b12dfd29 not found: ID does not exist"
Sep 16 02:35:28.794031 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.794024    2565 scope.go:117] "RemoveContainer" containerID="db5e6ea0126444102fc3e5f4f067ce99620b9e1bb40f18bccf47e84570576d4b"
Sep 16 02:35:28.794332 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:35:28.794312    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db5e6ea0126444102fc3e5f4f067ce99620b9e1bb40f18bccf47e84570576d4b\": container with ID starting with db5e6ea0126444102fc3e5f4f067ce99620b9e1bb40f18bccf47e84570576d4b not found: ID does not exist" containerID="db5e6ea0126444102fc3e5f4f067ce99620b9e1bb40f18bccf47e84570576d4b"
Sep 16 02:35:28.794404 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.794338    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db5e6ea0126444102fc3e5f4f067ce99620b9e1bb40f18bccf47e84570576d4b"} err="failed to get container status \"db5e6ea0126444102fc3e5f4f067ce99620b9e1bb40f18bccf47e84570576d4b\": rpc error: code = NotFound desc = could not find container \"db5e6ea0126444102fc3e5f4f067ce99620b9e1bb40f18bccf47e84570576d4b\": container with ID starting with db5e6ea0126444102fc3e5f4f067ce99620b9e1bb40f18bccf47e84570576d4b not found: ID does not exist"
Sep 16 02:35:28.804698 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.804677    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"]
Sep 16 02:35:28.812746 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:28.812722    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp"]
Sep 16 02:35:29.043963 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:29.043861    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:29.818634 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:29.818589    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:30.398678 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:30.398641    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d57bf4a3-5179-4b37-8542-0017543e6b1d" path="/var/lib/kubelet/pods/d57bf4a3-5179-4b37-8542-0017543e6b1d/volumes"
Sep 16 02:35:30.977265 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:30.977240    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:35:31.057275 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.057197    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c1e59a8-8244-4053-b71d-a20a52780adb-istio-podinfo\") pod \"6c1e59a8-8244-4053-b71d-a20a52780adb\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") "
Sep 16 02:35:31.057275 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.057237    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c1e59a8-8244-4053-b71d-a20a52780adb-istio-envoy\") pod \"6c1e59a8-8244-4053-b71d-a20a52780adb\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") "
Sep 16 02:35:31.057503 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.057295    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c1e59a8-8244-4053-b71d-a20a52780adb-workload-certs\") pod \"6c1e59a8-8244-4053-b71d-a20a52780adb\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") "
Sep 16 02:35:31.057503 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.057318    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1e59a8-8244-4053-b71d-a20a52780adb-credential-socket\") pod \"6c1e59a8-8244-4053-b71d-a20a52780adb\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") "
Sep 16 02:35:31.057503 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.057400    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c1e59a8-8244-4053-b71d-a20a52780adb-istio-data\") pod \"6c1e59a8-8244-4053-b71d-a20a52780adb\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") "
Sep 16 02:35:31.057503 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.057428    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c1e59a8-8244-4053-b71d-a20a52780adb-istio-token\") pod \"6c1e59a8-8244-4053-b71d-a20a52780adb\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") "
Sep 16 02:35:31.057503 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.057463    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbccl\" (UniqueName: \"kubernetes.io/projected/6c1e59a8-8244-4053-b71d-a20a52780adb-kube-api-access-wbccl\") pod \"6c1e59a8-8244-4053-b71d-a20a52780adb\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") "
Sep 16 02:35:31.057755 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.057511    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c1e59a8-8244-4053-b71d-a20a52780adb-istiod-ca-cert\") pod \"6c1e59a8-8244-4053-b71d-a20a52780adb\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") "
Sep 16 02:35:31.057755 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.057537    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1e59a8-8244-4053-b71d-a20a52780adb-workload-socket\") pod \"6c1e59a8-8244-4053-b71d-a20a52780adb\" (UID: \"6c1e59a8-8244-4053-b71d-a20a52780adb\") "
Sep 16 02:35:31.057755 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.057655    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c1e59a8-8244-4053-b71d-a20a52780adb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6c1e59a8-8244-4053-b71d-a20a52780adb" (UID: "6c1e59a8-8244-4053-b71d-a20a52780adb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:35:31.057755 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.057671    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c1e59a8-8244-4053-b71d-a20a52780adb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6c1e59a8-8244-4053-b71d-a20a52780adb" (UID: "6c1e59a8-8244-4053-b71d-a20a52780adb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:35:31.058000 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.057909    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c1e59a8-8244-4053-b71d-a20a52780adb-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:31.058000 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.057913    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c1e59a8-8244-4053-b71d-a20a52780adb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6c1e59a8-8244-4053-b71d-a20a52780adb" (UID: "6c1e59a8-8244-4053-b71d-a20a52780adb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:35:31.058000 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.057929    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1e59a8-8244-4053-b71d-a20a52780adb-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:31.058000 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.057992    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c1e59a8-8244-4053-b71d-a20a52780adb-istio-data" (OuterVolumeSpecName: "istio-data") pod "6c1e59a8-8244-4053-b71d-a20a52780adb" (UID: "6c1e59a8-8244-4053-b71d-a20a52780adb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:35:31.058145 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.057999    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c1e59a8-8244-4053-b71d-a20a52780adb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6c1e59a8-8244-4053-b71d-a20a52780adb" (UID: "6c1e59a8-8244-4053-b71d-a20a52780adb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:35:31.059652 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.059630    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6c1e59a8-8244-4053-b71d-a20a52780adb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6c1e59a8-8244-4053-b71d-a20a52780adb" (UID: "6c1e59a8-8244-4053-b71d-a20a52780adb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 02:35:31.059821 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.059799    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c1e59a8-8244-4053-b71d-a20a52780adb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6c1e59a8-8244-4053-b71d-a20a52780adb" (UID: "6c1e59a8-8244-4053-b71d-a20a52780adb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:35:31.060052 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.060030    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c1e59a8-8244-4053-b71d-a20a52780adb-kube-api-access-wbccl" (OuterVolumeSpecName: "kube-api-access-wbccl") pod "6c1e59a8-8244-4053-b71d-a20a52780adb" (UID: "6c1e59a8-8244-4053-b71d-a20a52780adb"). InnerVolumeSpecName "kube-api-access-wbccl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:35:31.060158 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.060093    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c1e59a8-8244-4053-b71d-a20a52780adb-istio-token" (OuterVolumeSpecName: "istio-token") pod "6c1e59a8-8244-4053-b71d-a20a52780adb" (UID: "6c1e59a8-8244-4053-b71d-a20a52780adb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:35:31.158756 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.158726    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c1e59a8-8244-4053-b71d-a20a52780adb-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:31.158756 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.158755    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1e59a8-8244-4053-b71d-a20a52780adb-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:31.158928 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.158764    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c1e59a8-8244-4053-b71d-a20a52780adb-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:31.158928 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.158773    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c1e59a8-8244-4053-b71d-a20a52780adb-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:31.158928 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.158782    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c1e59a8-8244-4053-b71d-a20a52780adb-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:31.158928 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.158789    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c1e59a8-8244-4053-b71d-a20a52780adb-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:31.158928 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.158797    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbccl\" (UniqueName: \"kubernetes.io/projected/6c1e59a8-8244-4053-b71d-a20a52780adb-kube-api-access-wbccl\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:31.794490 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.794459    2565 generic.go:356] "Generic (PLEG): container finished" podID="6c1e59a8-8244-4053-b71d-a20a52780adb" containerID="377f4458e5bc79d5ff588182fd9bf03eb41f0f96c1678372b726dd5387b757ad" exitCode=0
Sep 16 02:35:31.794669 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.794505    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"
Sep 16 02:35:31.794669 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.794555    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq" event={"ID":"6c1e59a8-8244-4053-b71d-a20a52780adb","Type":"ContainerDied","Data":"377f4458e5bc79d5ff588182fd9bf03eb41f0f96c1678372b726dd5387b757ad"}
Sep 16 02:35:31.794669 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.794614    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq" event={"ID":"6c1e59a8-8244-4053-b71d-a20a52780adb","Type":"ContainerDied","Data":"2d69b5b21464d15b71eb9adc002c9c585a532408656d87ff55bf06cd1c944f99"}
Sep 16 02:35:31.794669 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.794637    2565 scope.go:117] "RemoveContainer" containerID="377f4458e5bc79d5ff588182fd9bf03eb41f0f96c1678372b726dd5387b757ad"
Sep 16 02:35:31.804527 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.804509    2565 scope.go:117] "RemoveContainer" containerID="f2b9fabfd12e024e3ddb30a7d6f4366bc088bb99a59b72a5e6e86ccc3f183255"
Sep 16 02:35:31.813579 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.813502    2565 scope.go:117] "RemoveContainer" containerID="377f4458e5bc79d5ff588182fd9bf03eb41f0f96c1678372b726dd5387b757ad"
Sep 16 02:35:31.816172 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:35:31.816133    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"377f4458e5bc79d5ff588182fd9bf03eb41f0f96c1678372b726dd5387b757ad\": container with ID starting with 377f4458e5bc79d5ff588182fd9bf03eb41f0f96c1678372b726dd5387b757ad not found: ID does not exist" containerID="377f4458e5bc79d5ff588182fd9bf03eb41f0f96c1678372b726dd5387b757ad"
Sep 16 02:35:31.816262 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.816172    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"377f4458e5bc79d5ff588182fd9bf03eb41f0f96c1678372b726dd5387b757ad"} err="failed to get container status \"377f4458e5bc79d5ff588182fd9bf03eb41f0f96c1678372b726dd5387b757ad\": rpc error: code = NotFound desc = could not find container \"377f4458e5bc79d5ff588182fd9bf03eb41f0f96c1678372b726dd5387b757ad\": container with ID starting with 377f4458e5bc79d5ff588182fd9bf03eb41f0f96c1678372b726dd5387b757ad not found: ID does not exist"
Sep 16 02:35:31.816262 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.816195    2565 scope.go:117] "RemoveContainer" containerID="f2b9fabfd12e024e3ddb30a7d6f4366bc088bb99a59b72a5e6e86ccc3f183255"
Sep 16 02:35:31.816618 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:35:31.816592    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2b9fabfd12e024e3ddb30a7d6f4366bc088bb99a59b72a5e6e86ccc3f183255\": container with ID starting with f2b9fabfd12e024e3ddb30a7d6f4366bc088bb99a59b72a5e6e86ccc3f183255 not found: ID does not exist" containerID="f2b9fabfd12e024e3ddb30a7d6f4366bc088bb99a59b72a5e6e86ccc3f183255"
Sep 16 02:35:31.816719 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.816619    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2b9fabfd12e024e3ddb30a7d6f4366bc088bb99a59b72a5e6e86ccc3f183255"} err="failed to get container status \"f2b9fabfd12e024e3ddb30a7d6f4366bc088bb99a59b72a5e6e86ccc3f183255\": rpc error: code = NotFound desc = could not find container \"f2b9fabfd12e024e3ddb30a7d6f4366bc088bb99a59b72a5e6e86ccc3f183255\": container with ID starting with f2b9fabfd12e024e3ddb30a7d6f4366bc088bb99a59b72a5e6e86ccc3f183255 not found: ID does not exist"
Sep 16 02:35:31.818957 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.818933    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"]
Sep 16 02:35:31.821568 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:31.821549    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq"]
Sep 16 02:35:32.391922 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:32.391889    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c1e59a8-8244-4053-b71d-a20a52780adb" path="/var/lib/kubelet/pods/6c1e59a8-8244-4053-b71d-a20a52780adb/volumes"
Sep 16 02:35:33.720623 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:33.720593    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:34.253440 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:34.253407    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:34.353765 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:34.353736    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:34.414575 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:34.414542    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:34.473877 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:34.473808    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:34.760773 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:34.760735    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:35.030690 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:35.030608    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:35.818964 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:35.818906    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:36.509568 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:36.509510    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:37.130620 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:37.130578    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:38.118696 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:38.118643    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:39.783190 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:39.783157    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8"
Sep 16 02:35:39.901133 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:39.901097    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c40df7fa-7cjtg"]
Sep 16 02:35:39.901580 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:39.901562    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d57bf4a3-5179-4b37-8542-0017543e6b1d" containerName="istio-proxy"
Sep 16 02:35:39.901580 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:39.901580    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d57bf4a3-5179-4b37-8542-0017543e6b1d" containerName="istio-proxy"
Sep 16 02:35:39.901750 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:39.901588    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d57bf4a3-5179-4b37-8542-0017543e6b1d" containerName="istio-proxy"
Sep 16 02:35:39.901750 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:39.901593    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d57bf4a3-5179-4b37-8542-0017543e6b1d" containerName="istio-proxy"
Sep 16 02:35:39.901750 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:39.901602    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c1e59a8-8244-4053-b71d-a20a52780adb" containerName="istio-proxy"
Sep 16 02:35:39.901750 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:39.901608    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c1e59a8-8244-4053-b71d-a20a52780adb" containerName="istio-proxy"
Sep 16 02:35:39.901750 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:39.901666    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c1e59a8-8244-4053-b71d-a20a52780adb" containerName="istio-proxy"
Sep 16 02:35:39.901750 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:39.901673    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d57bf4a3-5179-4b37-8542-0017543e6b1d" containerName="istio-proxy"
Sep 16 02:35:39.901750 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:39.901679    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c1e59a8-8244-4053-b71d-a20a52780adb" containerName="istio-proxy"
Sep 16 02:35:39.903744 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:39.903726    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c40df7fa-7cjtg"
Sep 16 02:35:39.906081 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:39.906060    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 02:35:39.906196 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:39.906063    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w8hnp\""
Sep 16 02:35:39.915392 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:39.912623    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c40df7fa-7cjtg"]
Sep 16 02:35:40.050586 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:40.050517    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/610d253e-bb0a-48df-89b5-ca6ca3e380f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c40df7fa-7cjtg\" (UID: \"610d253e-bb0a-48df-89b5-ca6ca3e380f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c40df7fa-7cjtg"
Sep 16 02:35:40.151864 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:40.151820    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/610d253e-bb0a-48df-89b5-ca6ca3e380f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c40df7fa-7cjtg\" (UID: \"610d253e-bb0a-48df-89b5-ca6ca3e380f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c40df7fa-7cjtg"
Sep 16 02:35:40.152464 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:40.152446    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/610d253e-bb0a-48df-89b5-ca6ca3e380f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c40df7fa-7cjtg\" (UID: \"610d253e-bb0a-48df-89b5-ca6ca3e380f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c40df7fa-7cjtg"
Sep 16 02:35:40.223422 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:40.223391    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:40.226024 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:40.226006    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c40df7fa-7cjtg"
Sep 16 02:35:40.494656 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:40.494565    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c40df7fa-7cjtg"]
Sep 16 02:35:40.494993 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:35:40.494968    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod610d253e_bb0a_48df_89b5_ca6ca3e380f3.slice/crio-b0b002341c0aa22f8cee95ddf449e5719377d6128f750337c3f473e811cc695d WatchSource:0}: Error finding container b0b002341c0aa22f8cee95ddf449e5719377d6128f750337c3f473e811cc695d: Status 404 returned error can't find the container with id b0b002341c0aa22f8cee95ddf449e5719377d6128f750337c3f473e811cc695d
Sep 16 02:35:40.848486 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:40.848455    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c40df7fa-7cjtg" event={"ID":"610d253e-bb0a-48df-89b5-ca6ca3e380f3","Type":"ContainerStarted","Data":"e090cef9e1fde79eb52606e472ca70d6121f3daa563ba8fcf8d74ff6296dbe29"}
Sep 16 02:35:40.848872 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:40.848555    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c40df7fa-7cjtg" event={"ID":"610d253e-bb0a-48df-89b5-ca6ca3e380f3","Type":"ContainerStarted","Data":"b0b002341c0aa22f8cee95ddf449e5719377d6128f750337c3f473e811cc695d"}
Sep 16 02:35:40.865105 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:40.865063    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c40df7fa-7cjtg" podStartSLOduration=1.86505081 podStartE2EDuration="1.86505081s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:35:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:35:40.862049448 +0000 UTC m=+1018.912393961" watchObservedRunningTime="2026-09-16 02:35:40.86505081 +0000 UTC m=+1018.915395302"
Sep 16 02:35:41.001978 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:41.001903    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:41.098261 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:41.098233    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:41.250890 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:41.250855    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:41.807421 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:41.807387    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:41.856548 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:41.856515    2565 generic.go:356] "Generic (PLEG): container finished" podID="610d253e-bb0a-48df-89b5-ca6ca3e380f3" containerID="e090cef9e1fde79eb52606e472ca70d6121f3daa563ba8fcf8d74ff6296dbe29" exitCode=0
Sep 16 02:35:41.856874 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:41.856601    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c40df7fa-7cjtg" event={"ID":"610d253e-bb0a-48df-89b5-ca6ca3e380f3","Type":"ContainerDied","Data":"e090cef9e1fde79eb52606e472ca70d6121f3daa563ba8fcf8d74ff6296dbe29"}
Sep 16 02:35:41.877204 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:41.877179    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:42.079786 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.079716    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"]
Sep 16 02:35:42.080139 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.080127    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c1e59a8-8244-4053-b71d-a20a52780adb" containerName="istio-proxy"
Sep 16 02:35:42.080182 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.080140    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c1e59a8-8244-4053-b71d-a20a52780adb" containerName="istio-proxy"
Sep 16 02:35:42.080216 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.080207    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d57bf4a3-5179-4b37-8542-0017543e6b1d" containerName="istio-proxy"
Sep 16 02:35:42.082124 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.082109    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:42.084449 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.084429    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-db1ed7-openshift-default-dockercfg-k6lk6\""
Sep 16 02:35:42.094859 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.094836    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"]
Sep 16 02:35:42.110330 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.110301    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:42.172256 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.172193    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/040944c9-d831-4757-96ff-667b76585c7a-workload-certs\") pod \"e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") " pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:42.172465 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.172290    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/040944c9-d831-4757-96ff-667b76585c7a-istio-data\") pod \"e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") " pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:42.172465 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.172321    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/040944c9-d831-4757-96ff-667b76585c7a-istio-podinfo\") pod \"e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") " pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:42.172465 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.172347    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/040944c9-d831-4757-96ff-667b76585c7a-istio-token\") pod \"e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") " pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:42.172465 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.172398    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/040944c9-d831-4757-96ff-667b76585c7a-istio-envoy\") pod \"e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") " pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:42.172465 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.172420    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/040944c9-d831-4757-96ff-667b76585c7a-istiod-ca-cert\") pod \"e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") " pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:42.172741 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.172467    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/040944c9-d831-4757-96ff-667b76585c7a-credential-socket\") pod \"e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") " pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:42.172741 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.172489    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swtk9\" (UniqueName: \"kubernetes.io/projected/040944c9-d831-4757-96ff-667b76585c7a-kube-api-access-swtk9\") pod \"e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") " pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:42.172741 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.172537    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/040944c9-d831-4757-96ff-667b76585c7a-workload-socket\") pod \"e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") " pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:42.274032 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.274002    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/040944c9-d831-4757-96ff-667b76585c7a-credential-socket\") pod \"e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") " pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:42.274032 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.274033    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swtk9\" (UniqueName: \"kubernetes.io/projected/040944c9-d831-4757-96ff-667b76585c7a-kube-api-access-swtk9\") pod \"e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") " pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:42.274290 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.274069    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/040944c9-d831-4757-96ff-667b76585c7a-workload-socket\") pod \"e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") " pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:42.274290 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.274148    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/040944c9-d831-4757-96ff-667b76585c7a-workload-certs\") pod \"e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") " pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:42.274290 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.274198    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/040944c9-d831-4757-96ff-667b76585c7a-istio-data\") pod \"e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") " pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:42.274290 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.274218    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/040944c9-d831-4757-96ff-667b76585c7a-istio-podinfo\") pod \"e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") " pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:42.274290 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.274241    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/040944c9-d831-4757-96ff-667b76585c7a-istio-token\") pod \"e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") " pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:42.274290 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.274263    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/040944c9-d831-4757-96ff-667b76585c7a-istio-envoy\") pod \"e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") " pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:42.274290 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.274277    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/040944c9-d831-4757-96ff-667b76585c7a-istiod-ca-cert\") pod \"e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") " pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:42.274635 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.274437    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/040944c9-d831-4757-96ff-667b76585c7a-credential-socket\") pod \"e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") " pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:42.274635 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.274477    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/040944c9-d831-4757-96ff-667b76585c7a-workload-certs\") pod \"e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") " pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:42.274635 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.274537    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/040944c9-d831-4757-96ff-667b76585c7a-workload-socket\") pod \"e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") " pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:42.274783 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.274763    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/040944c9-d831-4757-96ff-667b76585c7a-istio-data\") pod \"e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") " pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:42.274968 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.274949    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/040944c9-d831-4757-96ff-667b76585c7a-istiod-ca-cert\") pod \"e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") " pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:42.276812 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.276790    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/040944c9-d831-4757-96ff-667b76585c7a-istio-envoy\") pod \"e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") " pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:42.276812 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.276800    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/040944c9-d831-4757-96ff-667b76585c7a-istio-podinfo\") pod \"e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") " pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:42.280921 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.280890    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swtk9\" (UniqueName: \"kubernetes.io/projected/040944c9-d831-4757-96ff-667b76585c7a-kube-api-access-swtk9\") pod \"e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") " pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:42.281032 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.280916    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/040944c9-d831-4757-96ff-667b76585c7a-istio-token\") pod \"e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") " pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:42.339820 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.339765    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:42.394846 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.394825    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-db1ed7-openshift-default-dockercfg-k6lk6\""
Sep 16 02:35:42.403236 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.403215    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:42.688178 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.688152    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"]
Sep 16 02:35:42.690254 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:35:42.690220    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod040944c9_d831_4757_96ff_667b76585c7a.slice/crio-b109638ca97e367d65bc2a04bc610a3c3c3463ec4e9205ec947b9d74eaa56944 WatchSource:0}: Error finding container b109638ca97e367d65bc2a04bc610a3c3c3463ec4e9205ec947b9d74eaa56944: Status 404 returned error can't find the container with id b109638ca97e367d65bc2a04bc610a3c3c3463ec4e9205ec947b9d74eaa56944
Sep 16 02:35:42.692855 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.692822    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:35:42.692965 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.692882    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:35:42.692965 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.692910    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:35:42.832087 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.832048    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:42.865460 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.865425    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd" event={"ID":"040944c9-d831-4757-96ff-667b76585c7a","Type":"ContainerStarted","Data":"50db097ac7e691a7dca543cf4072346e7e1f12410ac92f6565fdc2183891fba3"}
Sep 16 02:35:42.865913 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.865486    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd" event={"ID":"040944c9-d831-4757-96ff-667b76585c7a","Type":"ContainerStarted","Data":"b109638ca97e367d65bc2a04bc610a3c3c3463ec4e9205ec947b9d74eaa56944"}
Sep 16 02:35:42.887825 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:42.887766    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd" podStartSLOduration=0.887744603 podStartE2EDuration="887.744603ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:35:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:35:42.883806869 +0000 UTC m=+1020.934151392" watchObservedRunningTime="2026-09-16 02:35:42.887744603 +0000 UTC m=+1020.938089096"
Sep 16 02:35:43.002803 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:43.002773    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c40df7fa-7cjtg"
Sep 16 02:35:43.183071 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:43.183039    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/610d253e-bb0a-48df-89b5-ca6ca3e380f3-maas-api-service-ca\") pod \"610d253e-bb0a-48df-89b5-ca6ca3e380f3\" (UID: \"610d253e-bb0a-48df-89b5-ca6ca3e380f3\") "
Sep 16 02:35:43.183422 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:43.183399    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/610d253e-bb0a-48df-89b5-ca6ca3e380f3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "610d253e-bb0a-48df-89b5-ca6ca3e380f3" (UID: "610d253e-bb0a-48df-89b5-ca6ca3e380f3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:35:43.183511 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:43.183497    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/610d253e-bb0a-48df-89b5-ca6ca3e380f3-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:43.404462 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:43.404429    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:43.405616 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:43.405594    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 16 02:35:43.405742 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:43.405642    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd" podUID="040944c9-d831-4757-96ff-667b76585c7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 16 02:35:43.880064 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:43.880034    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c40df7fa-7cjtg"
Sep 16 02:35:43.880487 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:43.880067    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c40df7fa-7cjtg" event={"ID":"610d253e-bb0a-48df-89b5-ca6ca3e380f3","Type":"ContainerDied","Data":"b0b002341c0aa22f8cee95ddf449e5719377d6128f750337c3f473e811cc695d"}
Sep 16 02:35:43.880487 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:43.880139    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0b002341c0aa22f8cee95ddf449e5719377d6128f750337c3f473e811cc695d"
Sep 16 02:35:44.408730 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:44.408701    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:44.632859 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:44.632831    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:44.762998 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:44.762912    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:44.865420 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:44.865354    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:44.885444 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:44.885413    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:44.886484 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:44.886462    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:35:45.689382 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:45.689325    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:46.501015 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:46.500980    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:47.346459 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:47.346420    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:47.398405 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:47.398355    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:47.498710 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:47.498673    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:47.892843 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:47.892812    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:47.989329 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:47.989297    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:48.017182 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:48.017150    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x"]
Sep 16 02:35:48.017870 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:48.017849    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="610d253e-bb0a-48df-89b5-ca6ca3e380f3" containerName="revoke-keys"
Sep 16 02:35:48.017924 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:48.017875    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="610d253e-bb0a-48df-89b5-ca6ca3e380f3" containerName="revoke-keys"
Sep 16 02:35:48.017988 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:48.017976    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="610d253e-bb0a-48df-89b5-ca6ca3e380f3" containerName="revoke-keys"
Sep 16 02:35:48.020706 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:48.020687    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x"
Sep 16 02:35:48.023161 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:48.023142    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-db1ed7-dockercfg-xdllf\""
Sep 16 02:35:48.023282 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:48.023144    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-db1ed7\""
Sep 16 02:35:48.028130 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:48.027758    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cec5b1f8-4075-426b-bd74-7d80ad9748c1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x\" (UID: \"cec5b1f8-4075-426b-bd74-7d80ad9748c1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x"
Sep 16 02:35:48.028130 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:48.027951    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jbd6\" (UniqueName: \"kubernetes.io/projected/cec5b1f8-4075-426b-bd74-7d80ad9748c1-kube-api-access-9jbd6\") pod \"payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x\" (UID: \"cec5b1f8-4075-426b-bd74-7d80ad9748c1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x"
Sep 16 02:35:48.031593 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:48.031566    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x"]
Sep 16 02:35:48.128964 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:48.128931    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cec5b1f8-4075-426b-bd74-7d80ad9748c1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x\" (UID: \"cec5b1f8-4075-426b-bd74-7d80ad9748c1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x"
Sep 16 02:35:48.129148 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:48.129009    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jbd6\" (UniqueName: \"kubernetes.io/projected/cec5b1f8-4075-426b-bd74-7d80ad9748c1-kube-api-access-9jbd6\") pod \"payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x\" (UID: \"cec5b1f8-4075-426b-bd74-7d80ad9748c1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x"
Sep 16 02:35:48.129750 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:48.129725    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cec5b1f8-4075-426b-bd74-7d80ad9748c1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x\" (UID: \"cec5b1f8-4075-426b-bd74-7d80ad9748c1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x"
Sep 16 02:35:48.137243 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:48.137215    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jbd6\" (UniqueName: \"kubernetes.io/projected/cec5b1f8-4075-426b-bd74-7d80ad9748c1-kube-api-access-9jbd6\") pod \"payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x\" (UID: \"cec5b1f8-4075-426b-bd74-7d80ad9748c1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x"
Sep 16 02:35:48.268425 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:48.268387    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:48.332574 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:48.332549    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x"
Sep 16 02:35:48.621545 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:48.621512    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x"]
Sep 16 02:35:48.622953 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:35:48.622921    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcec5b1f8_4075_426b_bd74_7d80ad9748c1.slice/crio-1b67554147ef2f71911ae823671aeadb425ba628c8624124f282cbc7bf2ff168 WatchSource:0}: Error finding container 1b67554147ef2f71911ae823671aeadb425ba628c8624124f282cbc7bf2ff168: Status 404 returned error can't find the container with id 1b67554147ef2f71911ae823671aeadb425ba628c8624124f282cbc7bf2ff168
Sep 16 02:35:48.914921 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:48.914873    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x" event={"ID":"cec5b1f8-4075-426b-bd74-7d80ad9748c1","Type":"ContainerStarted","Data":"469c74ec05630c292e05ad24032fd8a16db7c128e62ae9bc0d0876c1bb5c1302"}
Sep 16 02:35:48.915408 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:48.914942    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x" event={"ID":"cec5b1f8-4075-426b-bd74-7d80ad9748c1","Type":"ContainerStarted","Data":"1b67554147ef2f71911ae823671aeadb425ba628c8624124f282cbc7bf2ff168"}
Sep 16 02:35:48.915408 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:48.915302    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x"
Sep 16 02:35:48.930867 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:48.930821    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x" podStartSLOduration=1.930807522 podStartE2EDuration="1.930807522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:35:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:35:48.930116363 +0000 UTC m=+1026.980460878" watchObservedRunningTime="2026-09-16 02:35:48.930807522 +0000 UTC m=+1026.981152014"
Sep 16 02:35:49.049039 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:49.048991    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:49.863710 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:49.863668    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:50.453386 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:50.450837    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:50.494696 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:50.494663    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8"]
Sep 16 02:35:50.494981 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:50.494933    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8" podUID="39b9061e-0b86-42dd-b965-3c6c2e6b9492" containerName="payload-pre-processing" containerID="cri-o://241e74d75168798e66df4f039bcd71be42e210f072d4434ea2e61ea72928bdce" gracePeriod=30
Sep 16 02:35:50.566382 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:50.565619    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:50.637713 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:50.637688    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c40df7fa-7cjtg"]
Sep 16 02:35:50.638280 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:50.638250    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:50.640506 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:50.640485    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c40df7fa-7cjtg"]
Sep 16 02:35:50.709908 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:50.709821    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:50.777397 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:50.776743    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"]
Sep 16 02:35:50.784417 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:50.779718    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:50.784417 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:50.783556    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd" podUID="0a2147ee-954e-4901-a0ea-7ff566e10a9e" containerName="istio-proxy" containerID="cri-o://58759b338ffb1c78237404294f0a6b6af9df51153b82b47e16a4abd599107a58" gracePeriod=30
Sep 16 02:35:50.820925 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:50.820904    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8"
Sep 16 02:35:50.876773 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:50.876734    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwwzs\" (UniqueName: \"kubernetes.io/projected/39b9061e-0b86-42dd-b965-3c6c2e6b9492-kube-api-access-mwwzs\") pod \"39b9061e-0b86-42dd-b965-3c6c2e6b9492\" (UID: \"39b9061e-0b86-42dd-b965-3c6c2e6b9492\") "
Sep 16 02:35:50.877030 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:50.877006    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39b9061e-0b86-42dd-b965-3c6c2e6b9492-plugins-config-volume\") pod \"39b9061e-0b86-42dd-b965-3c6c2e6b9492\" (UID: \"39b9061e-0b86-42dd-b965-3c6c2e6b9492\") "
Sep 16 02:35:50.877883 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:50.877857    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39b9061e-0b86-42dd-b965-3c6c2e6b9492-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "39b9061e-0b86-42dd-b965-3c6c2e6b9492" (UID: "39b9061e-0b86-42dd-b965-3c6c2e6b9492"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:35:50.897573 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:50.896910    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39b9061e-0b86-42dd-b965-3c6c2e6b9492-kube-api-access-mwwzs" (OuterVolumeSpecName: "kube-api-access-mwwzs") pod "39b9061e-0b86-42dd-b965-3c6c2e6b9492" (UID: "39b9061e-0b86-42dd-b965-3c6c2e6b9492"). InnerVolumeSpecName "kube-api-access-mwwzs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:35:50.927939 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:50.927907    2565 generic.go:356] "Generic (PLEG): container finished" podID="39b9061e-0b86-42dd-b965-3c6c2e6b9492" containerID="241e74d75168798e66df4f039bcd71be42e210f072d4434ea2e61ea72928bdce" exitCode=0
Sep 16 02:35:50.928059 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:50.927957    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8"
Sep 16 02:35:50.928059 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:50.927986    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8" event={"ID":"39b9061e-0b86-42dd-b965-3c6c2e6b9492","Type":"ContainerDied","Data":"241e74d75168798e66df4f039bcd71be42e210f072d4434ea2e61ea72928bdce"}
Sep 16 02:35:50.928059 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:50.928038    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8" event={"ID":"39b9061e-0b86-42dd-b965-3c6c2e6b9492","Type":"ContainerDied","Data":"096d0047b4f215a39e54ae1053ee8cac756b3875917ee0a8ffd8f6bac31bda59"}
Sep 16 02:35:50.928179 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:50.928068    2565 scope.go:117] "RemoveContainer" containerID="241e74d75168798e66df4f039bcd71be42e210f072d4434ea2e61ea72928bdce"
Sep 16 02:35:50.938148 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:50.938125    2565 scope.go:117] "RemoveContainer" containerID="241e74d75168798e66df4f039bcd71be42e210f072d4434ea2e61ea72928bdce"
Sep 16 02:35:50.938464 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:35:50.938444    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"241e74d75168798e66df4f039bcd71be42e210f072d4434ea2e61ea72928bdce\": container with ID starting with 241e74d75168798e66df4f039bcd71be42e210f072d4434ea2e61ea72928bdce not found: ID does not exist" containerID="241e74d75168798e66df4f039bcd71be42e210f072d4434ea2e61ea72928bdce"
Sep 16 02:35:50.938538 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:50.938470    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"241e74d75168798e66df4f039bcd71be42e210f072d4434ea2e61ea72928bdce"} err="failed to get container status \"241e74d75168798e66df4f039bcd71be42e210f072d4434ea2e61ea72928bdce\": rpc error: code = NotFound desc = could not find container \"241e74d75168798e66df4f039bcd71be42e210f072d4434ea2e61ea72928bdce\": container with ID starting with 241e74d75168798e66df4f039bcd71be42e210f072d4434ea2e61ea72928bdce not found: ID does not exist"
Sep 16 02:35:50.974430 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:50.973881    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8"]
Sep 16 02:35:50.976886 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:50.976861    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8"]
Sep 16 02:35:50.978624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:50.978601    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwwzs\" (UniqueName: \"kubernetes.io/projected/39b9061e-0b86-42dd-b965-3c6c2e6b9492-kube-api-access-mwwzs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:50.978709 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:50.978626    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39b9061e-0b86-42dd-b965-3c6c2e6b9492-plugins-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:51.132581 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:51.132544    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:51.234313 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:51.234219    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:51.475410 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:51.475161    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:52.063335 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:52.063297    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:52.165549 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:52.165512    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:52.391498 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:52.391425    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39b9061e-0b86-42dd-b965-3c6c2e6b9492" path="/var/lib/kubelet/pods/39b9061e-0b86-42dd-b965-3c6c2e6b9492/volumes"
Sep 16 02:35:52.392040 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:52.392012    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="610d253e-bb0a-48df-89b5-ca6ca3e380f3" path="/var/lib/kubelet/pods/610d253e-bb0a-48df-89b5-ca6ca3e380f3/volumes"
Sep 16 02:35:52.730196 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:52.730164    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:53.839408 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:53.839373    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:54.276960 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:54.276885    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:54.375351 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:54.375315    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:54.627618 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:54.627525    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:55.251016 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:55.250983    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:55.786487 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:55.786453    2565 patch_prober.go:28] interesting pod/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 02:35:55.786634 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:55.786502    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd" podUID="0a2147ee-954e-4901-a0ea-7ff566e10a9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 02:35:56.331783 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:56.331749    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:56.400409 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:56.400379    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:56.687193 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:56.687162    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:56.815057 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:56.815027    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:56.908468 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:56.908437    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:57.208235 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.208205    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:57.430600 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.430582    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:57.548718 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.548649    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a2147ee-954e-4901-a0ea-7ff566e10a9e-istio-data\") pod \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") "
Sep 16 02:35:57.548718 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.548699    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a2147ee-954e-4901-a0ea-7ff566e10a9e-istio-envoy\") pod \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") "
Sep 16 02:35:57.548916 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.548733    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a2147ee-954e-4901-a0ea-7ff566e10a9e-workload-certs\") pod \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") "
Sep 16 02:35:57.548916 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.548798    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhkx2\" (UniqueName: \"kubernetes.io/projected/0a2147ee-954e-4901-a0ea-7ff566e10a9e-kube-api-access-xhkx2\") pod \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") "
Sep 16 02:35:57.548916 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.548830    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a2147ee-954e-4901-a0ea-7ff566e10a9e-istiod-ca-cert\") pod \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") "
Sep 16 02:35:57.548916 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.548865    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a2147ee-954e-4901-a0ea-7ff566e10a9e-istio-token\") pod \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") "
Sep 16 02:35:57.548916 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.548899    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a2147ee-954e-4901-a0ea-7ff566e10a9e-istio-podinfo\") pod \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") "
Sep 16 02:35:57.549186 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.548949    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a2147ee-954e-4901-a0ea-7ff566e10a9e-istio-data" (OuterVolumeSpecName: "istio-data") pod "0a2147ee-954e-4901-a0ea-7ff566e10a9e" (UID: "0a2147ee-954e-4901-a0ea-7ff566e10a9e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:35:57.549186 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.548971    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a2147ee-954e-4901-a0ea-7ff566e10a9e-credential-socket\") pod \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") "
Sep 16 02:35:57.549186 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.549020    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a2147ee-954e-4901-a0ea-7ff566e10a9e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0a2147ee-954e-4901-a0ea-7ff566e10a9e" (UID: "0a2147ee-954e-4901-a0ea-7ff566e10a9e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:35:57.549186 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.549067    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a2147ee-954e-4901-a0ea-7ff566e10a9e-workload-socket\") pod \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\" (UID: \"0a2147ee-954e-4901-a0ea-7ff566e10a9e\") "
Sep 16 02:35:57.549418 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.549211    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a2147ee-954e-4901-a0ea-7ff566e10a9e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0a2147ee-954e-4901-a0ea-7ff566e10a9e" (UID: "0a2147ee-954e-4901-a0ea-7ff566e10a9e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:35:57.549418 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.549282    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a2147ee-954e-4901-a0ea-7ff566e10a9e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0a2147ee-954e-4901-a0ea-7ff566e10a9e" (UID: "0a2147ee-954e-4901-a0ea-7ff566e10a9e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:35:57.549418 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.549356    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a2147ee-954e-4901-a0ea-7ff566e10a9e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0a2147ee-954e-4901-a0ea-7ff566e10a9e" (UID: "0a2147ee-954e-4901-a0ea-7ff566e10a9e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:35:57.549580 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.549493    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a2147ee-954e-4901-a0ea-7ff566e10a9e-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:57.549580 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.549507    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a2147ee-954e-4901-a0ea-7ff566e10a9e-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:57.549580 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.549517    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a2147ee-954e-4901-a0ea-7ff566e10a9e-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:57.549580 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.549530    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a2147ee-954e-4901-a0ea-7ff566e10a9e-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:57.549580 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.549543    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a2147ee-954e-4901-a0ea-7ff566e10a9e-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:57.551027 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.551006    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a2147ee-954e-4901-a0ea-7ff566e10a9e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0a2147ee-954e-4901-a0ea-7ff566e10a9e" (UID: "0a2147ee-954e-4901-a0ea-7ff566e10a9e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:35:57.551171 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.551148    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0a2147ee-954e-4901-a0ea-7ff566e10a9e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0a2147ee-954e-4901-a0ea-7ff566e10a9e" (UID: "0a2147ee-954e-4901-a0ea-7ff566e10a9e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 02:35:57.551457 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.551434    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a2147ee-954e-4901-a0ea-7ff566e10a9e-kube-api-access-xhkx2" (OuterVolumeSpecName: "kube-api-access-xhkx2") pod "0a2147ee-954e-4901-a0ea-7ff566e10a9e" (UID: "0a2147ee-954e-4901-a0ea-7ff566e10a9e"). InnerVolumeSpecName "kube-api-access-xhkx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:35:57.551519 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.551484    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a2147ee-954e-4901-a0ea-7ff566e10a9e-istio-token" (OuterVolumeSpecName: "istio-token") pod "0a2147ee-954e-4901-a0ea-7ff566e10a9e" (UID: "0a2147ee-954e-4901-a0ea-7ff566e10a9e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:35:57.650391 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.650350    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a2147ee-954e-4901-a0ea-7ff566e10a9e-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:57.650391 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.650389    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhkx2\" (UniqueName: \"kubernetes.io/projected/0a2147ee-954e-4901-a0ea-7ff566e10a9e-kube-api-access-xhkx2\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:57.650527 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.650405    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a2147ee-954e-4901-a0ea-7ff566e10a9e-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:57.650527 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.650417    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a2147ee-954e-4901-a0ea-7ff566e10a9e-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:35:57.983380 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.976235    2565 generic.go:356] "Generic (PLEG): container finished" podID="0a2147ee-954e-4901-a0ea-7ff566e10a9e" containerID="58759b338ffb1c78237404294f0a6b6af9df51153b82b47e16a4abd599107a58" exitCode=0
Sep 16 02:35:57.983380 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.976442    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd" event={"ID":"0a2147ee-954e-4901-a0ea-7ff566e10a9e","Type":"ContainerDied","Data":"58759b338ffb1c78237404294f0a6b6af9df51153b82b47e16a4abd599107a58"}
Sep 16 02:35:57.983380 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.976526    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd" event={"ID":"0a2147ee-954e-4901-a0ea-7ff566e10a9e","Type":"ContainerDied","Data":"f6edbbdb91e03d2c234192baf46361297ba11e72f67ac7e0e817895a162b6daf"}
Sep 16 02:35:57.983380 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.976568    2565 scope.go:117] "RemoveContainer" containerID="58759b338ffb1c78237404294f0a6b6af9df51153b82b47e16a4abd599107a58"
Sep 16 02:35:57.983380 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.976777    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"
Sep 16 02:35:57.992675 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.992652    2565 scope.go:117] "RemoveContainer" containerID="58759b338ffb1c78237404294f0a6b6af9df51153b82b47e16a4abd599107a58"
Sep 16 02:35:57.992949 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:35:57.992929    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58759b338ffb1c78237404294f0a6b6af9df51153b82b47e16a4abd599107a58\": container with ID starting with 58759b338ffb1c78237404294f0a6b6af9df51153b82b47e16a4abd599107a58 not found: ID does not exist" containerID="58759b338ffb1c78237404294f0a6b6af9df51153b82b47e16a4abd599107a58"
Sep 16 02:35:57.992990 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:57.992958    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58759b338ffb1c78237404294f0a6b6af9df51153b82b47e16a4abd599107a58"} err="failed to get container status \"58759b338ffb1c78237404294f0a6b6af9df51153b82b47e16a4abd599107a58\": rpc error: code = NotFound desc = could not find container \"58759b338ffb1c78237404294f0a6b6af9df51153b82b47e16a4abd599107a58\": container with ID starting with 58759b338ffb1c78237404294f0a6b6af9df51153b82b47e16a4abd599107a58 not found: ID does not exist"
Sep 16 02:35:58.002716 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:58.002693    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"]
Sep 16 02:35:58.005114 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:58.005094    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd"]
Sep 16 02:35:58.172100 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:58.172068    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:58.391123 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:58.391049    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a2147ee-954e-4901-a0ea-7ff566e10a9e" path="/var/lib/kubelet/pods/0a2147ee-954e-4901-a0ea-7ff566e10a9e/volumes"
Sep 16 02:35:58.818575 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:58.818535    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:59.414930 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:59.414895    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:59.512217 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:59.512186    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:59.780327 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:59.780245    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:35:59.923510 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:35:59.923472    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x"
Sep 16 02:36:00.040862 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.040790    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"]
Sep 16 02:36:00.041243 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.041228    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a2147ee-954e-4901-a0ea-7ff566e10a9e" containerName="istio-proxy"
Sep 16 02:36:00.041306 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.041245    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a2147ee-954e-4901-a0ea-7ff566e10a9e" containerName="istio-proxy"
Sep 16 02:36:00.041306 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.041255    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39b9061e-0b86-42dd-b965-3c6c2e6b9492" containerName="payload-pre-processing"
Sep 16 02:36:00.041306 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.041260    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="39b9061e-0b86-42dd-b965-3c6c2e6b9492" containerName="payload-pre-processing"
Sep 16 02:36:00.041450 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.041342    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a2147ee-954e-4901-a0ea-7ff566e10a9e" containerName="istio-proxy"
Sep 16 02:36:00.041450 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.041354    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="39b9061e-0b86-42dd-b965-3c6c2e6b9492" containerName="payload-pre-processing"
Sep 16 02:36:00.044196 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.044180    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:00.046509 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.046490    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-eee708-openshift-default-dockercfg-679p2\""
Sep 16 02:36:00.054275 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.054246    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"]
Sep 16 02:36:00.058608 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.058588    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:00.173438 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.173397    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65aee6e8-258a-46db-946e-35165a96aacd-istio-podinfo\") pod \"e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") " pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:00.173438 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.173440    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qrcz\" (UniqueName: \"kubernetes.io/projected/65aee6e8-258a-46db-946e-35165a96aacd-kube-api-access-6qrcz\") pod \"e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") " pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:00.173683 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.173518    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65aee6e8-258a-46db-946e-35165a96aacd-istio-token\") pod \"e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") " pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:00.173683 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.173601    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65aee6e8-258a-46db-946e-35165a96aacd-workload-socket\") pod \"e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") " pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:00.173683 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.173635    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65aee6e8-258a-46db-946e-35165a96aacd-istiod-ca-cert\") pod \"e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") " pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:00.173683 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.173668    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65aee6e8-258a-46db-946e-35165a96aacd-istio-data\") pod \"e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") " pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:00.173903 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.173690    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65aee6e8-258a-46db-946e-35165a96aacd-credential-socket\") pod \"e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") " pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:00.173903 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.173759    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65aee6e8-258a-46db-946e-35165a96aacd-istio-envoy\") pod \"e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") " pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:00.173903 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.173819    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65aee6e8-258a-46db-946e-35165a96aacd-workload-certs\") pod \"e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") " pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:00.274319 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.274293    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65aee6e8-258a-46db-946e-35165a96aacd-istio-podinfo\") pod \"e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") " pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:00.274502 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.274327    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qrcz\" (UniqueName: \"kubernetes.io/projected/65aee6e8-258a-46db-946e-35165a96aacd-kube-api-access-6qrcz\") pod \"e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") " pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:00.274502 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.274344    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65aee6e8-258a-46db-946e-35165a96aacd-istio-token\") pod \"e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") " pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:00.274502 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.274475    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65aee6e8-258a-46db-946e-35165a96aacd-workload-socket\") pod \"e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") " pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:00.274683 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.274509    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65aee6e8-258a-46db-946e-35165a96aacd-istiod-ca-cert\") pod \"e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") " pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:00.274683 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.274532    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65aee6e8-258a-46db-946e-35165a96aacd-istio-data\") pod \"e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") " pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:00.274683 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.274562    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65aee6e8-258a-46db-946e-35165a96aacd-credential-socket\") pod \"e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") " pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:00.274683 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.274593    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65aee6e8-258a-46db-946e-35165a96aacd-istio-envoy\") pod \"e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") " pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:00.274683 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.274633    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65aee6e8-258a-46db-946e-35165a96aacd-workload-certs\") pod \"e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") " pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:00.274947 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.274885    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65aee6e8-258a-46db-946e-35165a96aacd-workload-socket\") pod \"e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") " pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:00.274998 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.274982    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65aee6e8-258a-46db-946e-35165a96aacd-credential-socket\") pod \"e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") " pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:00.275056 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.275039    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65aee6e8-258a-46db-946e-35165a96aacd-istio-data\") pod \"e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") " pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:00.275116 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.275053    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65aee6e8-258a-46db-946e-35165a96aacd-workload-certs\") pod \"e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") " pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:00.275201 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.275182    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65aee6e8-258a-46db-946e-35165a96aacd-istiod-ca-cert\") pod \"e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") " pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:00.276657 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.276635    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65aee6e8-258a-46db-946e-35165a96aacd-istio-envoy\") pod \"e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") " pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:00.276990 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.276969    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65aee6e8-258a-46db-946e-35165a96aacd-istio-podinfo\") pod \"e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") " pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:00.281586 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.281565    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qrcz\" (UniqueName: \"kubernetes.io/projected/65aee6e8-258a-46db-946e-35165a96aacd-kube-api-access-6qrcz\") pod \"e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") " pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:00.281670 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.281568    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65aee6e8-258a-46db-946e-35165a96aacd-istio-token\") pod \"e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") " pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:00.355435 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.355372    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:00.632242 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.630690    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"]
Sep 16 02:36:00.634410 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:36:00.634375    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65aee6e8_258a_46db_946e_35165a96aacd.slice/crio-09e374501a1ec957b517bc57a6e207d177c62532af89c519494a4d7a3a9b8e32 WatchSource:0}: Error finding container 09e374501a1ec957b517bc57a6e207d177c62532af89c519494a4d7a3a9b8e32: Status 404 returned error can't find the container with id 09e374501a1ec957b517bc57a6e207d177c62532af89c519494a4d7a3a9b8e32
Sep 16 02:36:00.636771 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.636738    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:36:00.636843 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.636812    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:36:00.636843 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.636838    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:36:00.699083 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.699060    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:00.998688 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.998651    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r" event={"ID":"65aee6e8-258a-46db-946e-35165a96aacd","Type":"ContainerStarted","Data":"6e79293e8b92e556c46a803235ddbb6e829dd23c6c1956d8479b8e3dfb84940e"}
Sep 16 02:36:00.999135 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:00.998714    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r" event={"ID":"65aee6e8-258a-46db-946e-35165a96aacd","Type":"ContainerStarted","Data":"09e374501a1ec957b517bc57a6e207d177c62532af89c519494a4d7a3a9b8e32"}
Sep 16 02:36:01.019879 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:01.019834    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r" podStartSLOduration=1.019821465 podStartE2EDuration="1.019821465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:36:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:36:01.016558323 +0000 UTC m=+1039.066902834" watchObservedRunningTime="2026-09-16 02:36:01.019821465 +0000 UTC m=+1039.070165957"
Sep 16 02:36:01.355548 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:01.355472    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:01.360198 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:01.360172    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:02.005098 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:02.005066    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:02.005990 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:02.005969    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:02.759539 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:02.759506    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:02.900124 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:02.900089    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:02.998967 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:02.998928    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:03.628731 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:03.628694    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:04.447660 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:04.447624    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:05.224880 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:05.224842    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:05.327173 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:05.327123    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:05.426463 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:05.426417    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:05.655072 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:05.655045    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:05.756913 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:05.756887    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:05.761618 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:05.761591    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq"]
Sep 16 02:36:05.764118 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:05.764101    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq"
Sep 16 02:36:05.766231 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:05.766201    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-eee708\""
Sep 16 02:36:05.766382 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:05.766346    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-eee708-dockercfg-mhbzv\""
Sep 16 02:36:05.775159 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:05.775136    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq"]
Sep 16 02:36:05.829658 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:05.829631    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq\" (UID: \"02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq"
Sep 16 02:36:05.829766 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:05.829724    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6qln\" (UniqueName: \"kubernetes.io/projected/02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2-kube-api-access-z6qln\") pod \"payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq\" (UID: \"02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq"
Sep 16 02:36:05.931324 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:05.931242    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq\" (UID: \"02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq"
Sep 16 02:36:05.931324 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:05.931292    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6qln\" (UniqueName: \"kubernetes.io/projected/02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2-kube-api-access-z6qln\") pod \"payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq\" (UID: \"02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq"
Sep 16 02:36:05.932015 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:05.931989    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq\" (UID: \"02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq"
Sep 16 02:36:05.939121 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:05.939090    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6qln\" (UniqueName: \"kubernetes.io/projected/02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2-kube-api-access-z6qln\") pod \"payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq\" (UID: \"02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq"
Sep 16 02:36:06.075380 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:06.075310    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq"
Sep 16 02:36:06.362157 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:06.362044    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq"]
Sep 16 02:36:06.378313 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:36:06.378266    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02a61744_9d02_4e1a_b6d9_2d4f3f7d86e2.slice/crio-c9e717709d470403b9034c37f0c754c8af16ce1e362adbe790da037a9d916c1f WatchSource:0}: Error finding container c9e717709d470403b9034c37f0c754c8af16ce1e362adbe790da037a9d916c1f: Status 404 returned error can't find the container with id c9e717709d470403b9034c37f0c754c8af16ce1e362adbe790da037a9d916c1f
Sep 16 02:36:07.035901 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:07.035860    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq" event={"ID":"02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2","Type":"ContainerStarted","Data":"2aea132380f30a334e7adecda826875d48b967cb397ded73d6c7417a732576bd"}
Sep 16 02:36:07.036076 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:07.035929    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq"
Sep 16 02:36:07.036076 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:07.035955    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq" event={"ID":"02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2","Type":"ContainerStarted","Data":"c9e717709d470403b9034c37f0c754c8af16ce1e362adbe790da037a9d916c1f"}
Sep 16 02:36:08.426835 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:08.426798    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:14.537386 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:14.537324    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:14.887635 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:14.887600    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 16 02:36:14.887809 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:14.887668    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd" podUID="040944c9-d831-4757-96ff-667b76585c7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 16 02:36:15.100294 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:15.100194    2565 generic.go:356] "Generic (PLEG): container finished" podID="040944c9-d831-4757-96ff-667b76585c7a" containerID="50db097ac7e691a7dca543cf4072346e7e1f12410ac92f6565fdc2183891fba3" exitCode=0
Sep 16 02:36:15.100294 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:15.100270    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd" event={"ID":"040944c9-d831-4757-96ff-667b76585c7a","Type":"ContainerDied","Data":"50db097ac7e691a7dca543cf4072346e7e1f12410ac92f6565fdc2183891fba3"}
Sep 16 02:36:15.100723 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:15.100707    2565 scope.go:117] "RemoveContainer" containerID="50db097ac7e691a7dca543cf4072346e7e1f12410ac92f6565fdc2183891fba3"
Sep 16 02:36:15.101814 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:15.101789    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:36:15.101874 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:15.101862    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:36:15.101909 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:15.101896    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:36:15.123871 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:15.123826    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq" podStartSLOduration=10.123811326 podStartE2EDuration="10.123811326s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:36:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:36:07.054880733 +0000 UTC m=+1045.105225243" watchObservedRunningTime="2026-09-16 02:36:15.123811326 +0000 UTC m=+1053.174155818"
Sep 16 02:36:15.940137 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:15.940099    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:16.110382 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:16.110326    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd" event={"ID":"040944c9-d831-4757-96ff-667b76585c7a","Type":"ContainerStarted","Data":"c6ba2b75ec72738fb78d219f3e74b7c0e56b8cf7c500d4d61efc8af53256a159"}
Sep 16 02:36:16.404086 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:16.403994    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:36:16.404273 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:16.404224    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 16 02:36:16.404356 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:16.404273    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd" podUID="040944c9-d831-4757-96ff-667b76585c7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 16 02:36:17.196083 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:17.196048    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:17.404607 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:17.404568    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 16 02:36:17.404769 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:17.404629    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd" podUID="040944c9-d831-4757-96ff-667b76585c7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 16 02:36:18.043381 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:18.043342    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq"
Sep 16 02:36:18.404471 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:18.404382    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 16 02:36:18.404471 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:18.404448    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd" podUID="040944c9-d831-4757-96ff-667b76585c7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 16 02:36:18.734024 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:18.733986    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:19.403707 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:19.403673    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 16 02:36:19.403867 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:19.403739    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd" podUID="040944c9-d831-4757-96ff-667b76585c7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 16 02:36:19.465485 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:19.465445    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:19.931630 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:19.931593    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b099417d-bl5wc"]
Sep 16 02:36:19.934451 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:19.934432    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b099417d-bl5wc"
Sep 16 02:36:19.936580 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:19.936557    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w8hnp\""
Sep 16 02:36:19.936675 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:19.936560    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 02:36:19.941391 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:19.941353    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b099417d-bl5wc"]
Sep 16 02:36:20.080676 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:20.080634    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c70eeab-a627-4932-8d88-a2c3338a500d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b099417d-bl5wc\" (UID: \"3c70eeab-a627-4932-8d88-a2c3338a500d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b099417d-bl5wc"
Sep 16 02:36:20.182344 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:20.182252    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c70eeab-a627-4932-8d88-a2c3338a500d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b099417d-bl5wc\" (UID: \"3c70eeab-a627-4932-8d88-a2c3338a500d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b099417d-bl5wc"
Sep 16 02:36:20.182904 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:20.182886    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c70eeab-a627-4932-8d88-a2c3338a500d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b099417d-bl5wc\" (UID: \"3c70eeab-a627-4932-8d88-a2c3338a500d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b099417d-bl5wc"
Sep 16 02:36:20.247059 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:20.247023    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b099417d-bl5wc"
Sep 16 02:36:20.385539 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:20.385505    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:20.404512 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:20.404467    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 16 02:36:20.404657 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:20.404527    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd" podUID="040944c9-d831-4757-96ff-667b76585c7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 16 02:36:20.536306 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:20.536268    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b099417d-bl5wc"]
Sep 16 02:36:20.537935 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:36:20.537908    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c70eeab_a627_4932_8d88_a2c3338a500d.slice/crio-b07342af3d724f81ecb6ac21316b6ce5918340cddb3ae3067e0dcc17ff75c09f WatchSource:0}: Error finding container b07342af3d724f81ecb6ac21316b6ce5918340cddb3ae3067e0dcc17ff75c09f: Status 404 returned error can't find the container with id b07342af3d724f81ecb6ac21316b6ce5918340cddb3ae3067e0dcc17ff75c09f
Sep 16 02:36:21.144152 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:21.144057    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b099417d-bl5wc" event={"ID":"3c70eeab-a627-4932-8d88-a2c3338a500d","Type":"ContainerStarted","Data":"a590c6e38e9896bdc1c06ef724ce0e9c983682839a67882873f05bf8bc3a7c04"}
Sep 16 02:36:21.144152 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:21.144114    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b099417d-bl5wc" event={"ID":"3c70eeab-a627-4932-8d88-a2c3338a500d","Type":"ContainerStarted","Data":"b07342af3d724f81ecb6ac21316b6ce5918340cddb3ae3067e0dcc17ff75c09f"}
Sep 16 02:36:21.158735 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:21.158672    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b099417d-bl5wc" podStartSLOduration=2.158648705 podStartE2EDuration="2.158648705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:36:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:36:21.156517858 +0000 UTC m=+1059.206862351" watchObservedRunningTime="2026-09-16 02:36:21.158648705 +0000 UTC m=+1059.208993199"
Sep 16 02:36:21.407988 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:21.407961    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:36:21.408243 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:21.408225    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:36:21.408955 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:21.408937    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:36:21.413782 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:21.413740    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:22.155128 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:22.155088    2565 generic.go:356] "Generic (PLEG): container finished" podID="3c70eeab-a627-4932-8d88-a2c3338a500d" containerID="a590c6e38e9896bdc1c06ef724ce0e9c983682839a67882873f05bf8bc3a7c04" exitCode=0
Sep 16 02:36:22.155868 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:22.155132    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b099417d-bl5wc" event={"ID":"3c70eeab-a627-4932-8d88-a2c3338a500d","Type":"ContainerDied","Data":"a590c6e38e9896bdc1c06ef724ce0e9c983682839a67882873f05bf8bc3a7c04"}
Sep 16 02:36:22.298824 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:22.298782    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:22.721667 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:22.721633    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:23.202531 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:23.202493    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:23.306599 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:23.306574    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b099417d-bl5wc"
Sep 16 02:36:23.417580 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:23.417500    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c70eeab-a627-4932-8d88-a2c3338a500d-maas-api-service-ca\") pod \"3c70eeab-a627-4932-8d88-a2c3338a500d\" (UID: \"3c70eeab-a627-4932-8d88-a2c3338a500d\") "
Sep 16 02:36:23.417828 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:23.417808    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c70eeab-a627-4932-8d88-a2c3338a500d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3c70eeab-a627-4932-8d88-a2c3338a500d" (UID: "3c70eeab-a627-4932-8d88-a2c3338a500d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:36:23.518552 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:23.518518    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c70eeab-a627-4932-8d88-a2c3338a500d-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:36:24.043231 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:24.043174    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:24.171008 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:24.170964    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b099417d-bl5wc" event={"ID":"3c70eeab-a627-4932-8d88-a2c3338a500d","Type":"ContainerDied","Data":"b07342af3d724f81ecb6ac21316b6ce5918340cddb3ae3067e0dcc17ff75c09f"}
Sep 16 02:36:24.171008 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:24.171003    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b099417d-bl5wc"
Sep 16 02:36:24.171277 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:24.171021    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b07342af3d724f81ecb6ac21316b6ce5918340cddb3ae3067e0dcc17ff75c09f"
Sep 16 02:36:24.800344 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:24.800305    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:25.553767 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:25.553695    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:26.216398 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:26.216337    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:26.286766 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:26.286733    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:26.340407 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:26.340354    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:26.440792 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:26.440759    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:26.481410 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:26.481278    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b099417d-bl5wc"]
Sep 16 02:36:26.485795 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:26.485760    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b099417d-bl5wc"]
Sep 16 02:36:26.541412 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:26.541380    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:27.253695 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:27.253654    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:27.573560 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:27.573464    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:27.982790 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:27.982750    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:28.284985 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.284904    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"]
Sep 16 02:36:28.285666 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.285642    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c70eeab-a627-4932-8d88-a2c3338a500d" containerName="revoke-keys"
Sep 16 02:36:28.285666 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.285666    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c70eeab-a627-4932-8d88-a2c3338a500d" containerName="revoke-keys"
Sep 16 02:36:28.285852 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.285781    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c70eeab-a627-4932-8d88-a2c3338a500d" containerName="revoke-keys"
Sep 16 02:36:28.288153 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.288134    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:28.291006 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.290920    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-642a8155-openshift-default-dockercfg-zzbpg\""
Sep 16 02:36:28.300887 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.300862    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"]
Sep 16 02:36:28.312507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.312484    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:28.387835 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.387802    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-istio-data\") pod \"e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") " pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:28.388220 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.388159    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-istio-envoy\") pod \"e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") " pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:28.388449 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.388429    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-workload-socket\") pod \"e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") " pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:28.388617 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.388601    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-credential-socket\") pod \"e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") " pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:28.388738 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.388724    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-istio-podinfo\") pod \"e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") " pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:28.388860 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.388847    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-workload-certs\") pod \"e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") " pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:28.388960 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.388947    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-istio-token\") pod \"e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") " pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:28.389056 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.389044    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-istiod-ca-cert\") pod \"e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") " pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:28.389152 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.389139    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5glc\" (UniqueName: \"kubernetes.io/projected/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-kube-api-access-x5glc\") pod \"e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") " pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:28.395886 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.395860    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c70eeab-a627-4932-8d88-a2c3338a500d" path="/var/lib/kubelet/pods/3c70eeab-a627-4932-8d88-a2c3338a500d/volumes"
Sep 16 02:36:28.411873 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.411844    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:28.490668 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.490638    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-istio-envoy\") pod \"e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") " pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:28.490915 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.490901    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-workload-socket\") pod \"e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") " pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:28.491024 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.491012    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-credential-socket\") pod \"e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") " pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:28.491104 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.491095    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-istio-podinfo\") pod \"e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") " pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:28.491181 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.491173    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-workload-certs\") pod \"e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") " pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:28.491251 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.491238    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-istio-token\") pod \"e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") " pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:28.491348 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.491335    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-istiod-ca-cert\") pod \"e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") " pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:28.491477 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.491456    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5glc\" (UniqueName: \"kubernetes.io/projected/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-kube-api-access-x5glc\") pod \"e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") " pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:28.491539 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.491472    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-credential-socket\") pod \"e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") " pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:28.491539 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.491390    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-workload-socket\") pod \"e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") " pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:28.491539 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.491511    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-istio-data\") pod \"e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") " pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:28.491983 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.491957    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-workload-certs\") pod \"e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") " pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:28.492079 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.491990    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-istiod-ca-cert\") pod \"e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") " pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:28.492218 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.492204    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-istio-data\") pod \"e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") " pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:28.493762 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.493733    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-istio-podinfo\") pod \"e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") " pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:28.493865 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.493762    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-istio-envoy\") pod \"e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") " pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:28.499582 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.499560    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5glc\" (UniqueName: \"kubernetes.io/projected/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-kube-api-access-x5glc\") pod \"e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") " pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:28.499967 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.499950    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-istio-token\") pod \"e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") " pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:28.603077 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.602989    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:28.729646 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.729546    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:28.898086 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.898001    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"]
Sep 16 02:36:28.901474 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:36:28.901443    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7935c9c2_79dc_479e_81aa_ebbc0d5d927d.slice/crio-69d87437ee848b2541b94e43f83f9e0f6c03f287bdc01a9cc8a6373ebce6758a WatchSource:0}: Error finding container 69d87437ee848b2541b94e43f83f9e0f6c03f287bdc01a9cc8a6373ebce6758a: Status 404 returned error can't find the container with id 69d87437ee848b2541b94e43f83f9e0f6c03f287bdc01a9cc8a6373ebce6758a
Sep 16 02:36:28.903832 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.903802    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:36:28.903977 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.903962    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:36:28.904065 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:28.904053    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:36:29.030928 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:29.030896    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:29.206785 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:29.206667    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg" event={"ID":"7935c9c2-79dc-479e-81aa-ebbc0d5d927d","Type":"ContainerStarted","Data":"e8494a399d0c84db0bcc06a93bdfd77f2e5a6d107e27c690550bf0031ec033fb"}
Sep 16 02:36:29.206785 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:29.206719    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg" event={"ID":"7935c9c2-79dc-479e-81aa-ebbc0d5d927d","Type":"ContainerStarted","Data":"69d87437ee848b2541b94e43f83f9e0f6c03f287bdc01a9cc8a6373ebce6758a"}
Sep 16 02:36:29.228514 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:29.228455    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg" podStartSLOduration=1.228433515 podStartE2EDuration="1.228433515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:36:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:36:29.225305797 +0000 UTC m=+1067.275650314" watchObservedRunningTime="2026-09-16 02:36:29.228433515 +0000 UTC m=+1067.278778009"
Sep 16 02:36:29.603864 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:29.603769    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:29.608874 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:29.608844    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:29.889762 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:29.889669    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:30.213237 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:30.213209    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:30.214178 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:30.214154    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:30.632652 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:30.632547    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:30.731887 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:30.731807    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:31.644682 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:31.644648    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:32.352614 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:32.352578    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:32.959473 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:32.959429    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:33.047519 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:33.047477    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 02:36:33.047686 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:33.047546    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r" podUID="65aee6e8-258a-46db-946e-35165a96aacd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 02:36:33.665460 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:33.665429    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:33.715569 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:33.715534    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:33.859942 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:33.859907    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:34.241883 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:34.241846    2565 generic.go:356] "Generic (PLEG): container finished" podID="65aee6e8-258a-46db-946e-35165a96aacd" containerID="6e79293e8b92e556c46a803235ddbb6e829dd23c6c1956d8479b8e3dfb84940e" exitCode=0
Sep 16 02:36:34.242353 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:34.241901    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r" event={"ID":"65aee6e8-258a-46db-946e-35165a96aacd","Type":"ContainerDied","Data":"6e79293e8b92e556c46a803235ddbb6e829dd23c6c1956d8479b8e3dfb84940e"}
Sep 16 02:36:34.242459 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:34.242353    2565 scope.go:117] "RemoveContainer" containerID="6e79293e8b92e556c46a803235ddbb6e829dd23c6c1956d8479b8e3dfb84940e"
Sep 16 02:36:34.243653 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:34.243625    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:36:34.243731 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:34.243696    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:36:34.243731 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:34.243726    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:36:34.279568 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:34.279538    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:34.374950 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:34.374920    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:34.999745 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:34.999669    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:35.100023 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:35.099981    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:35.252062 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:35.251971    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r" event={"ID":"65aee6e8-258a-46db-946e-35165a96aacd","Type":"ContainerStarted","Data":"5d531691e65a36af846c1f272e53dd756f2d27c5e4b636c0890432de9c43739e"}
Sep 16 02:36:35.360384 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:35.357914    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:35.360384 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:35.358473    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 16 02:36:35.360384 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:35.358567    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r" podUID="65aee6e8-258a-46db-946e-35165a96aacd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 16 02:36:36.356772 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:36.356729    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 16 02:36:36.357281 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:36.356806    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r" podUID="65aee6e8-258a-46db-946e-35165a96aacd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 16 02:36:36.384804 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:36.384771    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8" secret="" err="secret \"payload-processing-dockercfg-7v8jt\" not found"
Sep 16 02:36:37.356421 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:37.356380    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 16 02:36:37.356758 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:37.356725    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r" podUID="65aee6e8-258a-46db-946e-35165a96aacd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 16 02:36:38.356670 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:38.356629    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 16 02:36:38.357152 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:38.356700    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r" podUID="65aee6e8-258a-46db-946e-35165a96aacd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 16 02:36:39.355720 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:39.355678    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 16 02:36:39.355922 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:39.355746    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r" podUID="65aee6e8-258a-46db-946e-35165a96aacd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 16 02:36:40.360401 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:40.355883    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 16 02:36:40.360401 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:40.355948    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r" podUID="65aee6e8-258a-46db-946e-35165a96aacd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 16 02:36:40.838552 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:40.838505    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:41.359775 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:41.359742    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:41.360167 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:41.360146    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:41.360708 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:41.360689    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:36:52.368291 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:52.368252    2565 generic.go:356] "Generic (PLEG): container finished" podID="7935c9c2-79dc-479e-81aa-ebbc0d5d927d" containerID="e8494a399d0c84db0bcc06a93bdfd77f2e5a6d107e27c690550bf0031ec033fb" exitCode=0
Sep 16 02:36:52.368828 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:52.368334    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg" event={"ID":"7935c9c2-79dc-479e-81aa-ebbc0d5d927d","Type":"ContainerDied","Data":"e8494a399d0c84db0bcc06a93bdfd77f2e5a6d107e27c690550bf0031ec033fb"}
Sep 16 02:36:52.368899 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:52.368845    2565 scope.go:117] "RemoveContainer" containerID="e8494a399d0c84db0bcc06a93bdfd77f2e5a6d107e27c690550bf0031ec033fb"
Sep 16 02:36:52.370028 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:52.370001    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:36:52.370135 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:52.370079    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:36:52.370135 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:52.370124    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:36:53.380708 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:53.380671    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg" event={"ID":"7935c9c2-79dc-479e-81aa-ebbc0d5d927d","Type":"ContainerStarted","Data":"86b17fdfe17c094ddbe05e5a743b4182dd2d818330b2c32baded6162872bc02a"}
Sep 16 02:36:53.603558 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:53.603522    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:53.603744 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:53.603720    2565 patch_prober.go:28] interesting pod/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 16 02:36:53.603820 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:53.603787    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg" podUID="7935c9c2-79dc-479e-81aa-ebbc0d5d927d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 16 02:36:54.603337 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:54.603300    2565 patch_prober.go:28] interesting pod/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 16 02:36:54.603770 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:54.603401    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg" podUID="7935c9c2-79dc-479e-81aa-ebbc0d5d927d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 16 02:36:55.604274 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:55.604240    2565 patch_prober.go:28] interesting pod/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 16 02:36:55.604656 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:55.604321    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg" podUID="7935c9c2-79dc-479e-81aa-ebbc0d5d927d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 16 02:36:56.603765 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:56.603722    2565 patch_prober.go:28] interesting pod/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 16 02:36:56.603976 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:56.603787    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg" podUID="7935c9c2-79dc-479e-81aa-ebbc0d5d927d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 16 02:36:56.876175 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:56.876060    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:57.603762 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:57.603724    2565 patch_prober.go:28] interesting pod/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 16 02:36:57.603947 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:57.603789    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg" podUID="7935c9c2-79dc-479e-81aa-ebbc0d5d927d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 16 02:36:57.735331 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:57.735286    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:58.442971 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:58.442928    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:58.604128 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:58.604093    2565 patch_prober.go:28] interesting pod/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 16 02:36:58.604307 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:58.604157    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg" podUID="7935c9c2-79dc-479e-81aa-ebbc0d5d927d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 16 02:36:59.317004 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:59.316967    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:36:59.607855 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:59.607781    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:59.608217 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:59.608199    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:59.608772 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:59.608754    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:36:59.959952 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:36:59.959919    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:01.221056 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:01.221024    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:01.956786 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:01.956749    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:02.542674 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:02.542600    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:03.229812 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:03.229780    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:04.012108 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:04.012075    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:04.207309 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:04.207277    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:04.922208 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:04.922165    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:05.817345 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:05.817304    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:06.415877 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:06.415841    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:07.100955 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:07.100920    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:07.851006 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:07.850972    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:09.030654 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:09.030618    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:09.583131 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:09.583100    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:12.349997 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:12.349960    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:12.411594 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:12.411562    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:12.470227 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:12.470197    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:12.529288 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:12.529255    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:12.651018 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:12.650934    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"]
Sep 16 02:37:12.651479 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:12.651446    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg" podUID="7935c9c2-79dc-479e-81aa-ebbc0d5d927d" containerName="istio-proxy" containerID="cri-o://86b17fdfe17c094ddbe05e5a743b4182dd2d818330b2c32baded6162872bc02a" gracePeriod=30
Sep 16 02:37:12.663581 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:12.663539    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:12.945081 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:12.945047    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:13.318834 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:13.318757    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:13.420254 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:13.420225    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:13.528062 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:13.528031    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:13.732040 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:13.732008    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:14.527879 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:14.527843    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:14.610838 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:14.610807    2565 patch_prober.go:28] interesting pod/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 02:37:14.611011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:14.610874    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg" podUID="7935c9c2-79dc-479e-81aa-ebbc0d5d927d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 02:37:14.813712 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:14.813636    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:15.263233 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:15.263200    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:17.911394 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:17.911336    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:37:17.994499 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:17.994440    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-workload-socket\") pod \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") "
Sep 16 02:37:17.994499 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:17.994472    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-istio-podinfo\") pod \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") "
Sep 16 02:37:17.994499 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:17.994490    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-workload-certs\") pod \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") "
Sep 16 02:37:17.994693 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:17.994530    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-istio-envoy\") pod \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") "
Sep 16 02:37:17.994693 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:17.994661    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-istio-token\") pod \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") "
Sep 16 02:37:17.994801 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:17.994727    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-istio-data\") pod \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") "
Sep 16 02:37:17.994801 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:17.994730    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7935c9c2-79dc-479e-81aa-ebbc0d5d927d" (UID: "7935c9c2-79dc-479e-81aa-ebbc0d5d927d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:37:17.994906 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:17.994826    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7935c9c2-79dc-479e-81aa-ebbc0d5d927d" (UID: "7935c9c2-79dc-479e-81aa-ebbc0d5d927d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:37:17.994906 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:17.994876    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-credential-socket\") pod \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") "
Sep 16 02:37:17.995013 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:17.994925    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-istio-data" (OuterVolumeSpecName: "istio-data") pod "7935c9c2-79dc-479e-81aa-ebbc0d5d927d" (UID: "7935c9c2-79dc-479e-81aa-ebbc0d5d927d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:37:17.995013 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:17.994969    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5glc\" (UniqueName: \"kubernetes.io/projected/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-kube-api-access-x5glc\") pod \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") "
Sep 16 02:37:17.995118 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:17.995038    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-istiod-ca-cert\") pod \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\" (UID: \"7935c9c2-79dc-479e-81aa-ebbc0d5d927d\") "
Sep 16 02:37:17.995118 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:17.995076    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7935c9c2-79dc-479e-81aa-ebbc0d5d927d" (UID: "7935c9c2-79dc-479e-81aa-ebbc0d5d927d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:37:17.995423 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:17.995397    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:37:17.995423 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:17.995422    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:37:17.995597 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:17.995439    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:37:17.995597 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:17.995451    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:37:17.995597 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:17.995419    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7935c9c2-79dc-479e-81aa-ebbc0d5d927d" (UID: "7935c9c2-79dc-479e-81aa-ebbc0d5d927d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:37:17.996729 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:17.996703    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7935c9c2-79dc-479e-81aa-ebbc0d5d927d" (UID: "7935c9c2-79dc-479e-81aa-ebbc0d5d927d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 02:37:17.996840 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:17.996818    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-istio-token" (OuterVolumeSpecName: "istio-token") pod "7935c9c2-79dc-479e-81aa-ebbc0d5d927d" (UID: "7935c9c2-79dc-479e-81aa-ebbc0d5d927d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:37:17.996892 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:17.996862    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7935c9c2-79dc-479e-81aa-ebbc0d5d927d" (UID: "7935c9c2-79dc-479e-81aa-ebbc0d5d927d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:37:17.997202 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:17.997177    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-kube-api-access-x5glc" (OuterVolumeSpecName: "kube-api-access-x5glc") pod "7935c9c2-79dc-479e-81aa-ebbc0d5d927d" (UID: "7935c9c2-79dc-479e-81aa-ebbc0d5d927d"). InnerVolumeSpecName "kube-api-access-x5glc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:37:18.096503 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:18.096481    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5glc\" (UniqueName: \"kubernetes.io/projected/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-kube-api-access-x5glc\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:37:18.096503 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:18.096502    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:37:18.096626 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:18.096512    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:37:18.096626 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:18.096520    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:37:18.096626 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:18.096527    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7935c9c2-79dc-479e-81aa-ebbc0d5d927d-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:37:18.537442 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:18.537415    2565 generic.go:356] "Generic (PLEG): container finished" podID="7935c9c2-79dc-479e-81aa-ebbc0d5d927d" containerID="86b17fdfe17c094ddbe05e5a743b4182dd2d818330b2c32baded6162872bc02a" exitCode=0
Sep 16 02:37:18.537563 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:18.537463    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"
Sep 16 02:37:18.537563 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:18.537507    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg" event={"ID":"7935c9c2-79dc-479e-81aa-ebbc0d5d927d","Type":"ContainerDied","Data":"86b17fdfe17c094ddbe05e5a743b4182dd2d818330b2c32baded6162872bc02a"}
Sep 16 02:37:18.537743 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:18.537568    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg" event={"ID":"7935c9c2-79dc-479e-81aa-ebbc0d5d927d","Type":"ContainerDied","Data":"69d87437ee848b2541b94e43f83f9e0f6c03f287bdc01a9cc8a6373ebce6758a"}
Sep 16 02:37:18.537743 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:18.537604    2565 scope.go:117] "RemoveContainer" containerID="86b17fdfe17c094ddbe05e5a743b4182dd2d818330b2c32baded6162872bc02a"
Sep 16 02:37:18.547782 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:18.547749    2565 scope.go:117] "RemoveContainer" containerID="e8494a399d0c84db0bcc06a93bdfd77f2e5a6d107e27c690550bf0031ec033fb"
Sep 16 02:37:18.557005 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:18.556977    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"]
Sep 16 02:37:18.559288 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:18.559266    2565 scope.go:117] "RemoveContainer" containerID="86b17fdfe17c094ddbe05e5a743b4182dd2d818330b2c32baded6162872bc02a"
Sep 16 02:37:18.559575 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:37:18.559557    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86b17fdfe17c094ddbe05e5a743b4182dd2d818330b2c32baded6162872bc02a\": container with ID starting with 86b17fdfe17c094ddbe05e5a743b4182dd2d818330b2c32baded6162872bc02a not found: ID does not exist" containerID="86b17fdfe17c094ddbe05e5a743b4182dd2d818330b2c32baded6162872bc02a"
Sep 16 02:37:18.559640 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:18.559583    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86b17fdfe17c094ddbe05e5a743b4182dd2d818330b2c32baded6162872bc02a"} err="failed to get container status \"86b17fdfe17c094ddbe05e5a743b4182dd2d818330b2c32baded6162872bc02a\": rpc error: code = NotFound desc = could not find container \"86b17fdfe17c094ddbe05e5a743b4182dd2d818330b2c32baded6162872bc02a\": container with ID starting with 86b17fdfe17c094ddbe05e5a743b4182dd2d818330b2c32baded6162872bc02a not found: ID does not exist"
Sep 16 02:37:18.559640 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:18.559599    2565 scope.go:117] "RemoveContainer" containerID="e8494a399d0c84db0bcc06a93bdfd77f2e5a6d107e27c690550bf0031ec033fb"
Sep 16 02:37:18.559751 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:18.559709    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg"]
Sep 16 02:37:18.559831 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:37:18.559815    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8494a399d0c84db0bcc06a93bdfd77f2e5a6d107e27c690550bf0031ec033fb\": container with ID starting with e8494a399d0c84db0bcc06a93bdfd77f2e5a6d107e27c690550bf0031ec033fb not found: ID does not exist" containerID="e8494a399d0c84db0bcc06a93bdfd77f2e5a6d107e27c690550bf0031ec033fb"
Sep 16 02:37:18.559869 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:18.559836    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8494a399d0c84db0bcc06a93bdfd77f2e5a6d107e27c690550bf0031ec033fb"} err="failed to get container status \"e8494a399d0c84db0bcc06a93bdfd77f2e5a6d107e27c690550bf0031ec033fb\": rpc error: code = NotFound desc = could not find container \"e8494a399d0c84db0bcc06a93bdfd77f2e5a6d107e27c690550bf0031ec033fb\": container with ID starting with e8494a399d0c84db0bcc06a93bdfd77f2e5a6d107e27c690550bf0031ec033fb not found: ID does not exist"
Sep 16 02:37:20.364258 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:20.364186    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:20.391467 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:20.391436    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7935c9c2-79dc-479e-81aa-ebbc0d5d927d" path="/var/lib/kubelet/pods/7935c9c2-79dc-479e-81aa-ebbc0d5d927d/volumes"
Sep 16 02:37:20.465402 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:20.465369    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:20.564915 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:20.564883    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:20.665701 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:20.665675    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:21.034287 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.034215    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:21.176608 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.176575    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:21.209054 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.208813    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x"]
Sep 16 02:37:21.209226 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.209086    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x" podUID="f695ebef-9866-4bd7-ad23-d7be65d9a083" containerName="payload-processing" containerID="cri-o://3828a9f36d0338b0d36e09a4ad727cf872d8f17642e83e7dfa7583df04993cb0" gracePeriod=30
Sep 16 02:37:21.214187 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.214163    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp"]
Sep 16 02:37:21.214415 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.214389    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp" podUID="d6769937-1cc2-45ad-bae0-499d85de3043" containerName="payload-pre-processing" containerID="cri-o://3f2b027a03dbd8d692f5793888a2173b902a5b7518edaa70e36ac885a2079062" gracePeriod=30
Sep 16 02:37:21.238949 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.238916    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:21.301192 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.301121    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:21.402351 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.402317    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:21.491436 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.491407    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x"
Sep 16 02:37:21.501544 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.501495    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:21.526145 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.526122    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp"
Sep 16 02:37:21.560099 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.560026    2565 generic.go:356] "Generic (PLEG): container finished" podID="d6769937-1cc2-45ad-bae0-499d85de3043" containerID="3f2b027a03dbd8d692f5793888a2173b902a5b7518edaa70e36ac885a2079062" exitCode=0
Sep 16 02:37:21.560099 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.560063    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp"
Sep 16 02:37:21.560285 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.560114    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp" event={"ID":"d6769937-1cc2-45ad-bae0-499d85de3043","Type":"ContainerDied","Data":"3f2b027a03dbd8d692f5793888a2173b902a5b7518edaa70e36ac885a2079062"}
Sep 16 02:37:21.560285 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.560168    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp" event={"ID":"d6769937-1cc2-45ad-bae0-499d85de3043","Type":"ContainerDied","Data":"b2caae5bbaf88f834c8db786af7530d4a06a4866831f931a023e299280c21905"}
Sep 16 02:37:21.560285 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.560227    2565 scope.go:117] "RemoveContainer" containerID="3f2b027a03dbd8d692f5793888a2173b902a5b7518edaa70e36ac885a2079062"
Sep 16 02:37:21.561716 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.561693    2565 generic.go:356] "Generic (PLEG): container finished" podID="f695ebef-9866-4bd7-ad23-d7be65d9a083" containerID="3828a9f36d0338b0d36e09a4ad727cf872d8f17642e83e7dfa7583df04993cb0" exitCode=0
Sep 16 02:37:21.561823 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.561775    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x" event={"ID":"f695ebef-9866-4bd7-ad23-d7be65d9a083","Type":"ContainerDied","Data":"3828a9f36d0338b0d36e09a4ad727cf872d8f17642e83e7dfa7583df04993cb0"}
Sep 16 02:37:21.561881 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.561823    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x" event={"ID":"f695ebef-9866-4bd7-ad23-d7be65d9a083","Type":"ContainerDied","Data":"cb5ada7e8e7c1beb8fe4cebd1e85563699b2c609c7eff6faf360d55c7fc1492b"}
Sep 16 02:37:21.561988 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.561972    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x"
Sep 16 02:37:21.570680 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.570658    2565 scope.go:117] "RemoveContainer" containerID="3f2b027a03dbd8d692f5793888a2173b902a5b7518edaa70e36ac885a2079062"
Sep 16 02:37:21.571024 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:37:21.571002    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f2b027a03dbd8d692f5793888a2173b902a5b7518edaa70e36ac885a2079062\": container with ID starting with 3f2b027a03dbd8d692f5793888a2173b902a5b7518edaa70e36ac885a2079062 not found: ID does not exist" containerID="3f2b027a03dbd8d692f5793888a2173b902a5b7518edaa70e36ac885a2079062"
Sep 16 02:37:21.571102 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.571045    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f2b027a03dbd8d692f5793888a2173b902a5b7518edaa70e36ac885a2079062"} err="failed to get container status \"3f2b027a03dbd8d692f5793888a2173b902a5b7518edaa70e36ac885a2079062\": rpc error: code = NotFound desc = could not find container \"3f2b027a03dbd8d692f5793888a2173b902a5b7518edaa70e36ac885a2079062\": container with ID starting with 3f2b027a03dbd8d692f5793888a2173b902a5b7518edaa70e36ac885a2079062 not found: ID does not exist"
Sep 16 02:37:21.571102 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.571068    2565 scope.go:117] "RemoveContainer" containerID="3828a9f36d0338b0d36e09a4ad727cf872d8f17642e83e7dfa7583df04993cb0"
Sep 16 02:37:21.581968 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.581947    2565 scope.go:117] "RemoveContainer" containerID="3828a9f36d0338b0d36e09a4ad727cf872d8f17642e83e7dfa7583df04993cb0"
Sep 16 02:37:21.582235 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:37:21.582217    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3828a9f36d0338b0d36e09a4ad727cf872d8f17642e83e7dfa7583df04993cb0\": container with ID starting with 3828a9f36d0338b0d36e09a4ad727cf872d8f17642e83e7dfa7583df04993cb0 not found: ID does not exist" containerID="3828a9f36d0338b0d36e09a4ad727cf872d8f17642e83e7dfa7583df04993cb0"
Sep 16 02:37:21.582294 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.582243    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3828a9f36d0338b0d36e09a4ad727cf872d8f17642e83e7dfa7583df04993cb0"} err="failed to get container status \"3828a9f36d0338b0d36e09a4ad727cf872d8f17642e83e7dfa7583df04993cb0\": rpc error: code = NotFound desc = could not find container \"3828a9f36d0338b0d36e09a4ad727cf872d8f17642e83e7dfa7583df04993cb0\": container with ID starting with 3828a9f36d0338b0d36e09a4ad727cf872d8f17642e83e7dfa7583df04993cb0 not found: ID does not exist"
Sep 16 02:37:21.630312 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.630288    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f695ebef-9866-4bd7-ad23-d7be65d9a083-plugins-config-volume\") pod \"f695ebef-9866-4bd7-ad23-d7be65d9a083\" (UID: \"f695ebef-9866-4bd7-ad23-d7be65d9a083\") "
Sep 16 02:37:21.630834 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.630350    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6769937-1cc2-45ad-bae0-499d85de3043-plugins-config-volume\") pod \"d6769937-1cc2-45ad-bae0-499d85de3043\" (UID: \"d6769937-1cc2-45ad-bae0-499d85de3043\") "
Sep 16 02:37:21.630834 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.630433    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rncv\" (UniqueName: \"kubernetes.io/projected/f695ebef-9866-4bd7-ad23-d7be65d9a083-kube-api-access-4rncv\") pod \"f695ebef-9866-4bd7-ad23-d7be65d9a083\" (UID: \"f695ebef-9866-4bd7-ad23-d7be65d9a083\") "
Sep 16 02:37:21.630834 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.630520    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7w6lw\" (UniqueName: \"kubernetes.io/projected/d6769937-1cc2-45ad-bae0-499d85de3043-kube-api-access-7w6lw\") pod \"d6769937-1cc2-45ad-bae0-499d85de3043\" (UID: \"d6769937-1cc2-45ad-bae0-499d85de3043\") "
Sep 16 02:37:21.630834 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.630784    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f695ebef-9866-4bd7-ad23-d7be65d9a083-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f695ebef-9866-4bd7-ad23-d7be65d9a083" (UID: "f695ebef-9866-4bd7-ad23-d7be65d9a083"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:37:21.631030 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.630865    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6769937-1cc2-45ad-bae0-499d85de3043-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d6769937-1cc2-45ad-bae0-499d85de3043" (UID: "d6769937-1cc2-45ad-bae0-499d85de3043"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:37:21.631150 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.631134    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f695ebef-9866-4bd7-ad23-d7be65d9a083-plugins-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:37:21.631205 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.631153    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6769937-1cc2-45ad-bae0-499d85de3043-plugins-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:37:21.632656 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.632634    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f695ebef-9866-4bd7-ad23-d7be65d9a083-kube-api-access-4rncv" (OuterVolumeSpecName: "kube-api-access-4rncv") pod "f695ebef-9866-4bd7-ad23-d7be65d9a083" (UID: "f695ebef-9866-4bd7-ad23-d7be65d9a083"). InnerVolumeSpecName "kube-api-access-4rncv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:37:21.632950 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.632930    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6769937-1cc2-45ad-bae0-499d85de3043-kube-api-access-7w6lw" (OuterVolumeSpecName: "kube-api-access-7w6lw") pod "d6769937-1cc2-45ad-bae0-499d85de3043" (UID: "d6769937-1cc2-45ad-bae0-499d85de3043"). InnerVolumeSpecName "kube-api-access-7w6lw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:37:21.693414 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.693355    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:21.732407 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.732351    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rncv\" (UniqueName: \"kubernetes.io/projected/f695ebef-9866-4bd7-ad23-d7be65d9a083-kube-api-access-4rncv\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:37:21.732407 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.732408    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7w6lw\" (UniqueName: \"kubernetes.io/projected/d6769937-1cc2-45ad-bae0-499d85de3043-kube-api-access-7w6lw\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:37:21.886941 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.886912    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp"]
Sep 16 02:37:21.890708 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.890684    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp"]
Sep 16 02:37:21.899660 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.899635    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x"]
Sep 16 02:37:21.903003 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.902982    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x"]
Sep 16 02:37:21.922479 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:21.922455    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:22.392225 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:22.392199    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6769937-1cc2-45ad-bae0-499d85de3043" path="/var/lib/kubelet/pods/d6769937-1cc2-45ad-bae0-499d85de3043/volumes"
Sep 16 02:37:22.392605 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:22.392587    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f695ebef-9866-4bd7-ad23-d7be65d9a083" path="/var/lib/kubelet/pods/f695ebef-9866-4bd7-ad23-d7be65d9a083/volumes"
Sep 16 02:37:22.529716 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:22.529633    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:23.124237 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:23.124203    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:27.419970 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:27.419923    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:27.520740 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:27.520709    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:27.654715 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:27.654682    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"]
Sep 16 02:37:27.654965 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:27.654937    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k" podUID="334f809c-9853-46bc-a0d9-2dd32e2ef6f5" containerName="istio-proxy" containerID="cri-o://626a2b2f141344ff3a7785fbf5f45a7a175e730f9d6efcc3dbbc5d99076041f3" gracePeriod=30
Sep 16 02:37:27.661308 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:27.661267    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:29.261774 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:29.261744    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:29.641269 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:29.641182    2565 patch_prober.go:28] interesting pod/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 02:37:29.641420 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:29.641262    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k" podUID="334f809c-9853-46bc-a0d9-2dd32e2ef6f5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 02:37:32.906018 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:32.905994    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:37:33.033902 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.033838    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-istio-token\") pod \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") "
Sep 16 02:37:33.033902 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.033886    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-istiod-ca-cert\") pod \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") "
Sep 16 02:37:33.034081 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.033916    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-istio-podinfo\") pod \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") "
Sep 16 02:37:33.034081 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.034028    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-credential-socket\") pod \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") "
Sep 16 02:37:33.034212 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.034082    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-istio-data\") pod \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") "
Sep 16 02:37:33.034212 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.034113    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-istio-envoy\") pod \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") "
Sep 16 02:37:33.034212 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.034139    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-workload-socket\") pod \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") "
Sep 16 02:37:33.034212 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.034198    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-workload-certs\") pod \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") "
Sep 16 02:37:33.034465 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.034275    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzcxb\" (UniqueName: \"kubernetes.io/projected/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-kube-api-access-kzcxb\") pod \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\" (UID: \"334f809c-9853-46bc-a0d9-2dd32e2ef6f5\") "
Sep 16 02:37:33.034465 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.034290    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "334f809c-9853-46bc-a0d9-2dd32e2ef6f5" (UID: "334f809c-9853-46bc-a0d9-2dd32e2ef6f5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:37:33.034465 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.034350    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-istio-data" (OuterVolumeSpecName: "istio-data") pod "334f809c-9853-46bc-a0d9-2dd32e2ef6f5" (UID: "334f809c-9853-46bc-a0d9-2dd32e2ef6f5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:37:33.034465 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.034435    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "334f809c-9853-46bc-a0d9-2dd32e2ef6f5" (UID: "334f809c-9853-46bc-a0d9-2dd32e2ef6f5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:37:33.034640 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.034489    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "334f809c-9853-46bc-a0d9-2dd32e2ef6f5" (UID: "334f809c-9853-46bc-a0d9-2dd32e2ef6f5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:37:33.034640 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.034544    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "334f809c-9853-46bc-a0d9-2dd32e2ef6f5" (UID: "334f809c-9853-46bc-a0d9-2dd32e2ef6f5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:37:33.034775 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.034690    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:37:33.034775 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.034707    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:37:33.034775 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.034721    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:37:33.034775 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.034738    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:37:33.034775 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.034753    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:37:33.036104 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.036076    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "334f809c-9853-46bc-a0d9-2dd32e2ef6f5" (UID: "334f809c-9853-46bc-a0d9-2dd32e2ef6f5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 02:37:33.036279 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.036103    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-istio-token" (OuterVolumeSpecName: "istio-token") pod "334f809c-9853-46bc-a0d9-2dd32e2ef6f5" (UID: "334f809c-9853-46bc-a0d9-2dd32e2ef6f5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:37:33.036381 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.036313    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "334f809c-9853-46bc-a0d9-2dd32e2ef6f5" (UID: "334f809c-9853-46bc-a0d9-2dd32e2ef6f5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:37:33.036458 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.036440    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-kube-api-access-kzcxb" (OuterVolumeSpecName: "kube-api-access-kzcxb") pod "334f809c-9853-46bc-a0d9-2dd32e2ef6f5" (UID: "334f809c-9853-46bc-a0d9-2dd32e2ef6f5"). InnerVolumeSpecName "kube-api-access-kzcxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:37:33.136055 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.136032    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:37:33.136055 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.136053    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzcxb\" (UniqueName: \"kubernetes.io/projected/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-kube-api-access-kzcxb\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:37:33.136189 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.136064    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:37:33.136189 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.136073    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/334f809c-9853-46bc-a0d9-2dd32e2ef6f5-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:37:33.636663 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.636632    2565 generic.go:356] "Generic (PLEG): container finished" podID="334f809c-9853-46bc-a0d9-2dd32e2ef6f5" containerID="626a2b2f141344ff3a7785fbf5f45a7a175e730f9d6efcc3dbbc5d99076041f3" exitCode=0
Sep 16 02:37:33.636806 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.636677    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"
Sep 16 02:37:33.636806 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.636712    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k" event={"ID":"334f809c-9853-46bc-a0d9-2dd32e2ef6f5","Type":"ContainerDied","Data":"626a2b2f141344ff3a7785fbf5f45a7a175e730f9d6efcc3dbbc5d99076041f3"}
Sep 16 02:37:33.636806 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.636766    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k" event={"ID":"334f809c-9853-46bc-a0d9-2dd32e2ef6f5","Type":"ContainerDied","Data":"7dd563d42ea2772ed46412a6acc3dfe9f65c533ebf6415087e13551f03865f41"}
Sep 16 02:37:33.636806 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.636786    2565 scope.go:117] "RemoveContainer" containerID="626a2b2f141344ff3a7785fbf5f45a7a175e730f9d6efcc3dbbc5d99076041f3"
Sep 16 02:37:33.647064 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.647045    2565 scope.go:117] "RemoveContainer" containerID="bd18e62193f69576c767035b9b11706e18da929dd010af52cc4e3ac7fd259618"
Sep 16 02:37:33.655090 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.655071    2565 scope.go:117] "RemoveContainer" containerID="626a2b2f141344ff3a7785fbf5f45a7a175e730f9d6efcc3dbbc5d99076041f3"
Sep 16 02:37:33.655551 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:37:33.655514    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"626a2b2f141344ff3a7785fbf5f45a7a175e730f9d6efcc3dbbc5d99076041f3\": container with ID starting with 626a2b2f141344ff3a7785fbf5f45a7a175e730f9d6efcc3dbbc5d99076041f3 not found: ID does not exist" containerID="626a2b2f141344ff3a7785fbf5f45a7a175e730f9d6efcc3dbbc5d99076041f3"
Sep 16 02:37:33.655679 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.655567    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"626a2b2f141344ff3a7785fbf5f45a7a175e730f9d6efcc3dbbc5d99076041f3"} err="failed to get container status \"626a2b2f141344ff3a7785fbf5f45a7a175e730f9d6efcc3dbbc5d99076041f3\": rpc error: code = NotFound desc = could not find container \"626a2b2f141344ff3a7785fbf5f45a7a175e730f9d6efcc3dbbc5d99076041f3\": container with ID starting with 626a2b2f141344ff3a7785fbf5f45a7a175e730f9d6efcc3dbbc5d99076041f3 not found: ID does not exist"
Sep 16 02:37:33.655679 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.655591    2565 scope.go:117] "RemoveContainer" containerID="bd18e62193f69576c767035b9b11706e18da929dd010af52cc4e3ac7fd259618"
Sep 16 02:37:33.656082 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:37:33.656058    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd18e62193f69576c767035b9b11706e18da929dd010af52cc4e3ac7fd259618\": container with ID starting with bd18e62193f69576c767035b9b11706e18da929dd010af52cc4e3ac7fd259618 not found: ID does not exist" containerID="bd18e62193f69576c767035b9b11706e18da929dd010af52cc4e3ac7fd259618"
Sep 16 02:37:33.656195 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.656088    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd18e62193f69576c767035b9b11706e18da929dd010af52cc4e3ac7fd259618"} err="failed to get container status \"bd18e62193f69576c767035b9b11706e18da929dd010af52cc4e3ac7fd259618\": rpc error: code = NotFound desc = could not find container \"bd18e62193f69576c767035b9b11706e18da929dd010af52cc4e3ac7fd259618\": container with ID starting with bd18e62193f69576c767035b9b11706e18da929dd010af52cc4e3ac7fd259618 not found: ID does not exist"
Sep 16 02:37:33.660641 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.660621    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"]
Sep 16 02:37:33.664512 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:33.664492    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k"]
Sep 16 02:37:34.391113 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:34.391086    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="334f809c-9853-46bc-a0d9-2dd32e2ef6f5" path="/var/lib/kubelet/pods/334f809c-9853-46bc-a0d9-2dd32e2ef6f5/volumes"
Sep 16 02:37:42.387896 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:42.387865    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8" secret="" err="secret \"payload-processing-dockercfg-7v8jt\" not found"
Sep 16 02:37:45.640914 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:45.640875    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:45.689266 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:45.689218    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:46.293086 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:46.293047    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:46.947417 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:46.947351    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:52.663655 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:52.663623    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:52.770579 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:52.770541    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:37:52.863697 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:37:52.863664    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:08.747427 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:08.747309    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:08.847409 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:08.847349    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:14.473902 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:14.473869    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:14.533378 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:14.533337    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:14.607241 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:14.607203    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:14.709647 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:14.709614    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:25.147191 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:25.147155    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:25.887199 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:25.887166    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:28.940868 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:28.940812    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:29.049729 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:29.049690    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-5b59aa-88lnn"]
Sep 16 02:38:29.050147 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:29.050132    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="334f809c-9853-46bc-a0d9-2dd32e2ef6f5" containerName="istio-proxy"
Sep 16 02:38:29.050194 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:29.050151    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="334f809c-9853-46bc-a0d9-2dd32e2ef6f5" containerName="istio-proxy"
Sep 16 02:38:29.050194 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:29.050165    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6769937-1cc2-45ad-bae0-499d85de3043" containerName="payload-pre-processing"
Sep 16 02:38:29.050194 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:29.050172    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6769937-1cc2-45ad-bae0-499d85de3043" containerName="payload-pre-processing"
Sep 16 02:38:29.050194 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:29.050183    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7935c9c2-79dc-479e-81aa-ebbc0d5d927d" containerName="istio-proxy"
Sep 16 02:38:29.050194 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:29.050189    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7935c9c2-79dc-479e-81aa-ebbc0d5d927d" containerName="istio-proxy"
Sep 16 02:38:29.050353 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:29.050201    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f695ebef-9866-4bd7-ad23-d7be65d9a083" containerName="payload-processing"
Sep 16 02:38:29.050353 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:29.050206    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f695ebef-9866-4bd7-ad23-d7be65d9a083" containerName="payload-processing"
Sep 16 02:38:29.050353 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:29.050270    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6769937-1cc2-45ad-bae0-499d85de3043" containerName="payload-pre-processing"
Sep 16 02:38:29.050353 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:29.050278    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="334f809c-9853-46bc-a0d9-2dd32e2ef6f5" containerName="istio-proxy"
Sep 16 02:38:29.050353 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:29.050284    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="334f809c-9853-46bc-a0d9-2dd32e2ef6f5" containerName="istio-proxy"
Sep 16 02:38:29.050353 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:29.050289    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f695ebef-9866-4bd7-ad23-d7be65d9a083" containerName="payload-processing"
Sep 16 02:38:29.050353 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:29.050296    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7935c9c2-79dc-479e-81aa-ebbc0d5d927d" containerName="istio-proxy"
Sep 16 02:38:29.050353 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:29.050303    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7935c9c2-79dc-479e-81aa-ebbc0d5d927d" containerName="istio-proxy"
Sep 16 02:38:29.052465 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:29.052446    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-5b59aa-88lnn"
Sep 16 02:38:29.054693 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:29.054668    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 02:38:29.054693 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:29.054687    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w8hnp\""
Sep 16 02:38:29.059918 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:29.059892    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-5b59aa-88lnn"]
Sep 16 02:38:29.070761 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:29.070730    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b05f657-24bf-407e-a52b-f44105132d72-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-5b59aa-88lnn\" (UID: \"5b05f657-24bf-407e-a52b-f44105132d72\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-5b59aa-88lnn"
Sep 16 02:38:29.171964 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:29.171925    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b05f657-24bf-407e-a52b-f44105132d72-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-5b59aa-88lnn\" (UID: \"5b05f657-24bf-407e-a52b-f44105132d72\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-5b59aa-88lnn"
Sep 16 02:38:29.172552 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:29.172533    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b05f657-24bf-407e-a52b-f44105132d72-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-5b59aa-88lnn\" (UID: \"5b05f657-24bf-407e-a52b-f44105132d72\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-5b59aa-88lnn"
Sep 16 02:38:29.205074 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:29.204991    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:29.364545 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:29.364510    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-5b59aa-88lnn"
Sep 16 02:38:29.640081 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:29.640056    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-5b59aa-88lnn"]
Sep 16 02:38:29.640859 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:38:29.640838    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b05f657_24bf_407e_a52b_f44105132d72.slice/crio-38eb4c03f805b2fcaa786b7f5b835c12299ddb8741c14fa12e758f9c961a7e5e WatchSource:0}: Error finding container 38eb4c03f805b2fcaa786b7f5b835c12299ddb8741c14fa12e758f9c961a7e5e: Status 404 returned error can't find the container with id 38eb4c03f805b2fcaa786b7f5b835c12299ddb8741c14fa12e758f9c961a7e5e
Sep 16 02:38:29.968136 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:29.968104    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-5b59aa-88lnn" event={"ID":"5b05f657-24bf-407e-a52b-f44105132d72","Type":"ContainerStarted","Data":"462f07197ccdfa0a356be4047fd0179430e0495aec4b5f72bdd04058f9973b77"}
Sep 16 02:38:29.968515 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:29.968158    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-5b59aa-88lnn" event={"ID":"5b05f657-24bf-407e-a52b-f44105132d72","Type":"ContainerStarted","Data":"38eb4c03f805b2fcaa786b7f5b835c12299ddb8741c14fa12e758f9c961a7e5e"}
Sep 16 02:38:29.969906 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:29.969875    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:29.984488 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:29.984441    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-5b59aa-88lnn" podStartSLOduration=0.984426864 podStartE2EDuration="984.426864ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:38:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:38:29.981735931 +0000 UTC m=+1188.032080437" watchObservedRunningTime="2026-09-16 02:38:29.984426864 +0000 UTC m=+1188.034771356"
Sep 16 02:38:30.734145 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:30.734109    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:30.975906 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:30.975869    2565 generic.go:356] "Generic (PLEG): container finished" podID="5b05f657-24bf-407e-a52b-f44105132d72" containerID="462f07197ccdfa0a356be4047fd0179430e0495aec4b5f72bdd04058f9973b77" exitCode=0
Sep 16 02:38:30.976277 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:30.975954    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-5b59aa-88lnn" event={"ID":"5b05f657-24bf-407e-a52b-f44105132d72","Type":"ContainerDied","Data":"462f07197ccdfa0a356be4047fd0179430e0495aec4b5f72bdd04058f9973b77"}
Sep 16 02:38:31.433484 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:31.433449    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:32.102587 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:32.102550    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:32.109693 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:32.109674    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-5b59aa-88lnn"
Sep 16 02:38:32.202405 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:32.202372    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b05f657-24bf-407e-a52b-f44105132d72-maas-api-service-ca\") pod \"5b05f657-24bf-407e-a52b-f44105132d72\" (UID: \"5b05f657-24bf-407e-a52b-f44105132d72\") "
Sep 16 02:38:32.202683 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:32.202661    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b05f657-24bf-407e-a52b-f44105132d72-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5b05f657-24bf-407e-a52b-f44105132d72" (UID: "5b05f657-24bf-407e-a52b-f44105132d72"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:38:32.208243 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:32.208215    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:32.302105 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:32.302022    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:32.303179 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:32.303159    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b05f657-24bf-407e-a52b-f44105132d72-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:38:32.401471 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:32.401438    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:32.963919 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:32.963880    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:32.989211 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:32.989183    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-5b59aa-88lnn"
Sep 16 02:38:32.989402 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:32.989227    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-5b59aa-88lnn" event={"ID":"5b05f657-24bf-407e-a52b-f44105132d72","Type":"ContainerDied","Data":"38eb4c03f805b2fcaa786b7f5b835c12299ddb8741c14fa12e758f9c961a7e5e"}
Sep 16 02:38:32.989402 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:32.989274    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38eb4c03f805b2fcaa786b7f5b835c12299ddb8741c14fa12e758f9c961a7e5e"
Sep 16 02:38:33.063952 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:33.063918    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:33.145430 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:33.145390    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:34.032986 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:34.032952    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"]
Sep 16 02:38:34.052547 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:34.052504    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"]
Sep 16 02:38:34.125800 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:34.125757    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:34.574955 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:34.574923    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:36.003697 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:36.003662    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:36.055327 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:36.055293    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:40.280115 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:40.280076    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:41.650102 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:41.650066    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:44.519897 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:44.519862    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:44.541529 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:44.541496    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz"]
Sep 16 02:38:44.541743 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:44.541716    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz" podUID="c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d" containerName="payload-processing" containerID="cri-o://92c5e7734106feb01076e71401529bdbcc3c9fa2c45bfde9b222c8c27fc236ae" gracePeriod=30
Sep 16 02:38:44.617297 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:44.617237    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:44.691491 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:44.691442    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-5b59aa-88lnn"]
Sep 16 02:38:44.692654 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:44.692626    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:44.694312 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:44.694287    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-5b59aa-88lnn"]
Sep 16 02:38:44.744890 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:44.744854    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:44.806570 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:44.806537    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz"
Sep 16 02:38:44.925309 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:44.925273    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5zwv\" (UniqueName: \"kubernetes.io/projected/c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d-kube-api-access-p5zwv\") pod \"c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d\" (UID: \"c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d\") "
Sep 16 02:38:44.925498 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:44.925414    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d-plugins-config-volume\") pod \"c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d\" (UID: \"c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d\") "
Sep 16 02:38:44.925727 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:44.925705    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d" (UID: "c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:38:44.925808 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:44.925782    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d-plugins-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:38:44.927371 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:44.927340    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d-kube-api-access-p5zwv" (OuterVolumeSpecName: "kube-api-access-p5zwv") pod "c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d" (UID: "c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d"). InnerVolumeSpecName "kube-api-access-p5zwv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:38:45.024827 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:45.024797    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:45.027143 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:45.027115    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5zwv\" (UniqueName: \"kubernetes.io/projected/c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d-kube-api-access-p5zwv\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:38:45.063002 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:45.062922    2565 generic.go:356] "Generic (PLEG): container finished" podID="c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d" containerID="92c5e7734106feb01076e71401529bdbcc3c9fa2c45bfde9b222c8c27fc236ae" exitCode=0
Sep 16 02:38:45.063002 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:45.062975    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz"
Sep 16 02:38:45.063165 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:45.062979    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz" event={"ID":"c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d","Type":"ContainerDied","Data":"92c5e7734106feb01076e71401529bdbcc3c9fa2c45bfde9b222c8c27fc236ae"}
Sep 16 02:38:45.063165 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:45.063106    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz" event={"ID":"c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d","Type":"ContainerDied","Data":"0d7cb777c325b1b9ebc1da8d22cad4f54dde59d715f2109ddae8fcb98d265e67"}
Sep 16 02:38:45.063165 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:45.063134    2565 scope.go:117] "RemoveContainer" containerID="92c5e7734106feb01076e71401529bdbcc3c9fa2c45bfde9b222c8c27fc236ae"
Sep 16 02:38:45.072777 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:45.072763    2565 scope.go:117] "RemoveContainer" containerID="92c5e7734106feb01076e71401529bdbcc3c9fa2c45bfde9b222c8c27fc236ae"
Sep 16 02:38:45.073048 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:38:45.073028    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92c5e7734106feb01076e71401529bdbcc3c9fa2c45bfde9b222c8c27fc236ae\": container with ID starting with 92c5e7734106feb01076e71401529bdbcc3c9fa2c45bfde9b222c8c27fc236ae not found: ID does not exist" containerID="92c5e7734106feb01076e71401529bdbcc3c9fa2c45bfde9b222c8c27fc236ae"
Sep 16 02:38:45.073093 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:45.073056    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92c5e7734106feb01076e71401529bdbcc3c9fa2c45bfde9b222c8c27fc236ae"} err="failed to get container status \"92c5e7734106feb01076e71401529bdbcc3c9fa2c45bfde9b222c8c27fc236ae\": rpc error: code = NotFound desc = could not find container \"92c5e7734106feb01076e71401529bdbcc3c9fa2c45bfde9b222c8c27fc236ae\": container with ID starting with 92c5e7734106feb01076e71401529bdbcc3c9fa2c45bfde9b222c8c27fc236ae not found: ID does not exist"
Sep 16 02:38:45.088481 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:45.088444    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz"]
Sep 16 02:38:45.091004 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:45.090984    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz"]
Sep 16 02:38:45.125339 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:45.125315    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:45.880436 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:45.880399    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:46.391652 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:46.391617    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b05f657-24bf-407e-a52b-f44105132d72" path="/var/lib/kubelet/pods/5b05f657-24bf-407e-a52b-f44105132d72/volumes"
Sep 16 02:38:46.392022 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:46.392008    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d" path="/var/lib/kubelet/pods/c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d/volumes"
Sep 16 02:38:46.842656 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:46.842623    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:46.943830 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:46.943795    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:47.079415 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.079345    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:47.388797 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.388764    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"]
Sep 16 02:38:47.389171 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.389159    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7935c9c2-79dc-479e-81aa-ebbc0d5d927d" containerName="istio-proxy"
Sep 16 02:38:47.389219 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.389173    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7935c9c2-79dc-479e-81aa-ebbc0d5d927d" containerName="istio-proxy"
Sep 16 02:38:47.389219 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.389196    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d" containerName="payload-processing"
Sep 16 02:38:47.389219 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.389203    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d" containerName="payload-processing"
Sep 16 02:38:47.389219 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.389212    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="334f809c-9853-46bc-a0d9-2dd32e2ef6f5" containerName="istio-proxy"
Sep 16 02:38:47.389219 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.389217    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="334f809c-9853-46bc-a0d9-2dd32e2ef6f5" containerName="istio-proxy"
Sep 16 02:38:47.389398 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.389227    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b05f657-24bf-407e-a52b-f44105132d72" containerName="revoke-keys"
Sep 16 02:38:47.389398 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.389232    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b05f657-24bf-407e-a52b-f44105132d72" containerName="revoke-keys"
Sep 16 02:38:47.389398 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.389287    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c29f678b-5e9d-4ca6-96ae-ec9a71e9a09d" containerName="payload-processing"
Sep 16 02:38:47.389398 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.389296    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b05f657-24bf-407e-a52b-f44105132d72" containerName="revoke-keys"
Sep 16 02:38:47.391903 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.391887    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:47.394331 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.394308    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-efdec406-openshift-default-dockercfg-c6pn6\""
Sep 16 02:38:47.404729 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.404702    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"]
Sep 16 02:38:47.411643 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.411619    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:47.553452 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.553416    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52603d78-c62a-4226-9147-893c2ab9bdc5-istio-podinfo\") pod \"e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") " pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:47.553623 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.553464    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52603d78-c62a-4226-9147-893c2ab9bdc5-credential-socket\") pod \"e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") " pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:47.553623 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.553490    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52603d78-c62a-4226-9147-893c2ab9bdc5-istio-envoy\") pod \"e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") " pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:47.553623 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.553536    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz4ng\" (UniqueName: \"kubernetes.io/projected/52603d78-c62a-4226-9147-893c2ab9bdc5-kube-api-access-rz4ng\") pod \"e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") " pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:47.553623 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.553563    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52603d78-c62a-4226-9147-893c2ab9bdc5-workload-socket\") pod \"e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") " pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:47.553623 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.553607    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52603d78-c62a-4226-9147-893c2ab9bdc5-istio-token\") pod \"e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") " pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:47.553802 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.553665    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52603d78-c62a-4226-9147-893c2ab9bdc5-workload-certs\") pod \"e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") " pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:47.553802 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.553718    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52603d78-c62a-4226-9147-893c2ab9bdc5-istiod-ca-cert\") pod \"e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") " pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:47.553802 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.553745    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52603d78-c62a-4226-9147-893c2ab9bdc5-istio-data\") pod \"e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") " pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:47.654549 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.654459    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz4ng\" (UniqueName: \"kubernetes.io/projected/52603d78-c62a-4226-9147-893c2ab9bdc5-kube-api-access-rz4ng\") pod \"e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") " pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:47.654549 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.654499    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52603d78-c62a-4226-9147-893c2ab9bdc5-workload-socket\") pod \"e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") " pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:47.654549 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.654536    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52603d78-c62a-4226-9147-893c2ab9bdc5-istio-token\") pod \"e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") " pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:47.654807 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.654569    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52603d78-c62a-4226-9147-893c2ab9bdc5-workload-certs\") pod \"e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") " pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:47.654807 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.654610    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52603d78-c62a-4226-9147-893c2ab9bdc5-istiod-ca-cert\") pod \"e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") " pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:47.654807 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.654646    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52603d78-c62a-4226-9147-893c2ab9bdc5-istio-data\") pod \"e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") " pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:47.654807 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.654718    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52603d78-c62a-4226-9147-893c2ab9bdc5-istio-podinfo\") pod \"e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") " pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:47.654807 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.654755    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52603d78-c62a-4226-9147-893c2ab9bdc5-credential-socket\") pod \"e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") " pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:47.655066 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.654808    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52603d78-c62a-4226-9147-893c2ab9bdc5-istio-envoy\") pod \"e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") " pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:47.655066 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.654977    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52603d78-c62a-4226-9147-893c2ab9bdc5-workload-socket\") pod \"e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") " pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:47.655171 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.655068    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52603d78-c62a-4226-9147-893c2ab9bdc5-workload-certs\") pod \"e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") " pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:47.655171 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.655126    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52603d78-c62a-4226-9147-893c2ab9bdc5-istio-data\") pod \"e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") " pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:47.655171 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.655132    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52603d78-c62a-4226-9147-893c2ab9bdc5-credential-socket\") pod \"e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") " pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:47.655399 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.655337    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52603d78-c62a-4226-9147-893c2ab9bdc5-istiod-ca-cert\") pod \"e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") " pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:47.657182 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.657151    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52603d78-c62a-4226-9147-893c2ab9bdc5-istio-envoy\") pod \"e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") " pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:47.657292 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.657240    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52603d78-c62a-4226-9147-893c2ab9bdc5-istio-podinfo\") pod \"e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") " pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:47.661267 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.661248    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52603d78-c62a-4226-9147-893c2ab9bdc5-istio-token\") pod \"e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") " pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:47.661861 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.661838    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz4ng\" (UniqueName: \"kubernetes.io/projected/52603d78-c62a-4226-9147-893c2ab9bdc5-kube-api-access-rz4ng\") pod \"e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") " pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:47.702851 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.702826    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:47.817390 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.817333    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:47.980665 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.980633    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"]
Sep 16 02:38:47.982206 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:38:47.982174    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52603d78_c62a_4226_9147_893c2ab9bdc5.slice/crio-409048b33604ca875215537a5e0fd2679f2ee02c3d1134b75b58e924cc03c6de WatchSource:0}: Error finding container 409048b33604ca875215537a5e0fd2679f2ee02c3d1134b75b58e924cc03c6de: Status 404 returned error can't find the container with id 409048b33604ca875215537a5e0fd2679f2ee02c3d1134b75b58e924cc03c6de
Sep 16 02:38:47.984343 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.984309    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:38:47.984431 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.984394    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:38:47.984431 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:47.984423    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:38:48.085566 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:48.085527    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7" event={"ID":"52603d78-c62a-4226-9147-893c2ab9bdc5","Type":"ContainerStarted","Data":"fd7958493b7e0d75212e475473c67206fa6f67134e7281258484add2cde47b25"}
Sep 16 02:38:48.085752 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:48.085582    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7" event={"ID":"52603d78-c62a-4226-9147-893c2ab9bdc5","Type":"ContainerStarted","Data":"409048b33604ca875215537a5e0fd2679f2ee02c3d1134b75b58e924cc03c6de"}
Sep 16 02:38:48.103859 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:48.103809    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7" podStartSLOduration=1.103794797 podStartE2EDuration="1.103794797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:38:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:38:48.101797951 +0000 UTC m=+1206.152142445" watchObservedRunningTime="2026-09-16 02:38:48.103794797 +0000 UTC m=+1206.154139290"
Sep 16 02:38:48.703761 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:48.703728    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:49.067210 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.067108    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5" podUID="37e86c7e-6ff5-4d65-aa01-79835818282d" containerName="main" containerID="cri-o://52a5cafb8402d8870ac3d9f41f0bfaf7459be824f5d1a16d08c8b4a36f9e322d" gracePeriod=45
Sep 16 02:38:49.077181 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.077120    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr" podUID="a3f1e719-d68a-4163-b3b6-40402dc2942f" containerName="main" containerID="cri-o://39ea520db8a17f018387b51e2056fd78db774ec62bd16e761c1f62dc58498838" gracePeriod=45
Sep 16 02:38:49.352207 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.352180    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"
Sep 16 02:38:49.355756 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.355731    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"
Sep 16 02:38:49.421674 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.421644    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:49.477227 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.477195    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3f1e719-d68a-4163-b3b6-40402dc2942f-dshm\") pod \"a3f1e719-d68a-4163-b3b6-40402dc2942f\" (UID: \"a3f1e719-d68a-4163-b3b6-40402dc2942f\") "
Sep 16 02:38:49.477427 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.477240    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3f1e719-d68a-4163-b3b6-40402dc2942f-home\") pod \"a3f1e719-d68a-4163-b3b6-40402dc2942f\" (UID: \"a3f1e719-d68a-4163-b3b6-40402dc2942f\") "
Sep 16 02:38:49.477427 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.477267    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3f1e719-d68a-4163-b3b6-40402dc2942f-model-cache\") pod \"a3f1e719-d68a-4163-b3b6-40402dc2942f\" (UID: \"a3f1e719-d68a-4163-b3b6-40402dc2942f\") "
Sep 16 02:38:49.477427 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.477294    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37e86c7e-6ff5-4d65-aa01-79835818282d-dshm\") pod \"37e86c7e-6ff5-4d65-aa01-79835818282d\" (UID: \"37e86c7e-6ff5-4d65-aa01-79835818282d\") "
Sep 16 02:38:49.477427 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.477337    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76ncf\" (UniqueName: \"kubernetes.io/projected/a3f1e719-d68a-4163-b3b6-40402dc2942f-kube-api-access-76ncf\") pod \"a3f1e719-d68a-4163-b3b6-40402dc2942f\" (UID: \"a3f1e719-d68a-4163-b3b6-40402dc2942f\") "
Sep 16 02:38:49.477427 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.477395    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3f1e719-d68a-4163-b3b6-40402dc2942f-tmp-dir\") pod \"a3f1e719-d68a-4163-b3b6-40402dc2942f\" (UID: \"a3f1e719-d68a-4163-b3b6-40402dc2942f\") "
Sep 16 02:38:49.477427 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.477421    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6l8w\" (UniqueName: \"kubernetes.io/projected/37e86c7e-6ff5-4d65-aa01-79835818282d-kube-api-access-w6l8w\") pod \"37e86c7e-6ff5-4d65-aa01-79835818282d\" (UID: \"37e86c7e-6ff5-4d65-aa01-79835818282d\") "
Sep 16 02:38:49.477757 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.477487    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37e86c7e-6ff5-4d65-aa01-79835818282d-model-cache\") pod \"37e86c7e-6ff5-4d65-aa01-79835818282d\" (UID: \"37e86c7e-6ff5-4d65-aa01-79835818282d\") "
Sep 16 02:38:49.477757 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.477529    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3f1e719-d68a-4163-b3b6-40402dc2942f-tls-certs\") pod \"a3f1e719-d68a-4163-b3b6-40402dc2942f\" (UID: \"a3f1e719-d68a-4163-b3b6-40402dc2942f\") "
Sep 16 02:38:49.477757 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.477548    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3f1e719-d68a-4163-b3b6-40402dc2942f-home" (OuterVolumeSpecName: "home") pod "a3f1e719-d68a-4163-b3b6-40402dc2942f" (UID: "a3f1e719-d68a-4163-b3b6-40402dc2942f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:38:49.477757 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.477553    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37e86c7e-6ff5-4d65-aa01-79835818282d-tls-certs\") pod \"37e86c7e-6ff5-4d65-aa01-79835818282d\" (UID: \"37e86c7e-6ff5-4d65-aa01-79835818282d\") "
Sep 16 02:38:49.477757 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.477593    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3f1e719-d68a-4163-b3b6-40402dc2942f-model-cache" (OuterVolumeSpecName: "model-cache") pod "a3f1e719-d68a-4163-b3b6-40402dc2942f" (UID: "a3f1e719-d68a-4163-b3b6-40402dc2942f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:38:49.477757 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.477635    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37e86c7e-6ff5-4d65-aa01-79835818282d-tmp-dir\") pod \"37e86c7e-6ff5-4d65-aa01-79835818282d\" (UID: \"37e86c7e-6ff5-4d65-aa01-79835818282d\") "
Sep 16 02:38:49.477757 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.477690    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3f1e719-d68a-4163-b3b6-40402dc2942f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a3f1e719-d68a-4163-b3b6-40402dc2942f" (UID: "a3f1e719-d68a-4163-b3b6-40402dc2942f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:38:49.478097 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.477854    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37e86c7e-6ff5-4d65-aa01-79835818282d-model-cache" (OuterVolumeSpecName: "model-cache") pod "37e86c7e-6ff5-4d65-aa01-79835818282d" (UID: "37e86c7e-6ff5-4d65-aa01-79835818282d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:38:49.478097 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.477966    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37e86c7e-6ff5-4d65-aa01-79835818282d-home\") pod \"37e86c7e-6ff5-4d65-aa01-79835818282d\" (UID: \"37e86c7e-6ff5-4d65-aa01-79835818282d\") "
Sep 16 02:38:49.478452 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.478417    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37e86c7e-6ff5-4d65-aa01-79835818282d-home" (OuterVolumeSpecName: "home") pod "37e86c7e-6ff5-4d65-aa01-79835818282d" (UID: "37e86c7e-6ff5-4d65-aa01-79835818282d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:38:49.478590 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.478564    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3f1e719-d68a-4163-b3b6-40402dc2942f-home\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:38:49.478663 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.478588    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3f1e719-d68a-4163-b3b6-40402dc2942f-model-cache\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:38:49.478663 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.478603    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3f1e719-d68a-4163-b3b6-40402dc2942f-tmp-dir\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:38:49.478663 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.478615    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37e86c7e-6ff5-4d65-aa01-79835818282d-model-cache\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:38:49.478663 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.478627    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37e86c7e-6ff5-4d65-aa01-79835818282d-home\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:38:49.478866 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.478845    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37e86c7e-6ff5-4d65-aa01-79835818282d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "37e86c7e-6ff5-4d65-aa01-79835818282d" (UID: "37e86c7e-6ff5-4d65-aa01-79835818282d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:38:49.480148 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.480116    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37e86c7e-6ff5-4d65-aa01-79835818282d-dshm" (OuterVolumeSpecName: "dshm") pod "37e86c7e-6ff5-4d65-aa01-79835818282d" (UID: "37e86c7e-6ff5-4d65-aa01-79835818282d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:38:49.480244 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.480141    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37e86c7e-6ff5-4d65-aa01-79835818282d-kube-api-access-w6l8w" (OuterVolumeSpecName: "kube-api-access-w6l8w") pod "37e86c7e-6ff5-4d65-aa01-79835818282d" (UID: "37e86c7e-6ff5-4d65-aa01-79835818282d"). InnerVolumeSpecName "kube-api-access-w6l8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:38:49.480244 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.480185    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3f1e719-d68a-4163-b3b6-40402dc2942f-dshm" (OuterVolumeSpecName: "dshm") pod "a3f1e719-d68a-4163-b3b6-40402dc2942f" (UID: "a3f1e719-d68a-4163-b3b6-40402dc2942f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:38:49.480244 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.480199    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37e86c7e-6ff5-4d65-aa01-79835818282d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "37e86c7e-6ff5-4d65-aa01-79835818282d" (UID: "37e86c7e-6ff5-4d65-aa01-79835818282d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:38:49.480244 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.480223    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3f1e719-d68a-4163-b3b6-40402dc2942f-kube-api-access-76ncf" (OuterVolumeSpecName: "kube-api-access-76ncf") pod "a3f1e719-d68a-4163-b3b6-40402dc2942f" (UID: "a3f1e719-d68a-4163-b3b6-40402dc2942f"). InnerVolumeSpecName "kube-api-access-76ncf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:38:49.480493 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.480421    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3f1e719-d68a-4163-b3b6-40402dc2942f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a3f1e719-d68a-4163-b3b6-40402dc2942f" (UID: "a3f1e719-d68a-4163-b3b6-40402dc2942f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:38:49.579605 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.579522    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37e86c7e-6ff5-4d65-aa01-79835818282d-tmp-dir\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:38:49.579605 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.579551    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3f1e719-d68a-4163-b3b6-40402dc2942f-dshm\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:38:49.579605 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.579560    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37e86c7e-6ff5-4d65-aa01-79835818282d-dshm\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:38:49.579605 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.579568    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76ncf\" (UniqueName: \"kubernetes.io/projected/a3f1e719-d68a-4163-b3b6-40402dc2942f-kube-api-access-76ncf\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:38:49.579605 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.579579    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6l8w\" (UniqueName: \"kubernetes.io/projected/37e86c7e-6ff5-4d65-aa01-79835818282d-kube-api-access-w6l8w\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:38:49.579605 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.579587    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3f1e719-d68a-4163-b3b6-40402dc2942f-tls-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:38:49.579605 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.579595    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37e86c7e-6ff5-4d65-aa01-79835818282d-tls-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:38:49.708592 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.708561    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:49.965425 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:49.965386    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:50.063003 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:50.062968    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:50.099796 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:50.099759    2565 generic.go:356] "Generic (PLEG): container finished" podID="a3f1e719-d68a-4163-b3b6-40402dc2942f" containerID="39ea520db8a17f018387b51e2056fd78db774ec62bd16e761c1f62dc58498838" exitCode=0
Sep 16 02:38:50.099796 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:50.099799    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"
Sep 16 02:38:50.100314 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:50.099841    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr" event={"ID":"a3f1e719-d68a-4163-b3b6-40402dc2942f","Type":"ContainerDied","Data":"39ea520db8a17f018387b51e2056fd78db774ec62bd16e761c1f62dc58498838"}
Sep 16 02:38:50.100314 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:50.099884    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr" event={"ID":"a3f1e719-d68a-4163-b3b6-40402dc2942f","Type":"ContainerDied","Data":"8e0c62b32b0c4ffa1fd2600e8bc8f94f4588546b80aa8ea331e1b84d07fb0e8c"}
Sep 16 02:38:50.100314 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:50.099906    2565 scope.go:117] "RemoveContainer" containerID="39ea520db8a17f018387b51e2056fd78db774ec62bd16e761c1f62dc58498838"
Sep 16 02:38:50.101609 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:50.101586    2565 generic.go:356] "Generic (PLEG): container finished" podID="37e86c7e-6ff5-4d65-aa01-79835818282d" containerID="52a5cafb8402d8870ac3d9f41f0bfaf7459be824f5d1a16d08c8b4a36f9e322d" exitCode=0
Sep 16 02:38:50.101701 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:50.101630    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"
Sep 16 02:38:50.101701 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:50.101655    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5" event={"ID":"37e86c7e-6ff5-4d65-aa01-79835818282d","Type":"ContainerDied","Data":"52a5cafb8402d8870ac3d9f41f0bfaf7459be824f5d1a16d08c8b4a36f9e322d"}
Sep 16 02:38:50.101701 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:50.101691    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5" event={"ID":"37e86c7e-6ff5-4d65-aa01-79835818282d","Type":"ContainerDied","Data":"5d1a99be204452a8a200d0b242480e9dbbe051474a75abe72694881cfeecd039"}
Sep 16 02:38:50.101916 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:50.101900    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:50.103094 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:50.103075    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:38:50.110777 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:50.110760    2565 scope.go:117] "RemoveContainer" containerID="39ea520db8a17f018387b51e2056fd78db774ec62bd16e761c1f62dc58498838"
Sep 16 02:38:50.111091 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:38:50.111060    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39ea520db8a17f018387b51e2056fd78db774ec62bd16e761c1f62dc58498838\": container with ID starting with 39ea520db8a17f018387b51e2056fd78db774ec62bd16e761c1f62dc58498838 not found: ID does not exist" containerID="39ea520db8a17f018387b51e2056fd78db774ec62bd16e761c1f62dc58498838"
Sep 16 02:38:50.111191 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:50.111090    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39ea520db8a17f018387b51e2056fd78db774ec62bd16e761c1f62dc58498838"} err="failed to get container status \"39ea520db8a17f018387b51e2056fd78db774ec62bd16e761c1f62dc58498838\": rpc error: code = NotFound desc = could not find container \"39ea520db8a17f018387b51e2056fd78db774ec62bd16e761c1f62dc58498838\": container with ID starting with 39ea520db8a17f018387b51e2056fd78db774ec62bd16e761c1f62dc58498838 not found: ID does not exist"
Sep 16 02:38:50.111191 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:50.111113    2565 scope.go:117] "RemoveContainer" containerID="52a5cafb8402d8870ac3d9f41f0bfaf7459be824f5d1a16d08c8b4a36f9e322d"
Sep 16 02:38:50.121273 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:50.121247    2565 scope.go:117] "RemoveContainer" containerID="52a5cafb8402d8870ac3d9f41f0bfaf7459be824f5d1a16d08c8b4a36f9e322d"
Sep 16 02:38:50.121801 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:38:50.121720    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52a5cafb8402d8870ac3d9f41f0bfaf7459be824f5d1a16d08c8b4a36f9e322d\": container with ID starting with 52a5cafb8402d8870ac3d9f41f0bfaf7459be824f5d1a16d08c8b4a36f9e322d not found: ID does not exist" containerID="52a5cafb8402d8870ac3d9f41f0bfaf7459be824f5d1a16d08c8b4a36f9e322d"
Sep 16 02:38:50.121801 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:50.121758    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52a5cafb8402d8870ac3d9f41f0bfaf7459be824f5d1a16d08c8b4a36f9e322d"} err="failed to get container status \"52a5cafb8402d8870ac3d9f41f0bfaf7459be824f5d1a16d08c8b4a36f9e322d\": rpc error: code = NotFound desc = could not find container \"52a5cafb8402d8870ac3d9f41f0bfaf7459be824f5d1a16d08c8b4a36f9e322d\": container with ID starting with 52a5cafb8402d8870ac3d9f41f0bfaf7459be824f5d1a16d08c8b4a36f9e322d not found: ID does not exist"
Sep 16 02:38:50.136308 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:50.136278    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:50.145469 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:50.145397    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"]
Sep 16 02:38:50.149628 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:50.149590    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-5b59aa/premium-w0-5b59aa-kserve-f6cfb9485-kwmvr"]
Sep 16 02:38:50.158615 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:50.158531    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"]
Sep 16 02:38:50.161047 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:50.161022    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-5b59aa/distinct-w0-5b59aa-kserve-66bf97b884-xdrc5"]
Sep 16 02:38:50.395801 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:50.395712    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37e86c7e-6ff5-4d65-aa01-79835818282d" path="/var/lib/kubelet/pods/37e86c7e-6ff5-4d65-aa01-79835818282d/volumes"
Sep 16 02:38:50.396115 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:50.396101    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3f1e719-d68a-4163-b3b6-40402dc2942f" path="/var/lib/kubelet/pods/a3f1e719-d68a-4163-b3b6-40402dc2942f/volumes"
Sep 16 02:38:51.244208 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:51.244178    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:51.292609 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:51.292578    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:51.518174 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:51.518067    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:51.640068 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:51.640032    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:51.730190 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:51.730143    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:51.824158 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:51.824005    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:51.878543 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:51.878508    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm"]
Sep 16 02:38:51.879134 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:51.879114    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37e86c7e-6ff5-4d65-aa01-79835818282d" containerName="main"
Sep 16 02:38:51.879185 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:51.879140    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="37e86c7e-6ff5-4d65-aa01-79835818282d" containerName="main"
Sep 16 02:38:51.879185 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:51.879161    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3f1e719-d68a-4163-b3b6-40402dc2942f" containerName="main"
Sep 16 02:38:51.879185 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:51.879171    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3f1e719-d68a-4163-b3b6-40402dc2942f" containerName="main"
Sep 16 02:38:51.879298 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:51.879270    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3f1e719-d68a-4163-b3b6-40402dc2942f" containerName="main"
Sep 16 02:38:51.879298 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:51.879286    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="37e86c7e-6ff5-4d65-aa01-79835818282d" containerName="main"
Sep 16 02:38:51.882238 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:51.882221    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm"
Sep 16 02:38:51.884582 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:51.884505    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-efdec406\""
Sep 16 02:38:51.891639 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:51.891617    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:51.892160 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:51.892137    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm"]
Sep 16 02:38:52.002862 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:52.002806    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6f95\" (UniqueName: \"kubernetes.io/projected/fe71132b-e60a-46d7-8d7b-71b4b36916ec-kube-api-access-d6f95\") pod \"payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm\" (UID: \"fe71132b-e60a-46d7-8d7b-71b4b36916ec\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm"
Sep 16 02:38:52.003075 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:52.002921    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe71132b-e60a-46d7-8d7b-71b4b36916ec-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm\" (UID: \"fe71132b-e60a-46d7-8d7b-71b4b36916ec\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm"
Sep 16 02:38:52.104552 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:52.104468    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6f95\" (UniqueName: \"kubernetes.io/projected/fe71132b-e60a-46d7-8d7b-71b4b36916ec-kube-api-access-d6f95\") pod \"payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm\" (UID: \"fe71132b-e60a-46d7-8d7b-71b4b36916ec\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm"
Sep 16 02:38:52.104552 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:52.104512    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe71132b-e60a-46d7-8d7b-71b4b36916ec-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm\" (UID: \"fe71132b-e60a-46d7-8d7b-71b4b36916ec\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm"
Sep 16 02:38:52.105238 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:52.105217    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe71132b-e60a-46d7-8d7b-71b4b36916ec-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm\" (UID: \"fe71132b-e60a-46d7-8d7b-71b4b36916ec\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm"
Sep 16 02:38:52.112291 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:52.112266    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6f95\" (UniqueName: \"kubernetes.io/projected/fe71132b-e60a-46d7-8d7b-71b4b36916ec-kube-api-access-d6f95\") pod \"payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm\" (UID: \"fe71132b-e60a-46d7-8d7b-71b4b36916ec\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm"
Sep 16 02:38:52.194943 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:52.194895    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm"
Sep 16 02:38:52.465917 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:52.465882    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm"]
Sep 16 02:38:52.466944 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:38:52.466915    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe71132b_e60a_46d7_8d7b_71b4b36916ec.slice/crio-51e24801e0bf387b55b1f2b88ff35eb2b5873be01bb3dfa23e361a88a47cb569 WatchSource:0}: Error finding container 51e24801e0bf387b55b1f2b88ff35eb2b5873be01bb3dfa23e361a88a47cb569: Status 404 returned error can't find the container with id 51e24801e0bf387b55b1f2b88ff35eb2b5873be01bb3dfa23e361a88a47cb569
Sep 16 02:38:53.123959 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:53.123922    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm" event={"ID":"fe71132b-e60a-46d7-8d7b-71b4b36916ec","Type":"ContainerStarted","Data":"dad1f4fc9c1adc6f23fe8e598444906f6219390e2ad433f0c196ca93957c5ded"}
Sep 16 02:38:53.124166 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:53.123982    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm" event={"ID":"fe71132b-e60a-46d7-8d7b-71b4b36916ec","Type":"ContainerStarted","Data":"51e24801e0bf387b55b1f2b88ff35eb2b5873be01bb3dfa23e361a88a47cb569"}
Sep 16 02:38:53.124166 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:53.124037    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm"
Sep 16 02:38:53.137888 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:53.137838    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm" podStartSLOduration=2.137824369 podStartE2EDuration="2.137824369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:38:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:38:53.137350109 +0000 UTC m=+1211.187694620" watchObservedRunningTime="2026-09-16 02:38:53.137824369 +0000 UTC m=+1211.188168872"
Sep 16 02:38:54.974108 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:54.974055    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:38:55.020624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:38:55.020593    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:04.135446 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:04.135413    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm"
Sep 16 02:39:06.385783 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:06.385745    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8" secret="" err="secret \"payload-processing-dockercfg-7v8jt\" not found"
Sep 16 02:39:10.259518 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:10.259453    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:10.351093 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:10.351047    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:11.360454 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:11.360299    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:13.141656 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:13.141617    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:13.834710 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:13.834676    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:14.253946 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:14.253908    2565 generic.go:356] "Generic (PLEG): container finished" podID="52603d78-c62a-4226-9147-893c2ab9bdc5" containerID="fd7958493b7e0d75212e475473c67206fa6f67134e7281258484add2cde47b25" exitCode=0
Sep 16 02:39:14.254418 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:14.253981    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7" event={"ID":"52603d78-c62a-4226-9147-893c2ab9bdc5","Type":"ContainerDied","Data":"fd7958493b7e0d75212e475473c67206fa6f67134e7281258484add2cde47b25"}
Sep 16 02:39:14.254499 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:14.254429    2565 scope.go:117] "RemoveContainer" containerID="fd7958493b7e0d75212e475473c67206fa6f67134e7281258484add2cde47b25"
Sep 16 02:39:14.255535 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:14.255504    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:39:14.255610 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:14.255594    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:39:14.255659 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:14.255644    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:39:14.535947 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:14.535854    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:14.913565 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:14.913531    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:15.261700 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:15.261609    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7" event={"ID":"52603d78-c62a-4226-9147-893c2ab9bdc5","Type":"ContainerStarted","Data":"c8c024fb4b8c11aa41a37bcd110ebf1240b85acd4b0d6c3dec272915506a233e"}
Sep 16 02:39:15.548911 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:15.548821    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:15.647466 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:15.647416    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:15.703419 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:15.703379    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:39:15.704443 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:15.704415    2565 patch_prober.go:28] interesting pod/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 16 02:39:15.704566 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:15.704480    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7" podUID="52603d78-c62a-4226-9147-893c2ab9bdc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 16 02:39:16.011161 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:16.011125    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:16.703977 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:16.703941    2565 patch_prober.go:28] interesting pod/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 16 02:39:16.704396 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:16.704000    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7" podUID="52603d78-c62a-4226-9147-893c2ab9bdc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 16 02:39:17.703638 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:17.703599    2565 patch_prober.go:28] interesting pod/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 16 02:39:17.703811 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:17.703671    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7" podUID="52603d78-c62a-4226-9147-893c2ab9bdc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 16 02:39:18.703948 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:18.703909    2565 patch_prober.go:28] interesting pod/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 16 02:39:18.704348 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:18.703966    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7" podUID="52603d78-c62a-4226-9147-893c2ab9bdc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 16 02:39:19.703473 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:19.703433    2565 patch_prober.go:28] interesting pod/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 16 02:39:19.703656 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:19.703506    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7" podUID="52603d78-c62a-4226-9147-893c2ab9bdc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 16 02:39:20.102697 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:20.102667    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:39:20.703968 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:20.703932    2565 patch_prober.go:28] interesting pod/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 16 02:39:20.704157 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:20.703986    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7" podUID="52603d78-c62a-4226-9147-893c2ab9bdc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 16 02:39:21.561927 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:21.561894    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:21.662525 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:21.662492    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:21.707468 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:21.707433    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:39:21.708379 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:21.708346    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:39:21.904112 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:21.904020    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-efdec406-c4vrd"]
Sep 16 02:39:21.916926 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:21.916893    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-efdec406-c4vrd"
Sep 16 02:39:21.917807 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:21.917770    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-efdec406-c4vrd"]
Sep 16 02:39:21.919198 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:21.919175    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w8hnp\""
Sep 16 02:39:21.919302 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:21.919179    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 02:39:22.005196 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:22.005160    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d80da84-b4a6-4d42-bdac-d7b4d2c5e9cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-efdec406-c4vrd\" (UID: \"4d80da84-b4a6-4d42-bdac-d7b4d2c5e9cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-efdec406-c4vrd"
Sep 16 02:39:22.106012 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:22.105975    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d80da84-b4a6-4d42-bdac-d7b4d2c5e9cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-efdec406-c4vrd\" (UID: \"4d80da84-b4a6-4d42-bdac-d7b4d2c5e9cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-efdec406-c4vrd"
Sep 16 02:39:22.106617 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:22.106598    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d80da84-b4a6-4d42-bdac-d7b4d2c5e9cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-efdec406-c4vrd\" (UID: \"4d80da84-b4a6-4d42-bdac-d7b4d2c5e9cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-efdec406-c4vrd"
Sep 16 02:39:22.227834 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:22.227801    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-efdec406-c4vrd"
Sep 16 02:39:22.499040 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:22.499014    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-efdec406-c4vrd"]
Sep 16 02:39:22.500911 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:39:22.500881    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d80da84_b4a6_4d42_bdac_d7b4d2c5e9cb.slice/crio-807e0f525bfd1b7ed198157f6917f1905b6b320930b1953fee876b673b9d07e8 WatchSource:0}: Error finding container 807e0f525bfd1b7ed198157f6917f1905b6b320930b1953fee876b673b9d07e8: Status 404 returned error can't find the container with id 807e0f525bfd1b7ed198157f6917f1905b6b320930b1953fee876b673b9d07e8
Sep 16 02:39:22.752133 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:22.752061    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:23.327642 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:23.327605    2565 generic.go:356] "Generic (PLEG): container finished" podID="4d80da84-b4a6-4d42-bdac-d7b4d2c5e9cb" containerID="e73b3390bf83598a84cc7a3245eab7c8b67d71bf647e737ee6bbb523ff3be50e" exitCode=0
Sep 16 02:39:23.327813 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:23.327689    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-efdec406-c4vrd" event={"ID":"4d80da84-b4a6-4d42-bdac-d7b4d2c5e9cb","Type":"ContainerDied","Data":"e73b3390bf83598a84cc7a3245eab7c8b67d71bf647e737ee6bbb523ff3be50e"}
Sep 16 02:39:23.327813 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:23.327748    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-efdec406-c4vrd" event={"ID":"4d80da84-b4a6-4d42-bdac-d7b4d2c5e9cb","Type":"ContainerStarted","Data":"807e0f525bfd1b7ed198157f6917f1905b6b320930b1953fee876b673b9d07e8"}
Sep 16 02:39:23.414615 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:23.414577    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:24.112827 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:24.112794    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:24.464059 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:24.464036    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-efdec406-c4vrd"
Sep 16 02:39:24.530694 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:24.530662    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d80da84-b4a6-4d42-bdac-d7b4d2c5e9cb-maas-api-service-ca\") pod \"4d80da84-b4a6-4d42-bdac-d7b4d2c5e9cb\" (UID: \"4d80da84-b4a6-4d42-bdac-d7b4d2c5e9cb\") "
Sep 16 02:39:24.531030 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:24.531008    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d80da84-b4a6-4d42-bdac-d7b4d2c5e9cb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4d80da84-b4a6-4d42-bdac-d7b4d2c5e9cb" (UID: "4d80da84-b4a6-4d42-bdac-d7b4d2c5e9cb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:39:24.632170 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:24.632133    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d80da84-b4a6-4d42-bdac-d7b4d2c5e9cb-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:39:25.341001 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:25.340969    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-efdec406-c4vrd"
Sep 16 02:39:25.341001 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:25.340997    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-efdec406-c4vrd" event={"ID":"4d80da84-b4a6-4d42-bdac-d7b4d2c5e9cb","Type":"ContainerDied","Data":"807e0f525bfd1b7ed198157f6917f1905b6b320930b1953fee876b673b9d07e8"}
Sep 16 02:39:25.341492 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:25.341047    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="807e0f525bfd1b7ed198157f6917f1905b6b320930b1953fee876b673b9d07e8"
Sep 16 02:39:32.292935 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:32.292898    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:32.326624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:32.326592    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm"]
Sep 16 02:39:32.326856 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:32.326825    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm" podUID="fe71132b-e60a-46d7-8d7b-71b4b36916ec" containerName="payload-pre-processing" containerID="cri-o://dad1f4fc9c1adc6f23fe8e598444906f6219390e2ad433f0c196ca93957c5ded" gracePeriod=30
Sep 16 02:39:32.391607 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:32.391576    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:32.465594 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:32.465557    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-efdec406-c4vrd"]
Sep 16 02:39:32.465753 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:32.465643    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:32.469865 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:32.469838    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-efdec406-c4vrd"]
Sep 16 02:39:32.515262 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:32.515212    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:32.604011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:32.603988    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm"
Sep 16 02:39:32.712179 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:32.712140    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe71132b-e60a-46d7-8d7b-71b4b36916ec-plugins-config-volume\") pod \"fe71132b-e60a-46d7-8d7b-71b4b36916ec\" (UID: \"fe71132b-e60a-46d7-8d7b-71b4b36916ec\") "
Sep 16 02:39:32.712389 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:32.712244    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6f95\" (UniqueName: \"kubernetes.io/projected/fe71132b-e60a-46d7-8d7b-71b4b36916ec-kube-api-access-d6f95\") pod \"fe71132b-e60a-46d7-8d7b-71b4b36916ec\" (UID: \"fe71132b-e60a-46d7-8d7b-71b4b36916ec\") "
Sep 16 02:39:32.712609 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:32.712574    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe71132b-e60a-46d7-8d7b-71b4b36916ec-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fe71132b-e60a-46d7-8d7b-71b4b36916ec" (UID: "fe71132b-e60a-46d7-8d7b-71b4b36916ec"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:39:32.714391 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:32.714337    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe71132b-e60a-46d7-8d7b-71b4b36916ec-kube-api-access-d6f95" (OuterVolumeSpecName: "kube-api-access-d6f95") pod "fe71132b-e60a-46d7-8d7b-71b4b36916ec" (UID: "fe71132b-e60a-46d7-8d7b-71b4b36916ec"). InnerVolumeSpecName "kube-api-access-d6f95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:39:32.806458 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:32.806423    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:32.813678 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:32.813647    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe71132b-e60a-46d7-8d7b-71b4b36916ec-plugins-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:39:32.813678 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:32.813675    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6f95\" (UniqueName: \"kubernetes.io/projected/fe71132b-e60a-46d7-8d7b-71b4b36916ec-kube-api-access-d6f95\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:39:33.050843 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:33.050807    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:33.394897 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:33.394798    2565 generic.go:356] "Generic (PLEG): container finished" podID="fe71132b-e60a-46d7-8d7b-71b4b36916ec" containerID="dad1f4fc9c1adc6f23fe8e598444906f6219390e2ad433f0c196ca93957c5ded" exitCode=0
Sep 16 02:39:33.394897 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:33.394851    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm"
Sep 16 02:39:33.394897 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:33.394887    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm" event={"ID":"fe71132b-e60a-46d7-8d7b-71b4b36916ec","Type":"ContainerDied","Data":"dad1f4fc9c1adc6f23fe8e598444906f6219390e2ad433f0c196ca93957c5ded"}
Sep 16 02:39:33.395494 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:33.394945    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm" event={"ID":"fe71132b-e60a-46d7-8d7b-71b4b36916ec","Type":"ContainerDied","Data":"51e24801e0bf387b55b1f2b88ff35eb2b5873be01bb3dfa23e361a88a47cb569"}
Sep 16 02:39:33.395494 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:33.394969    2565 scope.go:117] "RemoveContainer" containerID="dad1f4fc9c1adc6f23fe8e598444906f6219390e2ad433f0c196ca93957c5ded"
Sep 16 02:39:33.404830 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:33.404815    2565 scope.go:117] "RemoveContainer" containerID="dad1f4fc9c1adc6f23fe8e598444906f6219390e2ad433f0c196ca93957c5ded"
Sep 16 02:39:33.405094 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:39:33.405074    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dad1f4fc9c1adc6f23fe8e598444906f6219390e2ad433f0c196ca93957c5ded\": container with ID starting with dad1f4fc9c1adc6f23fe8e598444906f6219390e2ad433f0c196ca93957c5ded not found: ID does not exist" containerID="dad1f4fc9c1adc6f23fe8e598444906f6219390e2ad433f0c196ca93957c5ded"
Sep 16 02:39:33.405139 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:33.405103    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dad1f4fc9c1adc6f23fe8e598444906f6219390e2ad433f0c196ca93957c5ded"} err="failed to get container status \"dad1f4fc9c1adc6f23fe8e598444906f6219390e2ad433f0c196ca93957c5ded\": rpc error: code = NotFound desc = could not find container \"dad1f4fc9c1adc6f23fe8e598444906f6219390e2ad433f0c196ca93957c5ded\": container with ID starting with dad1f4fc9c1adc6f23fe8e598444906f6219390e2ad433f0c196ca93957c5ded not found: ID does not exist"
Sep 16 02:39:33.415410 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:33.415383    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm"]
Sep 16 02:39:33.418732 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:33.418714    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm"]
Sep 16 02:39:33.824460 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:33.824422    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:34.391723 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:34.391693    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d80da84-b4a6-4d42-bdac-d7b4d2c5e9cb" path="/var/lib/kubelet/pods/4d80da84-b4a6-4d42-bdac-d7b4d2c5e9cb/volumes"
Sep 16 02:39:34.392055 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:34.392043    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe71132b-e60a-46d7-8d7b-71b4b36916ec" path="/var/lib/kubelet/pods/fe71132b-e60a-46d7-8d7b-71b4b36916ec/volumes"
Sep 16 02:39:34.677731 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:34.677698    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:38.744471 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:38.744436    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:38.842866 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:38.842833    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:39.002925 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:39.002847    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"]
Sep 16 02:39:39.003085 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:39.003059    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7" podUID="52603d78-c62a-4226-9147-893c2ab9bdc5" containerName="istio-proxy" containerID="cri-o://c8c024fb4b8c11aa41a37bcd110ebf1240b85acd4b0d6c3dec272915506a233e" gracePeriod=30
Sep 16 02:39:39.023112 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:39.023079    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:39.356776 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:39.356691    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:39.454594 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:39.454560    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:39.597058 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:39.597020    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:44.253780 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.253752    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:39:44.428065 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.428024    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52603d78-c62a-4226-9147-893c2ab9bdc5-istio-podinfo\") pod \"52603d78-c62a-4226-9147-893c2ab9bdc5\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") "
Sep 16 02:39:44.428220 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.428075    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52603d78-c62a-4226-9147-893c2ab9bdc5-istio-data\") pod \"52603d78-c62a-4226-9147-893c2ab9bdc5\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") "
Sep 16 02:39:44.428220 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.428128    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52603d78-c62a-4226-9147-893c2ab9bdc5-istiod-ca-cert\") pod \"52603d78-c62a-4226-9147-893c2ab9bdc5\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") "
Sep 16 02:39:44.428220 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.428181    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52603d78-c62a-4226-9147-893c2ab9bdc5-istio-token\") pod \"52603d78-c62a-4226-9147-893c2ab9bdc5\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") "
Sep 16 02:39:44.428344 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.428251    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rz4ng\" (UniqueName: \"kubernetes.io/projected/52603d78-c62a-4226-9147-893c2ab9bdc5-kube-api-access-rz4ng\") pod \"52603d78-c62a-4226-9147-893c2ab9bdc5\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") "
Sep 16 02:39:44.428344 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.428275    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52603d78-c62a-4226-9147-893c2ab9bdc5-workload-socket\") pod \"52603d78-c62a-4226-9147-893c2ab9bdc5\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") "
Sep 16 02:39:44.428344 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.428321    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52603d78-c62a-4226-9147-893c2ab9bdc5-istio-envoy\") pod \"52603d78-c62a-4226-9147-893c2ab9bdc5\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") "
Sep 16 02:39:44.428537 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.428385    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52603d78-c62a-4226-9147-893c2ab9bdc5-workload-certs\") pod \"52603d78-c62a-4226-9147-893c2ab9bdc5\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") "
Sep 16 02:39:44.428537 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.428446    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52603d78-c62a-4226-9147-893c2ab9bdc5-credential-socket\") pod \"52603d78-c62a-4226-9147-893c2ab9bdc5\" (UID: \"52603d78-c62a-4226-9147-893c2ab9bdc5\") "
Sep 16 02:39:44.428537 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.428441    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52603d78-c62a-4226-9147-893c2ab9bdc5-istio-data" (OuterVolumeSpecName: "istio-data") pod "52603d78-c62a-4226-9147-893c2ab9bdc5" (UID: "52603d78-c62a-4226-9147-893c2ab9bdc5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:39:44.428696 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.428590    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52603d78-c62a-4226-9147-893c2ab9bdc5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "52603d78-c62a-4226-9147-893c2ab9bdc5" (UID: "52603d78-c62a-4226-9147-893c2ab9bdc5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:39:44.428696 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.428605    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52603d78-c62a-4226-9147-893c2ab9bdc5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "52603d78-c62a-4226-9147-893c2ab9bdc5" (UID: "52603d78-c62a-4226-9147-893c2ab9bdc5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:39:44.428696 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.428667    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52603d78-c62a-4226-9147-893c2ab9bdc5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "52603d78-c62a-4226-9147-893c2ab9bdc5" (UID: "52603d78-c62a-4226-9147-893c2ab9bdc5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:39:44.428866 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.428814    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52603d78-c62a-4226-9147-893c2ab9bdc5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "52603d78-c62a-4226-9147-893c2ab9bdc5" (UID: "52603d78-c62a-4226-9147-893c2ab9bdc5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:39:44.428933 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.428892    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52603d78-c62a-4226-9147-893c2ab9bdc5-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:39:44.428933 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.428911    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52603d78-c62a-4226-9147-893c2ab9bdc5-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:39:44.428933 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.428925    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52603d78-c62a-4226-9147-893c2ab9bdc5-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:39:44.429056 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.428939    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52603d78-c62a-4226-9147-893c2ab9bdc5-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:39:44.429056 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.428951    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52603d78-c62a-4226-9147-893c2ab9bdc5-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:39:44.430318 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.430297    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/52603d78-c62a-4226-9147-893c2ab9bdc5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "52603d78-c62a-4226-9147-893c2ab9bdc5" (UID: "52603d78-c62a-4226-9147-893c2ab9bdc5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 02:39:44.430536 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.430516    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52603d78-c62a-4226-9147-893c2ab9bdc5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "52603d78-c62a-4226-9147-893c2ab9bdc5" (UID: "52603d78-c62a-4226-9147-893c2ab9bdc5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:39:44.430838 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.430814    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52603d78-c62a-4226-9147-893c2ab9bdc5-istio-token" (OuterVolumeSpecName: "istio-token") pod "52603d78-c62a-4226-9147-893c2ab9bdc5" (UID: "52603d78-c62a-4226-9147-893c2ab9bdc5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:39:44.430937 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.430836    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52603d78-c62a-4226-9147-893c2ab9bdc5-kube-api-access-rz4ng" (OuterVolumeSpecName: "kube-api-access-rz4ng") pod "52603d78-c62a-4226-9147-893c2ab9bdc5" (UID: "52603d78-c62a-4226-9147-893c2ab9bdc5"). InnerVolumeSpecName "kube-api-access-rz4ng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:39:44.465685 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.465654    2565 generic.go:356] "Generic (PLEG): container finished" podID="52603d78-c62a-4226-9147-893c2ab9bdc5" containerID="c8c024fb4b8c11aa41a37bcd110ebf1240b85acd4b0d6c3dec272915506a233e" exitCode=0
Sep 16 02:39:44.465843 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.465709    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"
Sep 16 02:39:44.465843 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.465713    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7" event={"ID":"52603d78-c62a-4226-9147-893c2ab9bdc5","Type":"ContainerDied","Data":"c8c024fb4b8c11aa41a37bcd110ebf1240b85acd4b0d6c3dec272915506a233e"}
Sep 16 02:39:44.465843 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.465769    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7" event={"ID":"52603d78-c62a-4226-9147-893c2ab9bdc5","Type":"ContainerDied","Data":"409048b33604ca875215537a5e0fd2679f2ee02c3d1134b75b58e924cc03c6de"}
Sep 16 02:39:44.465843 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.465807    2565 scope.go:117] "RemoveContainer" containerID="c8c024fb4b8c11aa41a37bcd110ebf1240b85acd4b0d6c3dec272915506a233e"
Sep 16 02:39:44.475696 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.475677    2565 scope.go:117] "RemoveContainer" containerID="fd7958493b7e0d75212e475473c67206fa6f67134e7281258484add2cde47b25"
Sep 16 02:39:44.484931 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.484550    2565 scope.go:117] "RemoveContainer" containerID="c8c024fb4b8c11aa41a37bcd110ebf1240b85acd4b0d6c3dec272915506a233e"
Sep 16 02:39:44.484931 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:39:44.484914    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8c024fb4b8c11aa41a37bcd110ebf1240b85acd4b0d6c3dec272915506a233e\": container with ID starting with c8c024fb4b8c11aa41a37bcd110ebf1240b85acd4b0d6c3dec272915506a233e not found: ID does not exist" containerID="c8c024fb4b8c11aa41a37bcd110ebf1240b85acd4b0d6c3dec272915506a233e"
Sep 16 02:39:44.484931 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.484940    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8c024fb4b8c11aa41a37bcd110ebf1240b85acd4b0d6c3dec272915506a233e"} err="failed to get container status \"c8c024fb4b8c11aa41a37bcd110ebf1240b85acd4b0d6c3dec272915506a233e\": rpc error: code = NotFound desc = could not find container \"c8c024fb4b8c11aa41a37bcd110ebf1240b85acd4b0d6c3dec272915506a233e\": container with ID starting with c8c024fb4b8c11aa41a37bcd110ebf1240b85acd4b0d6c3dec272915506a233e not found: ID does not exist"
Sep 16 02:39:44.484931 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.484957    2565 scope.go:117] "RemoveContainer" containerID="fd7958493b7e0d75212e475473c67206fa6f67134e7281258484add2cde47b25"
Sep 16 02:39:44.485213 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:39:44.485201    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd7958493b7e0d75212e475473c67206fa6f67134e7281258484add2cde47b25\": container with ID starting with fd7958493b7e0d75212e475473c67206fa6f67134e7281258484add2cde47b25 not found: ID does not exist" containerID="fd7958493b7e0d75212e475473c67206fa6f67134e7281258484add2cde47b25"
Sep 16 02:39:44.485270 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.485219    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd7958493b7e0d75212e475473c67206fa6f67134e7281258484add2cde47b25"} err="failed to get container status \"fd7958493b7e0d75212e475473c67206fa6f67134e7281258484add2cde47b25\": rpc error: code = NotFound desc = could not find container \"fd7958493b7e0d75212e475473c67206fa6f67134e7281258484add2cde47b25\": container with ID starting with fd7958493b7e0d75212e475473c67206fa6f67134e7281258484add2cde47b25 not found: ID does not exist"
Sep 16 02:39:44.487988 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.487958    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"]
Sep 16 02:39:44.491210 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.491189    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7"]
Sep 16 02:39:44.530864 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.530837    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rz4ng\" (UniqueName: \"kubernetes.io/projected/52603d78-c62a-4226-9147-893c2ab9bdc5-kube-api-access-rz4ng\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:39:44.530993 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.530929    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52603d78-c62a-4226-9147-893c2ab9bdc5-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:39:44.530993 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.530941    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52603d78-c62a-4226-9147-893c2ab9bdc5-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:39:44.530993 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:44.530949    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52603d78-c62a-4226-9147-893c2ab9bdc5-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:39:45.192255 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:45.192211    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:45.253991 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:45.253955    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:45.339482 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:45.339444    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:45.560031 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:45.559950    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:46.391189 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:46.391158    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52603d78-c62a-4226-9147-893c2ab9bdc5" path="/var/lib/kubelet/pods/52603d78-c62a-4226-9147-893c2ab9bdc5/volumes"
Sep 16 02:39:51.328384 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:51.328325    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:51.391921 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:51.391890    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:52.233307 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.233269    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:52.514511 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.514423    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"]
Sep 16 02:39:52.515035 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.515017    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52603d78-c62a-4226-9147-893c2ab9bdc5" containerName="istio-proxy"
Sep 16 02:39:52.515095 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.515040    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="52603d78-c62a-4226-9147-893c2ab9bdc5" containerName="istio-proxy"
Sep 16 02:39:52.515095 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.515052    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe71132b-e60a-46d7-8d7b-71b4b36916ec" containerName="payload-pre-processing"
Sep 16 02:39:52.515095 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.515062    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe71132b-e60a-46d7-8d7b-71b4b36916ec" containerName="payload-pre-processing"
Sep 16 02:39:52.515095 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.515073    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52603d78-c62a-4226-9147-893c2ab9bdc5" containerName="istio-proxy"
Sep 16 02:39:52.515095 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.515082    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="52603d78-c62a-4226-9147-893c2ab9bdc5" containerName="istio-proxy"
Sep 16 02:39:52.515346 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.515102    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d80da84-b4a6-4d42-bdac-d7b4d2c5e9cb" containerName="revoke-keys"
Sep 16 02:39:52.515346 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.515110    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d80da84-b4a6-4d42-bdac-d7b4d2c5e9cb" containerName="revoke-keys"
Sep 16 02:39:52.515346 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.515219    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="52603d78-c62a-4226-9147-893c2ab9bdc5" containerName="istio-proxy"
Sep 16 02:39:52.515346 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.515232    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="52603d78-c62a-4226-9147-893c2ab9bdc5" containerName="istio-proxy"
Sep 16 02:39:52.515346 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.515242    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d80da84-b4a6-4d42-bdac-d7b4d2c5e9cb" containerName="revoke-keys"
Sep 16 02:39:52.515346 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.515251    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe71132b-e60a-46d7-8d7b-71b4b36916ec" containerName="payload-pre-processing"
Sep 16 02:39:52.519755 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.519735    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:52.521942 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.521918    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w1-fe9d17-openshift-default-dockercfg-j5kpw\""
Sep 16 02:39:52.528821 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.528797    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"]
Sep 16 02:39:52.538745 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.538714    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:52.602010 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.601973    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6529c04b-957f-4eb3-adb0-8e0c34c5908c-istio-token\") pod \"e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") " pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:52.602295 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.602272    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6cx6\" (UniqueName: \"kubernetes.io/projected/6529c04b-957f-4eb3-adb0-8e0c34c5908c-kube-api-access-g6cx6\") pod \"e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") " pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:52.602451 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.602433    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6529c04b-957f-4eb3-adb0-8e0c34c5908c-istiod-ca-cert\") pod \"e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") " pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:52.602573 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.602548    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6529c04b-957f-4eb3-adb0-8e0c34c5908c-credential-socket\") pod \"e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") " pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:52.602634 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.602591    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6529c04b-957f-4eb3-adb0-8e0c34c5908c-istio-data\") pod \"e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") " pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:52.602691 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.602641    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6529c04b-957f-4eb3-adb0-8e0c34c5908c-workload-socket\") pod \"e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") " pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:52.602783 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.602759    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6529c04b-957f-4eb3-adb0-8e0c34c5908c-workload-certs\") pod \"e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") " pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:52.602846 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.602819    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6529c04b-957f-4eb3-adb0-8e0c34c5908c-istio-podinfo\") pod \"e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") " pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:52.602897 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.602862    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6529c04b-957f-4eb3-adb0-8e0c34c5908c-istio-envoy\") pod \"e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") " pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:52.703853 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.703821    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6529c04b-957f-4eb3-adb0-8e0c34c5908c-workload-certs\") pod \"e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") " pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:52.704041 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.703862    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6529c04b-957f-4eb3-adb0-8e0c34c5908c-istio-podinfo\") pod \"e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") " pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:52.704041 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.703878    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6529c04b-957f-4eb3-adb0-8e0c34c5908c-istio-envoy\") pod \"e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") " pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:52.704041 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.704001    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6529c04b-957f-4eb3-adb0-8e0c34c5908c-istio-token\") pod \"e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") " pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:52.704234 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.704090    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6cx6\" (UniqueName: \"kubernetes.io/projected/6529c04b-957f-4eb3-adb0-8e0c34c5908c-kube-api-access-g6cx6\") pod \"e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") " pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:52.704234 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.704130    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6529c04b-957f-4eb3-adb0-8e0c34c5908c-istiod-ca-cert\") pod \"e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") " pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:52.704234 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.704214    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6529c04b-957f-4eb3-adb0-8e0c34c5908c-credential-socket\") pod \"e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") " pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:52.704234 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.704222    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6529c04b-957f-4eb3-adb0-8e0c34c5908c-workload-certs\") pod \"e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") " pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:52.704478 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.704243    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6529c04b-957f-4eb3-adb0-8e0c34c5908c-istio-data\") pod \"e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") " pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:52.704478 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.704296    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6529c04b-957f-4eb3-adb0-8e0c34c5908c-workload-socket\") pod \"e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") " pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:52.704589 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.704497    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6529c04b-957f-4eb3-adb0-8e0c34c5908c-credential-socket\") pod \"e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") " pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:52.704646 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.704629    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6529c04b-957f-4eb3-adb0-8e0c34c5908c-istio-data\") pod \"e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") " pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:52.704704 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.704644    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6529c04b-957f-4eb3-adb0-8e0c34c5908c-workload-socket\") pod \"e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") " pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:52.704960 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.704932    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6529c04b-957f-4eb3-adb0-8e0c34c5908c-istiod-ca-cert\") pod \"e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") " pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:52.706257 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.706234    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6529c04b-957f-4eb3-adb0-8e0c34c5908c-istio-envoy\") pod \"e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") " pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:52.706437 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.706420    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6529c04b-957f-4eb3-adb0-8e0c34c5908c-istio-podinfo\") pod \"e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") " pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:52.711276 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.711256    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6cx6\" (UniqueName: \"kubernetes.io/projected/6529c04b-957f-4eb3-adb0-8e0c34c5908c-kube-api-access-g6cx6\") pod \"e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") " pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:52.711691 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.711674    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6529c04b-957f-4eb3-adb0-8e0c34c5908c-istio-token\") pod \"e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") " pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:52.808001 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.807910    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:52.831868 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:52.831839    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:53.121891 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:53.121865    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"]
Sep 16 02:39:53.123563 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:39:53.123534    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6529c04b_957f_4eb3_adb0_8e0c34c5908c.slice/crio-035eae592cd6b8ff45119346e128fab18a7d6aa97bef6ef02e5c495f1949bc80 WatchSource:0}: Error finding container 035eae592cd6b8ff45119346e128fab18a7d6aa97bef6ef02e5c495f1949bc80: Status 404 returned error can't find the container with id 035eae592cd6b8ff45119346e128fab18a7d6aa97bef6ef02e5c495f1949bc80
Sep 16 02:39:53.125748 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:53.125714    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:39:53.125831 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:53.125780    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:39:53.125831 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:53.125821    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:39:53.526256 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:53.526220    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4" event={"ID":"6529c04b-957f-4eb3-adb0-8e0c34c5908c","Type":"ContainerStarted","Data":"c7bfe83f8793bb6df28487ad54c056177e1674122ab10232e8cd123a7e30f36e"}
Sep 16 02:39:53.526761 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:53.526280    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4" event={"ID":"6529c04b-957f-4eb3-adb0-8e0c34c5908c","Type":"ContainerStarted","Data":"035eae592cd6b8ff45119346e128fab18a7d6aa97bef6ef02e5c495f1949bc80"}
Sep 16 02:39:53.545693 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:53.545641    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4" podStartSLOduration=1.545624554 podStartE2EDuration="1.545624554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:39:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:39:53.544030354 +0000 UTC m=+1271.594374871" watchObservedRunningTime="2026-09-16 02:39:53.545624554 +0000 UTC m=+1271.595969046"
Sep 16 02:39:53.832730 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:53.832646    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:53.952740 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:53.952712    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:54.765276 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:54.765241    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:54.837927 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:54.837896    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:55.249400 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:55.249353    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:55.440471 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:55.440438    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:55.539312 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:55.539208    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:55.540475 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:55.540453    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:39:55.543015 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:55.542986    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:55.642682 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:55.642649    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:56.467970 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:56.467930    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:57.156377 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:57.156320    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:57.921974 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:57.921942    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:58.022962 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:58.022900    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:58.121868 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:58.121834    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:58.385741 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:58.385656    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:58.442616 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:58.442578    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q"]
Sep 16 02:39:58.446220 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:58.446198    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q"
Sep 16 02:39:58.450812 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:58.450791    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w1-fe9d17-dockercfg-xqstt\""
Sep 16 02:39:58.450927 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:58.450836    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w1-fe9d17\""
Sep 16 02:39:58.459161 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:58.459138    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q"]
Sep 16 02:39:58.460417 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:58.460390    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:39:58.561859 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:58.561821    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcwwj\" (UniqueName: \"kubernetes.io/projected/fd863ae8-6b3d-4c78-95e4-2251d4aacc26-kube-api-access-dcwwj\") pod \"payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q\" (UID: \"fd863ae8-6b3d-4c78-95e4-2251d4aacc26\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q"
Sep 16 02:39:58.562350 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:58.562324    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd863ae8-6b3d-4c78-95e4-2251d4aacc26-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q\" (UID: \"fd863ae8-6b3d-4c78-95e4-2251d4aacc26\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q"
Sep 16 02:39:58.663845 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:58.663812    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcwwj\" (UniqueName: \"kubernetes.io/projected/fd863ae8-6b3d-4c78-95e4-2251d4aacc26-kube-api-access-dcwwj\") pod \"payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q\" (UID: \"fd863ae8-6b3d-4c78-95e4-2251d4aacc26\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q"
Sep 16 02:39:58.664040 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:58.663950    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd863ae8-6b3d-4c78-95e4-2251d4aacc26-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q\" (UID: \"fd863ae8-6b3d-4c78-95e4-2251d4aacc26\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q"
Sep 16 02:39:58.664665 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:58.664645    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd863ae8-6b3d-4c78-95e4-2251d4aacc26-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q\" (UID: \"fd863ae8-6b3d-4c78-95e4-2251d4aacc26\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q"
Sep 16 02:39:58.671508 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:58.671478    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcwwj\" (UniqueName: \"kubernetes.io/projected/fd863ae8-6b3d-4c78-95e4-2251d4aacc26-kube-api-access-dcwwj\") pod \"payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q\" (UID: \"fd863ae8-6b3d-4c78-95e4-2251d4aacc26\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q"
Sep 16 02:39:58.756889 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:58.756850    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q"
Sep 16 02:39:59.028651 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:59.028137    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q"]
Sep 16 02:39:59.569091 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:59.569051    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q" event={"ID":"fd863ae8-6b3d-4c78-95e4-2251d4aacc26","Type":"ContainerStarted","Data":"f744360faf5519ab85b36159adde6ea15edafe7b96d65a27ee46e3d79c4a6a6d"}
Sep 16 02:39:59.569276 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:59.569215    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q"
Sep 16 02:39:59.569276 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:59.569262    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q" event={"ID":"fd863ae8-6b3d-4c78-95e4-2251d4aacc26","Type":"ContainerStarted","Data":"c7f5837ceb7d9529c720d9b98321ea9a70c57982dc84f245244a10a82ce68455"}
Sep 16 02:39:59.585417 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:39:59.585340    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q" podStartSLOduration=1.585325914 podStartE2EDuration="1.585325914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:39:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:39:59.5834778 +0000 UTC m=+1277.633822295" watchObservedRunningTime="2026-09-16 02:39:59.585325914 +0000 UTC m=+1277.635670407"
Sep 16 02:40:10.577225 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:10.577197    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q"
Sep 16 02:40:11.580557 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:11.580523    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 02:40:11.582182 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:11.580616    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4" podUID="6529c04b-957f-4eb3-adb0-8e0c34c5908c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 02:40:12.644954 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:12.644922    2565 generic.go:356] "Generic (PLEG): container finished" podID="6529c04b-957f-4eb3-adb0-8e0c34c5908c" containerID="c7bfe83f8793bb6df28487ad54c056177e1674122ab10232e8cd123a7e30f36e" exitCode=0
Sep 16 02:40:12.645346 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:12.644993    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4" event={"ID":"6529c04b-957f-4eb3-adb0-8e0c34c5908c","Type":"ContainerDied","Data":"c7bfe83f8793bb6df28487ad54c056177e1674122ab10232e8cd123a7e30f36e"}
Sep 16 02:40:12.645433 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:12.645403    2565 scope.go:117] "RemoveContainer" containerID="c7bfe83f8793bb6df28487ad54c056177e1674122ab10232e8cd123a7e30f36e"
Sep 16 02:40:12.646455 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:12.646421    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:40:12.646528 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:12.646488    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:40:12.646528 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:12.646518    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:40:13.658253 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:13.658204    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4" event={"ID":"6529c04b-957f-4eb3-adb0-8e0c34c5908c","Type":"ContainerStarted","Data":"375190791ba7c498a76f2c521c33bc638f7fa24a8f4cc25d97f5cf8eb676c860"}
Sep 16 02:40:13.832232 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:13.832196    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:40:13.832430 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:13.832374    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 16 02:40:13.832430 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:13.832417    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4" podUID="6529c04b-957f-4eb3-adb0-8e0c34c5908c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 16 02:40:14.832863 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:14.832824    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 16 02:40:14.833251 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:14.832887    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4" podUID="6529c04b-957f-4eb3-adb0-8e0c34c5908c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 16 02:40:15.832135 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:15.832102    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 16 02:40:15.832351 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:15.832155    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4" podUID="6529c04b-957f-4eb3-adb0-8e0c34c5908c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 16 02:40:16.833215 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:16.833175    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 16 02:40:16.833708 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:16.833242    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4" podUID="6529c04b-957f-4eb3-adb0-8e0c34c5908c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 16 02:40:17.833026 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:17.832989    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 16 02:40:17.833208 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:17.833049    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4" podUID="6529c04b-957f-4eb3-adb0-8e0c34c5908c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 16 02:40:18.836316 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:18.836276    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:40:18.836720 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:18.836651    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:40:18.837423 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:18.837406    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:40:20.478061 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:20.478025    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:40:20.580179 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:20.580060    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:40:20.831110 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:20.831021    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:40:21.139635 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:21.139539    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:40:21.238607 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:21.238574    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:40:21.339068 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:21.339036    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:40:22.072320 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:22.072288    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:40:23.629557 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:23.629520    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:40:24.218876 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:24.218830    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:40:24.357949 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:24.357911    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:40:24.458679 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:24.458638    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:40:25.065510 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:25.065473    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:40:25.933039 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:25.933001    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:40:26.035277 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:26.035240    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:40:26.379679 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:26.379599    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:40:26.384867 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:26.384837    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8" secret="" err="secret \"payload-processing-dockercfg-7v8jt\" not found"
Sep 16 02:40:26.476136 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:26.476103    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:40:26.480523 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:26.480497    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk"]
Sep 16 02:40:26.483056 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:26.483039    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk"
Sep 16 02:40:26.485355 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:26.485335    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w1-e86d9e-dockercfg-8nl2d\""
Sep 16 02:40:26.485470 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:26.485389    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w1-e86d9e\""
Sep 16 02:40:26.494002 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:26.493983    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk"]
Sep 16 02:40:26.522511 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:26.522473    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l"]
Sep 16 02:40:26.524945 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:26.524929    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l"
Sep 16 02:40:26.554402 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:26.554350    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swvwq\" (UniqueName: \"kubernetes.io/projected/04d068c3-9d02-4804-bfca-71c90360edf3-kube-api-access-swvwq\") pod \"payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l\" (UID: \"04d068c3-9d02-4804-bfca-71c90360edf3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l"
Sep 16 02:40:26.554508 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:26.554419    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b9ba53a-a0c5-4710-b342-aeb6047b0da6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk\" (UID: \"3b9ba53a-a0c5-4710-b342-aeb6047b0da6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk"
Sep 16 02:40:26.554508 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:26.554451    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxctx\" (UniqueName: \"kubernetes.io/projected/3b9ba53a-a0c5-4710-b342-aeb6047b0da6-kube-api-access-dxctx\") pod \"payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk\" (UID: \"3b9ba53a-a0c5-4710-b342-aeb6047b0da6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk"
Sep 16 02:40:26.554508 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:26.554473    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04d068c3-9d02-4804-bfca-71c90360edf3-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l\" (UID: \"04d068c3-9d02-4804-bfca-71c90360edf3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l"
Sep 16 02:40:26.571417 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:26.571380    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l"]
Sep 16 02:40:26.655500 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:26.655472    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04d068c3-9d02-4804-bfca-71c90360edf3-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l\" (UID: \"04d068c3-9d02-4804-bfca-71c90360edf3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l"
Sep 16 02:40:26.655674 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:26.655577    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swvwq\" (UniqueName: \"kubernetes.io/projected/04d068c3-9d02-4804-bfca-71c90360edf3-kube-api-access-swvwq\") pod \"payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l\" (UID: \"04d068c3-9d02-4804-bfca-71c90360edf3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l"
Sep 16 02:40:26.655674 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:26.655606    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b9ba53a-a0c5-4710-b342-aeb6047b0da6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk\" (UID: \"3b9ba53a-a0c5-4710-b342-aeb6047b0da6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk"
Sep 16 02:40:26.655674 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:26.655631    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxctx\" (UniqueName: \"kubernetes.io/projected/3b9ba53a-a0c5-4710-b342-aeb6047b0da6-kube-api-access-dxctx\") pod \"payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk\" (UID: \"3b9ba53a-a0c5-4710-b342-aeb6047b0da6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk"
Sep 16 02:40:26.656255 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:26.656234    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04d068c3-9d02-4804-bfca-71c90360edf3-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l\" (UID: \"04d068c3-9d02-4804-bfca-71c90360edf3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l"
Sep 16 02:40:26.656343 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:26.656326    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b9ba53a-a0c5-4710-b342-aeb6047b0da6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk\" (UID: \"3b9ba53a-a0c5-4710-b342-aeb6047b0da6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk"
Sep 16 02:40:26.663115 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:26.663087    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swvwq\" (UniqueName: \"kubernetes.io/projected/04d068c3-9d02-4804-bfca-71c90360edf3-kube-api-access-swvwq\") pod \"payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l\" (UID: \"04d068c3-9d02-4804-bfca-71c90360edf3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l"
Sep 16 02:40:26.663229 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:26.663142    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxctx\" (UniqueName: \"kubernetes.io/projected/3b9ba53a-a0c5-4710-b342-aeb6047b0da6-kube-api-access-dxctx\") pod \"payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk\" (UID: \"3b9ba53a-a0c5-4710-b342-aeb6047b0da6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk"
Sep 16 02:40:26.794015 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:26.793979    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk"
Sep 16 02:40:26.834777 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:26.834739    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l"
Sep 16 02:40:27.063870 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:27.063841    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk"]
Sep 16 02:40:27.064818 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:40:27.064785    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b9ba53a_a0c5_4710_b342_aeb6047b0da6.slice/crio-cfcd2f80fbffe294f5b6669bc43cb57b0df75848caa20cedf3e2d8dfcf86d281 WatchSource:0}: Error finding container cfcd2f80fbffe294f5b6669bc43cb57b0df75848caa20cedf3e2d8dfcf86d281: Status 404 returned error can't find the container with id cfcd2f80fbffe294f5b6669bc43cb57b0df75848caa20cedf3e2d8dfcf86d281
Sep 16 02:40:27.115497 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:27.115471    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l"]
Sep 16 02:40:27.116035 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:40:27.116014    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04d068c3_9d02_4804_bfca_71c90360edf3.slice/crio-5a4631cf71030c4814ae198c16757fadaea2c24f77a8503418bb610eb56f6d2d WatchSource:0}: Error finding container 5a4631cf71030c4814ae198c16757fadaea2c24f77a8503418bb610eb56f6d2d: Status 404 returned error can't find the container with id 5a4631cf71030c4814ae198c16757fadaea2c24f77a8503418bb610eb56f6d2d
Sep 16 02:40:27.750155 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:27.750114    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l" event={"ID":"04d068c3-9d02-4804-bfca-71c90360edf3","Type":"ContainerStarted","Data":"015c988ed89bdff12d8fdda7a5e9d20f3a08cdfbe3b32be98eb3edbb5d72b572"}
Sep 16 02:40:27.750666 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:27.750286    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l"
Sep 16 02:40:27.750666 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:27.750315    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l" event={"ID":"04d068c3-9d02-4804-bfca-71c90360edf3","Type":"ContainerStarted","Data":"5a4631cf71030c4814ae198c16757fadaea2c24f77a8503418bb610eb56f6d2d"}
Sep 16 02:40:27.751820 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:27.751789    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk" event={"ID":"3b9ba53a-a0c5-4710-b342-aeb6047b0da6","Type":"ContainerStarted","Data":"95d918a4eda9262f1e3637408c3d1bf6cad409e307b9aeb2684f49533daf2278"}
Sep 16 02:40:27.751940 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:27.751842    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk" event={"ID":"3b9ba53a-a0c5-4710-b342-aeb6047b0da6","Type":"ContainerStarted","Data":"cfcd2f80fbffe294f5b6669bc43cb57b0df75848caa20cedf3e2d8dfcf86d281"}
Sep 16 02:40:27.751940 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:27.751902    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk"
Sep 16 02:40:27.766996 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:27.766952    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l" podStartSLOduration=1.766937169 podStartE2EDuration="1.766937169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:40:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:40:27.763935048 +0000 UTC m=+1305.814279563" watchObservedRunningTime="2026-09-16 02:40:27.766937169 +0000 UTC m=+1305.817281662"
Sep 16 02:40:27.779880 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:27.779839    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk" podStartSLOduration=1.779824554 podStartE2EDuration="1.779824554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:40:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:40:27.77675543 +0000 UTC m=+1305.827099970" watchObservedRunningTime="2026-09-16 02:40:27.779824554 +0000 UTC m=+1305.830169048"
Sep 16 02:40:31.767112 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:31.767073    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:40:38.760404 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:38.760350    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l"
Sep 16 02:40:38.760903 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:38.760567    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk"
Sep 16 02:40:47.998387 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:47.998325    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:40:48.610030 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:48.609985    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:40:49.216383 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:49.216327    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:40:49.335935 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:49.335899    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:40:49.925004 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:49.924971    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:40:58.211943 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:58.211904    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:40:58.518600 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:58.518514    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:40:58.909066 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:40:58.909032    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:41:00.939064 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:00.939030    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:41:01.461076 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:01.461027    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:41:01.560460 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:01.560425    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:41:01.788106 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:01.788023    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:41:02.415286 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:02.415251    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:41:03.214462 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:03.214429    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:41:03.933928 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:03.933891    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:41:04.035178 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:04.035148    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:41:04.135919 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:04.135884    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:41:04.358581 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:04.358502    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:41:04.459250 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:04.459214    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:41:04.460755 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:04.460734    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm"]
Sep 16 02:41:04.466167 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:04.466138    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm"
Sep 16 02:41:04.468628 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:04.468604    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-73bfc1e9-dockercfg-jzw6q\""
Sep 16 02:41:04.469341 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:04.469040    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-73bfc1e9\""
Sep 16 02:41:04.474194 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:04.474170    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm"]
Sep 16 02:41:04.629867 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:04.629771    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f2c6803-96f7-44eb-a0ab-74cb97c46fd5-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm\" (UID: \"8f2c6803-96f7-44eb-a0ab-74cb97c46fd5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm"
Sep 16 02:41:04.629867 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:04.629817    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m45z\" (UniqueName: \"kubernetes.io/projected/8f2c6803-96f7-44eb-a0ab-74cb97c46fd5-kube-api-access-5m45z\") pod \"payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm\" (UID: \"8f2c6803-96f7-44eb-a0ab-74cb97c46fd5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm"
Sep 16 02:41:04.731016 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:04.730979    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f2c6803-96f7-44eb-a0ab-74cb97c46fd5-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm\" (UID: \"8f2c6803-96f7-44eb-a0ab-74cb97c46fd5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm"
Sep 16 02:41:04.731183 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:04.731023    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m45z\" (UniqueName: \"kubernetes.io/projected/8f2c6803-96f7-44eb-a0ab-74cb97c46fd5-kube-api-access-5m45z\") pod \"payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm\" (UID: \"8f2c6803-96f7-44eb-a0ab-74cb97c46fd5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm"
Sep 16 02:41:04.731722 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:04.731702    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f2c6803-96f7-44eb-a0ab-74cb97c46fd5-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm\" (UID: \"8f2c6803-96f7-44eb-a0ab-74cb97c46fd5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm"
Sep 16 02:41:04.738701 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:04.738673    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m45z\" (UniqueName: \"kubernetes.io/projected/8f2c6803-96f7-44eb-a0ab-74cb97c46fd5-kube-api-access-5m45z\") pod \"payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm\" (UID: \"8f2c6803-96f7-44eb-a0ab-74cb97c46fd5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm"
Sep 16 02:41:04.779225 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:04.779196    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm"
Sep 16 02:41:05.052944 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:05.052916    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm"]
Sep 16 02:41:05.053733 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:41:05.053702    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f2c6803_96f7_44eb_a0ab_74cb97c46fd5.slice/crio-625b6739a52cc09837c9d70276c5230eaa2d67edcf8ec97069eba421a9d049a2 WatchSource:0}: Error finding container 625b6739a52cc09837c9d70276c5230eaa2d67edcf8ec97069eba421a9d049a2: Status 404 returned error can't find the container with id 625b6739a52cc09837c9d70276c5230eaa2d67edcf8ec97069eba421a9d049a2
Sep 16 02:41:05.988596 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:05.988551    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm" event={"ID":"8f2c6803-96f7-44eb-a0ab-74cb97c46fd5","Type":"ContainerStarted","Data":"755abde4e604235597c5a963c1c2907582bf09481d096de08e13b519e1931d15"}
Sep 16 02:41:05.988781 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:05.988621    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm" event={"ID":"8f2c6803-96f7-44eb-a0ab-74cb97c46fd5","Type":"ContainerStarted","Data":"625b6739a52cc09837c9d70276c5230eaa2d67edcf8ec97069eba421a9d049a2"}
Sep 16 02:41:05.988781 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:05.988753    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm"
Sep 16 02:41:06.003184 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:06.003136    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm" podStartSLOduration=2.003118305 podStartE2EDuration="2.003118305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:41:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:41:06.0025443 +0000 UTC m=+1344.052888806" watchObservedRunningTime="2026-09-16 02:41:06.003118305 +0000 UTC m=+1344.053462800"
Sep 16 02:41:09.114708 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:09.114645    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:41:16.997455 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:16.997422    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm"
Sep 16 02:41:17.172533 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:17.172498    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:41:24.830952 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:24.830911    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:41:26.051254 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:26.051218    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:41:26.396229 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:26.396139    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:41:26.814335 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:26.814300    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:41:27.433044 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:27.433006    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:41:28.031284 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:28.031251    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:41:28.726664 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:28.726627    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:41:30.484022 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:30.483982    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:41:30.541121 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:30.541086    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:41:42.239235 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:42.239202    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:41:42.555985 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:42.555901    2565 scope.go:117] "RemoveContainer" containerID="ed2b4bdf803c4e8ce3000bde151d81cca7fec03643fcf7d84bae139c5ade6795"
Sep 16 02:41:42.565024 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:42.565006    2565 scope.go:117] "RemoveContainer" containerID="aa8143a603c1d71e0be052f235683ef6899534c903c0cc925c91e7532a759384"
Sep 16 02:41:42.573232 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:42.573211    2565 scope.go:117] "RemoveContainer" containerID="e090cef9e1fde79eb52606e472ca70d6121f3daa563ba8fcf8d74ff6296dbe29"
Sep 16 02:41:55.384849 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:55.384812    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8" secret="" err="secret \"payload-processing-dockercfg-7v8jt\" not found"
Sep 16 02:41:58.029727 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:58.029680    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:41:58.864039 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:41:58.863999    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:42:01.449552 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:01.449518    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:42:02.750072 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:02.750028    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:42:07.874531 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:07.874493    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:42:11.037818 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:11.037781    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73bfc1e9-h5c7q"]
Sep 16 02:42:11.042778 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:11.042759    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73bfc1e9-h5c7q"
Sep 16 02:42:11.045189 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:11.045162    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w8hnp\""
Sep 16 02:42:11.045399 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:11.045202    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 02:42:11.047765 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:11.047740    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73bfc1e9-h5c7q"]
Sep 16 02:42:11.189502 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:11.189468    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfda0f44-96d9-4ae8-8e48-2deb1a132498-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-73bfc1e9-h5c7q\" (UID: \"dfda0f44-96d9-4ae8-8e48-2deb1a132498\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73bfc1e9-h5c7q"
Sep 16 02:42:11.291042 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:11.290960    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfda0f44-96d9-4ae8-8e48-2deb1a132498-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-73bfc1e9-h5c7q\" (UID: \"dfda0f44-96d9-4ae8-8e48-2deb1a132498\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73bfc1e9-h5c7q"
Sep 16 02:42:11.291590 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:11.291567    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfda0f44-96d9-4ae8-8e48-2deb1a132498-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-73bfc1e9-h5c7q\" (UID: \"dfda0f44-96d9-4ae8-8e48-2deb1a132498\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73bfc1e9-h5c7q"
Sep 16 02:42:11.357458 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:11.357429    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73bfc1e9-h5c7q"
Sep 16 02:42:11.630106 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:11.630075    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73bfc1e9-h5c7q"]
Sep 16 02:42:11.631299 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:42:11.631268    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfda0f44_96d9_4ae8_8e48_2deb1a132498.slice/crio-4449f269c5a0d15c623217fa4259940dbfb58944742220f8c9234b139533025b WatchSource:0}: Error finding container 4449f269c5a0d15c623217fa4259940dbfb58944742220f8c9234b139533025b: Status 404 returned error can't find the container with id 4449f269c5a0d15c623217fa4259940dbfb58944742220f8c9234b139533025b
Sep 16 02:42:12.044432 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:12.044383    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:42:12.289691 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:12.289580    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:42:12.386313 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:12.386280    2565 generic.go:356] "Generic (PLEG): container finished" podID="dfda0f44-96d9-4ae8-8e48-2deb1a132498" containerID="2743bb876049f68313664dba31a1fa6ff47578efc399cb29026cdda2a6c1fda9" exitCode=0
Sep 16 02:42:12.391426 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:12.391402    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73bfc1e9-h5c7q" event={"ID":"dfda0f44-96d9-4ae8-8e48-2deb1a132498","Type":"ContainerDied","Data":"2743bb876049f68313664dba31a1fa6ff47578efc399cb29026cdda2a6c1fda9"}
Sep 16 02:42:12.391545 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:12.391446    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73bfc1e9-h5c7q" event={"ID":"dfda0f44-96d9-4ae8-8e48-2deb1a132498","Type":"ContainerStarted","Data":"4449f269c5a0d15c623217fa4259940dbfb58944742220f8c9234b139533025b"}
Sep 16 02:42:12.660817 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:12.660784    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:42:13.311912 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:13.311868    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:42:13.536646 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:13.536620    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73bfc1e9-h5c7q"
Sep 16 02:42:13.613555 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:13.613473    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfda0f44-96d9-4ae8-8e48-2deb1a132498-maas-api-service-ca\") pod \"dfda0f44-96d9-4ae8-8e48-2deb1a132498\" (UID: \"dfda0f44-96d9-4ae8-8e48-2deb1a132498\") "
Sep 16 02:42:13.613873 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:13.613852    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfda0f44-96d9-4ae8-8e48-2deb1a132498-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dfda0f44-96d9-4ae8-8e48-2deb1a132498" (UID: "dfda0f44-96d9-4ae8-8e48-2deb1a132498"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:42:13.714780 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:13.714743    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfda0f44-96d9-4ae8-8e48-2deb1a132498-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:42:13.995205 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:13.995171    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:42:14.402923 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:14.402898    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73bfc1e9-h5c7q"
Sep 16 02:42:14.403240 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:14.402936    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73bfc1e9-h5c7q" event={"ID":"dfda0f44-96d9-4ae8-8e48-2deb1a132498","Type":"ContainerDied","Data":"4449f269c5a0d15c623217fa4259940dbfb58944742220f8c9234b139533025b"}
Sep 16 02:42:14.403240 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:14.402982    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4449f269c5a0d15c623217fa4259940dbfb58944742220f8c9234b139533025b"
Sep 16 02:42:14.697988 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:14.697950    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:42:26.499543 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:26.499490    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:42:26.522526 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:26.522496    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm"]
Sep 16 02:42:26.522952 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:26.522915    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm" podUID="8f2c6803-96f7-44eb-a0ab-74cb97c46fd5" containerName="payload-pre-processing" containerID="cri-o://755abde4e604235597c5a963c1c2907582bf09481d096de08e13b519e1931d15" gracePeriod=30
Sep 16 02:42:26.595892 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:26.595852    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:42:26.673112 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:26.673073    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:42:26.673448 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:26.673426    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73bfc1e9-h5c7q"]
Sep 16 02:42:26.676094 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:26.676071    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73bfc1e9-h5c7q"]
Sep 16 02:42:26.735027 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:26.734994    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:42:26.812578 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:26.812551    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm"
Sep 16 02:42:26.840947 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:26.840915    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f2c6803-96f7-44eb-a0ab-74cb97c46fd5-plugins-config-volume\") pod \"8f2c6803-96f7-44eb-a0ab-74cb97c46fd5\" (UID: \"8f2c6803-96f7-44eb-a0ab-74cb97c46fd5\") "
Sep 16 02:42:26.841076 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:26.841022    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5m45z\" (UniqueName: \"kubernetes.io/projected/8f2c6803-96f7-44eb-a0ab-74cb97c46fd5-kube-api-access-5m45z\") pod \"8f2c6803-96f7-44eb-a0ab-74cb97c46fd5\" (UID: \"8f2c6803-96f7-44eb-a0ab-74cb97c46fd5\") "
Sep 16 02:42:26.841301 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:26.841277    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f2c6803-96f7-44eb-a0ab-74cb97c46fd5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8f2c6803-96f7-44eb-a0ab-74cb97c46fd5" (UID: "8f2c6803-96f7-44eb-a0ab-74cb97c46fd5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:42:26.841433 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:26.841419    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f2c6803-96f7-44eb-a0ab-74cb97c46fd5-plugins-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:42:26.843058 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:26.843030    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f2c6803-96f7-44eb-a0ab-74cb97c46fd5-kube-api-access-5m45z" (OuterVolumeSpecName: "kube-api-access-5m45z") pod "8f2c6803-96f7-44eb-a0ab-74cb97c46fd5" (UID: "8f2c6803-96f7-44eb-a0ab-74cb97c46fd5"). InnerVolumeSpecName "kube-api-access-5m45z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:42:26.941933 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:26.941900    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5m45z\" (UniqueName: \"kubernetes.io/projected/8f2c6803-96f7-44eb-a0ab-74cb97c46fd5-kube-api-access-5m45z\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:42:27.243681 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:27.243637    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:42:27.490536 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:27.490494    2565 generic.go:356] "Generic (PLEG): container finished" podID="8f2c6803-96f7-44eb-a0ab-74cb97c46fd5" containerID="755abde4e604235597c5a963c1c2907582bf09481d096de08e13b519e1931d15" exitCode=0
Sep 16 02:42:27.490705 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:27.490546    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm"
Sep 16 02:42:27.490705 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:27.490586    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm" event={"ID":"8f2c6803-96f7-44eb-a0ab-74cb97c46fd5","Type":"ContainerDied","Data":"755abde4e604235597c5a963c1c2907582bf09481d096de08e13b519e1931d15"}
Sep 16 02:42:27.490705 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:27.490645    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm" event={"ID":"8f2c6803-96f7-44eb-a0ab-74cb97c46fd5","Type":"ContainerDied","Data":"625b6739a52cc09837c9d70276c5230eaa2d67edcf8ec97069eba421a9d049a2"}
Sep 16 02:42:27.490705 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:27.490669    2565 scope.go:117] "RemoveContainer" containerID="755abde4e604235597c5a963c1c2907582bf09481d096de08e13b519e1931d15"
Sep 16 02:42:27.500220 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:27.500202    2565 scope.go:117] "RemoveContainer" containerID="755abde4e604235597c5a963c1c2907582bf09481d096de08e13b519e1931d15"
Sep 16 02:42:27.500515 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:42:27.500485    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"755abde4e604235597c5a963c1c2907582bf09481d096de08e13b519e1931d15\": container with ID starting with 755abde4e604235597c5a963c1c2907582bf09481d096de08e13b519e1931d15 not found: ID does not exist" containerID="755abde4e604235597c5a963c1c2907582bf09481d096de08e13b519e1931d15"
Sep 16 02:42:27.500556 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:27.500513    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"755abde4e604235597c5a963c1c2907582bf09481d096de08e13b519e1931d15"} err="failed to get container status \"755abde4e604235597c5a963c1c2907582bf09481d096de08e13b519e1931d15\": rpc error: code = NotFound desc = could not find container \"755abde4e604235597c5a963c1c2907582bf09481d096de08e13b519e1931d15\": container with ID starting with 755abde4e604235597c5a963c1c2907582bf09481d096de08e13b519e1931d15 not found: ID does not exist"
Sep 16 02:42:27.513101 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:27.513077    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm"]
Sep 16 02:42:27.519868 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:27.519845    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm"]
Sep 16 02:42:28.038261 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:28.038224    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:42:28.392031 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:28.391951    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f2c6803-96f7-44eb-a0ab-74cb97c46fd5" path="/var/lib/kubelet/pods/8f2c6803-96f7-44eb-a0ab-74cb97c46fd5/volumes"
Sep 16 02:42:28.392287 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:28.392273    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfda0f44-96d9-4ae8-8e48-2deb1a132498" path="/var/lib/kubelet/pods/dfda0f44-96d9-4ae8-8e48-2deb1a132498/volumes"
Sep 16 02:42:28.634311 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:28.634253    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:42:29.314290 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:29.314257    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:42:29.825961 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:29.825916    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:42:32.081406 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:32.081337    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:42:34.908784 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:34.908745    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:42:42.603562 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:42.603529    2565 scope.go:117] "RemoveContainer" containerID="a590c6e38e9896bdc1c06ef724ce0e9c983682839a67882873f05bf8bc3a7c04"
Sep 16 02:42:56.385648 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:42:56.385610    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8" secret="" err="secret \"payload-processing-dockercfg-7v8jt\" not found"
Sep 16 02:43:11.288997 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:11.288963    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:11.977585 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:11.977552    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:18.392702 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:18.392670    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:22.982861 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:22.982829    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:24.295866 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:24.295835    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:24.726052 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:24.726010    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:25.022517 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.022443    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"]
Sep 16 02:43:25.022858 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.022845    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfda0f44-96d9-4ae8-8e48-2deb1a132498" containerName="revoke-keys"
Sep 16 02:43:25.022913 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.022858    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfda0f44-96d9-4ae8-8e48-2deb1a132498" containerName="revoke-keys"
Sep 16 02:43:25.022913 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.022887    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f2c6803-96f7-44eb-a0ab-74cb97c46fd5" containerName="payload-pre-processing"
Sep 16 02:43:25.022913 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.022893    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f2c6803-96f7-44eb-a0ab-74cb97c46fd5" containerName="payload-pre-processing"
Sep 16 02:43:25.023017 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.022948    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfda0f44-96d9-4ae8-8e48-2deb1a132498" containerName="revoke-keys"
Sep 16 02:43:25.023017 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.022959    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f2c6803-96f7-44eb-a0ab-74cb97c46fd5" containerName="payload-pre-processing"
Sep 16 02:43:25.026328 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.026307    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:25.028908 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.028892    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-10a6b9-openshift-default-dockercfg-6bbl9\""
Sep 16 02:43:25.037577 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.037550    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"]
Sep 16 02:43:25.045790 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.045740    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:25.118464 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.118425    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-istio-envoy\") pod \"e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") " pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:25.118669 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.118508    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-credential-socket\") pod \"e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") " pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:25.118669 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.118541    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-istio-data\") pod \"e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") " pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:25.118669 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.118575    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-istiod-ca-cert\") pod \"e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") " pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:25.118669 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.118607    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-workload-certs\") pod \"e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") " pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:25.118669 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.118652    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-istio-token\") pod \"e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") " pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:25.118900 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.118788    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-istio-podinfo\") pod \"e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") " pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:25.118900 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.118832    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c28r\" (UniqueName: \"kubernetes.io/projected/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-kube-api-access-4c28r\") pod \"e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") " pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:25.118900 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.118870    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-workload-socket\") pod \"e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") " pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:25.220186 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.220148    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-istiod-ca-cert\") pod \"e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") " pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:25.220186 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.220188    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-workload-certs\") pod \"e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") " pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:25.220461 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.220231    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-istio-token\") pod \"e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") " pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:25.220461 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.220404    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-istio-podinfo\") pod \"e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") " pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:25.220461 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.220445    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c28r\" (UniqueName: \"kubernetes.io/projected/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-kube-api-access-4c28r\") pod \"e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") " pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:25.220635 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.220471    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-workload-socket\") pod \"e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") " pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:25.220698 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.220650    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-istio-envoy\") pod \"e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") " pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:25.220753 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.220714    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-workload-certs\") pod \"e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") " pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:25.220753 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.220733    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-credential-socket\") pod \"e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") " pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:25.220860 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.220765    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-workload-socket\") pod \"e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") " pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:25.220860 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.220790    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-istio-data\") pod \"e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") " pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:25.221051 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.221022    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-credential-socket\") pod \"e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") " pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:25.221181 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.221027    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-istiod-ca-cert\") pod \"e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") " pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:25.221181 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.221077    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-istio-data\") pod \"e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") " pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:25.223146 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.223123    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-istio-podinfo\") pod \"e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") " pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:25.223248 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.223180    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-istio-envoy\") pod \"e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") " pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:25.227326 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.227307    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c28r\" (UniqueName: \"kubernetes.io/projected/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-kube-api-access-4c28r\") pod \"e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") " pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:25.227424 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.227350    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-istio-token\") pod \"e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") " pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:25.250886 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.250862    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:25.339592 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.339501    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:25.613668 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.613643    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"]
Sep 16 02:43:25.615015 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:43:25.614986    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode69e4dbf_7413_4d6c_82a1_1ec4666c5d98.slice/crio-6d039440ede9e4437a1ad2ac520320da45c2fc8c44fd7b699be831692a2d1532 WatchSource:0}: Error finding container 6d039440ede9e4437a1ad2ac520320da45c2fc8c44fd7b699be831692a2d1532: Status 404 returned error can't find the container with id 6d039440ede9e4437a1ad2ac520320da45c2fc8c44fd7b699be831692a2d1532
Sep 16 02:43:25.617788 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.617749    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:43:25.617866 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.617825    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:43:25.617866 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.617851    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:43:25.843254 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.843215    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps" event={"ID":"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98","Type":"ContainerStarted","Data":"d8ed8ebc0054e646d68b2457784b6fc4b5fbf36d9b8b267337b4423df1d42798"}
Sep 16 02:43:25.843483 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.843278    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps" event={"ID":"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98","Type":"ContainerStarted","Data":"6d039440ede9e4437a1ad2ac520320da45c2fc8c44fd7b699be831692a2d1532"}
Sep 16 02:43:25.862784 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:25.862685    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps" podStartSLOduration=0.862666178 podStartE2EDuration="862.666178ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:43:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:43:25.859952466 +0000 UTC m=+1483.910296988" watchObservedRunningTime="2026-09-16 02:43:25.862666178 +0000 UTC m=+1483.913010671"
Sep 16 02:43:26.340126 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:26.340090    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:26.345611 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:26.345585    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:26.849855 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:26.849816    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:26.850638 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:26.850617    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:26.908169 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:26.908132    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:27.711562 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:27.711530    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:27.808268 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:27.808239    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:28.533855 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:28.533826    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:29.228620 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:29.228582    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:30.038939 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:30.038898    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:30.093017 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:30.092981    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:30.465956 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:30.465928    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:30.548544 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:30.548508    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:30.550393 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:30.550372    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6"]
Sep 16 02:43:30.554206 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:30.554186    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6"
Sep 16 02:43:30.556347 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:30.556310    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-10a6b9\""
Sep 16 02:43:30.556520 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:30.556462    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-10a6b9-dockercfg-kgrhq\""
Sep 16 02:43:30.563500 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:30.563480    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6"]
Sep 16 02:43:30.602671 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:30.602634    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm"]
Sep 16 02:43:30.606153 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:30.606137    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm"
Sep 16 02:43:30.615734 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:30.615709    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm"]
Sep 16 02:43:30.679356 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:30.679200    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c52a7f8f-53ca-41f9-9f70-18a598d5ea00-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6\" (UID: \"c52a7f8f-53ca-41f9-9f70-18a598d5ea00\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6"
Sep 16 02:43:30.679356 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:30.679317    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fz97\" (UniqueName: \"kubernetes.io/projected/c52a7f8f-53ca-41f9-9f70-18a598d5ea00-kube-api-access-9fz97\") pod \"payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6\" (UID: \"c52a7f8f-53ca-41f9-9f70-18a598d5ea00\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6"
Sep 16 02:43:30.687011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:30.686976    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:30.780169 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:30.780071    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4eefb51d-070f-419b-af82-4a55d71da636-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm\" (UID: \"4eefb51d-070f-419b-af82-4a55d71da636\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm"
Sep 16 02:43:30.780169 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:30.780116    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c52a7f8f-53ca-41f9-9f70-18a598d5ea00-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6\" (UID: \"c52a7f8f-53ca-41f9-9f70-18a598d5ea00\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6"
Sep 16 02:43:30.780169 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:30.780157    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fz97\" (UniqueName: \"kubernetes.io/projected/c52a7f8f-53ca-41f9-9f70-18a598d5ea00-kube-api-access-9fz97\") pod \"payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6\" (UID: \"c52a7f8f-53ca-41f9-9f70-18a598d5ea00\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6"
Sep 16 02:43:30.780514 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:30.780175    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n6js\" (UniqueName: \"kubernetes.io/projected/4eefb51d-070f-419b-af82-4a55d71da636-kube-api-access-4n6js\") pod \"payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm\" (UID: \"4eefb51d-070f-419b-af82-4a55d71da636\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm"
Sep 16 02:43:30.780916 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:30.780891    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c52a7f8f-53ca-41f9-9f70-18a598d5ea00-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6\" (UID: \"c52a7f8f-53ca-41f9-9f70-18a598d5ea00\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6"
Sep 16 02:43:30.787516 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:30.787498    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fz97\" (UniqueName: \"kubernetes.io/projected/c52a7f8f-53ca-41f9-9f70-18a598d5ea00-kube-api-access-9fz97\") pod \"payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6\" (UID: \"c52a7f8f-53ca-41f9-9f70-18a598d5ea00\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6"
Sep 16 02:43:30.866828 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:30.866797    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6"
Sep 16 02:43:30.881264 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:30.881238    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4eefb51d-070f-419b-af82-4a55d71da636-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm\" (UID: \"4eefb51d-070f-419b-af82-4a55d71da636\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm"
Sep 16 02:43:30.881407 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:30.881320    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n6js\" (UniqueName: \"kubernetes.io/projected/4eefb51d-070f-419b-af82-4a55d71da636-kube-api-access-4n6js\") pod \"payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm\" (UID: \"4eefb51d-070f-419b-af82-4a55d71da636\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm"
Sep 16 02:43:30.882186 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:30.882154    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4eefb51d-070f-419b-af82-4a55d71da636-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm\" (UID: \"4eefb51d-070f-419b-af82-4a55d71da636\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm"
Sep 16 02:43:30.888903 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:30.888878    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n6js\" (UniqueName: \"kubernetes.io/projected/4eefb51d-070f-419b-af82-4a55d71da636-kube-api-access-4n6js\") pod \"payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm\" (UID: \"4eefb51d-070f-419b-af82-4a55d71da636\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm"
Sep 16 02:43:30.918738 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:30.918700    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm"
Sep 16 02:43:31.141516 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:31.141486    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6"]
Sep 16 02:43:31.142663 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:43:31.142634    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc52a7f8f_53ca_41f9_9f70_18a598d5ea00.slice/crio-4b48e0671c09d9c6044e6a9483763ac3adf20f85a6e01b0474dd027e00ea5a3c WatchSource:0}: Error finding container 4b48e0671c09d9c6044e6a9483763ac3adf20f85a6e01b0474dd027e00ea5a3c: Status 404 returned error can't find the container with id 4b48e0671c09d9c6044e6a9483763ac3adf20f85a6e01b0474dd027e00ea5a3c
Sep 16 02:43:31.206643 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:31.206613    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm"]
Sep 16 02:43:31.207390 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:43:31.207354    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eefb51d_070f_419b_af82_4a55d71da636.slice/crio-1d474acd65e0acb3fa880fe1196a4e00365672e190123ea7eca77b3241639a1e WatchSource:0}: Error finding container 1d474acd65e0acb3fa880fe1196a4e00365672e190123ea7eca77b3241639a1e: Status 404 returned error can't find the container with id 1d474acd65e0acb3fa880fe1196a4e00365672e190123ea7eca77b3241639a1e
Sep 16 02:43:31.832060 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:31.832031    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:31.887240 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:31.887203    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6" event={"ID":"c52a7f8f-53ca-41f9-9f70-18a598d5ea00","Type":"ContainerStarted","Data":"98c00e8661ee80e05ded03d7701456cea13d043f366cb191c7d4875480d6adb3"}
Sep 16 02:43:31.887475 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:31.887267    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6" event={"ID":"c52a7f8f-53ca-41f9-9f70-18a598d5ea00","Type":"ContainerStarted","Data":"4b48e0671c09d9c6044e6a9483763ac3adf20f85a6e01b0474dd027e00ea5a3c"}
Sep 16 02:43:31.887475 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:31.887387    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6"
Sep 16 02:43:31.888991 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:31.888965    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm" event={"ID":"4eefb51d-070f-419b-af82-4a55d71da636","Type":"ContainerStarted","Data":"445fdb60851ae0e374adb333065890ee65f49ba44215a873bfd2447769d0c3d4"}
Sep 16 02:43:31.889107 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:31.889008    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm" event={"ID":"4eefb51d-070f-419b-af82-4a55d71da636","Type":"ContainerStarted","Data":"1d474acd65e0acb3fa880fe1196a4e00365672e190123ea7eca77b3241639a1e"}
Sep 16 02:43:31.889107 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:31.889034    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm"
Sep 16 02:43:31.898561 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:31.898539    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:31.905407 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:31.905340    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6" podStartSLOduration=1.9053208000000001 podStartE2EDuration="1.9053208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:43:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:43:31.902465219 +0000 UTC m=+1489.952809738" watchObservedRunningTime="2026-09-16 02:43:31.9053208 +0000 UTC m=+1489.955665293"
Sep 16 02:43:31.924950 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:31.924907    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm" podStartSLOduration=1.924891661 podStartE2EDuration="1.924891661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:43:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:43:31.923686938 +0000 UTC m=+1489.974031456" watchObservedRunningTime="2026-09-16 02:43:31.924891661 +0000 UTC m=+1489.975236154"
Sep 16 02:43:32.103982 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:32.103871    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:33.286160 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:33.286124    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:33.388060 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:33.388025    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:33.487039 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:33.487005    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:34.052923 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:34.052881    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:34.157973 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:34.157942    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:34.262969 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:34.262936    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:35.502338 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:35.502302    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:41.196247 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:41.196206    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:41.263691 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:41.263649    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:41.849921 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:41.849873    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:42.897545 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:42.897514    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm"
Sep 16 02:43:42.897910 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:42.897627    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6"
Sep 16 02:43:47.000236 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:47.000202    2565 generic.go:356] "Generic (PLEG): container finished" podID="e69e4dbf-7413-4d6c-82a1-1ec4666c5d98" containerID="d8ed8ebc0054e646d68b2457784b6fc4b5fbf36d9b8b267337b4423df1d42798" exitCode=0
Sep 16 02:43:47.000682 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:47.000274    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps" event={"ID":"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98","Type":"ContainerDied","Data":"d8ed8ebc0054e646d68b2457784b6fc4b5fbf36d9b8b267337b4423df1d42798"}
Sep 16 02:43:47.000682 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:47.000677    2565 scope.go:117] "RemoveContainer" containerID="d8ed8ebc0054e646d68b2457784b6fc4b5fbf36d9b8b267337b4423df1d42798"
Sep 16 02:43:47.001812 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:47.001784    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:43:47.001887 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:47.001851    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:43:47.001887 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:47.001881    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:43:47.722422 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:47.722390    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:47.823867 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:47.823832    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:47.923322 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:47.923288    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:48.009269 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:48.009180    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps" event={"ID":"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98","Type":"ContainerStarted","Data":"95f80e0b24e2489fbd56e34257c1b0169c13cdd67d17d0fa20fc5432c249a78f"}
Sep 16 02:43:48.339742 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:48.339646    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:48.339950 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:48.339915    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 16 02:43:48.340026 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:48.339979    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps" podUID="e69e4dbf-7413-4d6c-82a1-1ec4666c5d98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 16 02:43:49.340667 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:49.340627    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 16 02:43:49.341051 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:49.340689    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps" podUID="e69e4dbf-7413-4d6c-82a1-1ec4666c5d98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 16 02:43:50.340615 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:50.340577    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 16 02:43:50.340774 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:50.340632    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps" podUID="e69e4dbf-7413-4d6c-82a1-1ec4666c5d98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 16 02:43:51.340381 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:51.340322    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 16 02:43:51.340573 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:51.340401    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps" podUID="e69e4dbf-7413-4d6c-82a1-1ec4666c5d98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 16 02:43:52.340473 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:52.340431    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 16 02:43:52.340897 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:52.340500    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps" podUID="e69e4dbf-7413-4d6c-82a1-1ec4666c5d98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 16 02:43:52.772731 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:52.772691    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:52.871764 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:52.871730    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:53.328164 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:53.328132    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:53.340062 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:53.340033    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 16 02:43:53.340199 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:53.340084    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps" podUID="e69e4dbf-7413-4d6c-82a1-1ec4666c5d98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 16 02:43:53.584601 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:53.584518    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:53.654147 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:53.654057    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:53.742012 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:53.741975    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:54.319346 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:54.319308    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:54.344616 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:54.344571    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:54.344985 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:54.344966    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:54.345709 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:54.345690    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:43:54.949986 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:54.949951    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:56.028670 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:56.028635    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:56.537588 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:56.537548    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:56.635001 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:56.634964    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:56.847435 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:56.847305    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:57.524879 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:57.524829    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:58.370482 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:58.370440    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:58.571588 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:58.571544    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:59.131701 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:59.131666    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:59.822557 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:59.822524    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:43:59.923518 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:43:59.923480    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:00.245956 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:00.245920    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:00.342419 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:00.342385    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:00.645789 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:00.645689    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:00.746027 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:00.745995    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:01.433567 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:01.433531    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:02.235498 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:02.235461    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:03.700012 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:03.699976    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:21.347883 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:21.347845    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:21.727804 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:21.727769    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:22.421806 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:22.421772    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:23.136859 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:23.136829    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:23.719055 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:23.719026    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:24.323008 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:24.322963    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:24.385181 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:24.385143    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8" secret="" err="secret \"payload-processing-dockercfg-7v8jt\" not found"
Sep 16 02:44:24.590922 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:24.590839    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:25.012188 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:25.012154    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:30.259212 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:30.259161    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:30.439991 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:30.439942    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:30.574351 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:30.574249    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:30.861080 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:30.860991    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:31.129761 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:31.129675    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:33.222466 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:33.222428    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:33.604556 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:33.604450    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:33.704057 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:33.703997    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:33.926016 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:33.925981    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:34.847185 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:34.847148    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:35.545455 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:35.545383    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:36.331734 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:36.331697    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:36.926040 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:36.926010    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:37.744955 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:37.744924    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:37.844975 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:37.844937    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:38.192740 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:38.192703    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:38.295829 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:38.295798    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:38.379468 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:38.379431    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:44:42.639665 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:42.639633    2565 scope.go:117] "RemoveContainer" containerID="462f07197ccdfa0a356be4047fd0179430e0495aec4b5f72bdd04058f9973b77"
Sep 16 02:44:59.843266 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:44:59.843228    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:00.134502 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:00.134407    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-4fe974-29825445-ptmj4"]
Sep 16 02:45:00.143128 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:00.143096    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29825445-pr5qj"]
Sep 16 02:45:00.143300 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:00.143217    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-4fe974-29825445-ptmj4"
Sep 16 02:45:00.145622 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:00.145599    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w8hnp\""
Sep 16 02:45:00.146161 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:00.146139    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-eee708-29825445-m4c9g"]
Sep 16 02:45:00.146286 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:00.146248    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825445-pr5qj"
Sep 16 02:45:00.153570 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:00.153539    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-4fe974-29825445-ptmj4"]
Sep 16 02:45:00.153725 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:00.153589    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29825445-pr5qj"]
Sep 16 02:45:00.153725 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:00.153683    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-eee708-29825445-m4c9g"
Sep 16 02:45:00.156250 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:00.156228    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-eee708-29825445-m4c9g"]
Sep 16 02:45:00.160571 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:00.160550    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-4fe974-29825445-ptmj4"
Sep 16 02:45:00.163942 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:00.163345    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-e86d9e-29825445-stw6p"]
Sep 16 02:45:00.166459 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:00.166435    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-e86d9e-29825445-stw6p"
Sep 16 02:45:00.171838 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:00.171818    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825445-pr5qj"
Sep 16 02:45:00.172180 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:00.172160    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-e86d9e-29825445-stw6p"]
Sep 16 02:45:00.208841 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:00.208679    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-eee708-29825445-m4c9g"
Sep 16 02:45:00.216282 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:00.216257    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-e86d9e-29825445-stw6p"
Sep 16 02:45:00.448374 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:00.448328    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-4fe974-29825445-ptmj4"]
Sep 16 02:45:00.449471 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:45:00.449442    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30f2bd7b_8002_4f1e_bbaf_f7e53711718e.slice/crio-bb686cb33b82438e9caaf88538be1a028fd69738ed2bc3a27a6b52aac0d290aa WatchSource:0}: Error finding container bb686cb33b82438e9caaf88538be1a028fd69738ed2bc3a27a6b52aac0d290aa: Status 404 returned error can't find the container with id bb686cb33b82438e9caaf88538be1a028fd69738ed2bc3a27a6b52aac0d290aa
Sep 16 02:45:00.462525 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:00.462496    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-4fe974-29825445-ptmj4" event={"ID":"30f2bd7b-8002-4f1e-bbaf-f7e53711718e","Type":"ContainerStarted","Data":"bb686cb33b82438e9caaf88538be1a028fd69738ed2bc3a27a6b52aac0d290aa"}
Sep 16 02:45:00.474695 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:00.474669    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29825445-pr5qj"]
Sep 16 02:45:00.482852 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:45:00.482824    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf733281e_00fb_48c6_8536_a22ce256c66e.slice/crio-b8473d38ee7163e9e8e8b78c93663a3ef02381974f805c79f0e117f41c5f7655 WatchSource:0}: Error finding container b8473d38ee7163e9e8e8b78c93663a3ef02381974f805c79f0e117f41c5f7655: Status 404 returned error can't find the container with id b8473d38ee7163e9e8e8b78c93663a3ef02381974f805c79f0e117f41c5f7655
Sep 16 02:45:00.530762 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:00.530733    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-eee708-29825445-m4c9g"]
Sep 16 02:45:00.530947 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:45:00.530925    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c99f0a6_4a89_4ae7_a8f6_a444c05de213.slice/crio-136bbcc306dce063a4fdc37b66cb9f81d43b5e0714dc515c86a45b951875acb3 WatchSource:0}: Error finding container 136bbcc306dce063a4fdc37b66cb9f81d43b5e0714dc515c86a45b951875acb3: Status 404 returned error can't find the container with id 136bbcc306dce063a4fdc37b66cb9f81d43b5e0714dc515c86a45b951875acb3
Sep 16 02:45:00.533831 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:00.533808    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-e86d9e-29825445-stw6p"]
Sep 16 02:45:00.534315 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:45:00.534297    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2beb8a89_5095_4b44_8919_87afc90ed8cf.slice/crio-d40a613b24ee6ce34329605358b7558669ce03b79797ddc1f4dc5c22e366aa4d WatchSource:0}: Error finding container d40a613b24ee6ce34329605358b7558669ce03b79797ddc1f4dc5c22e366aa4d: Status 404 returned error can't find the container with id d40a613b24ee6ce34329605358b7558669ce03b79797ddc1f4dc5c22e366aa4d
Sep 16 02:45:00.619937 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:00.619901    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:01.345341 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:01.345309    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:01.470846 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:01.470810    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825445-pr5qj" event={"ID":"f733281e-00fb-48c6-8536-a22ce256c66e","Type":"ContainerStarted","Data":"abeca5f070cf3427e6b332d08820b2135905409eba29c7edd34621d23906e0f6"}
Sep 16 02:45:01.470998 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:01.470872    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825445-pr5qj" event={"ID":"f733281e-00fb-48c6-8536-a22ce256c66e","Type":"ContainerStarted","Data":"b8473d38ee7163e9e8e8b78c93663a3ef02381974f805c79f0e117f41c5f7655"}
Sep 16 02:45:01.472423 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:01.472397    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-e86d9e-29825445-stw6p" event={"ID":"2beb8a89-5095-4b44-8919-87afc90ed8cf","Type":"ContainerStarted","Data":"0e9a0726d59fa6996c2c93c126fe2df1ba0cda3fef9b42f148b54a7c29379e55"}
Sep 16 02:45:01.472562 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:01.472440    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-e86d9e-29825445-stw6p" event={"ID":"2beb8a89-5095-4b44-8919-87afc90ed8cf","Type":"ContainerStarted","Data":"d40a613b24ee6ce34329605358b7558669ce03b79797ddc1f4dc5c22e366aa4d"}
Sep 16 02:45:01.474054 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:01.474025    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-eee708-29825445-m4c9g" event={"ID":"3c99f0a6-4a89-4ae7-a8f6-a444c05de213","Type":"ContainerStarted","Data":"ece0b6fff8c9d19b83c7238d7457354097cb5d1aba983eb6de63009bf7716627"}
Sep 16 02:45:01.474157 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:01.474071    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-eee708-29825445-m4c9g" event={"ID":"3c99f0a6-4a89-4ae7-a8f6-a444c05de213","Type":"ContainerStarted","Data":"136bbcc306dce063a4fdc37b66cb9f81d43b5e0714dc515c86a45b951875acb3"}
Sep 16 02:45:01.475562 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:01.475538    2565 generic.go:356] "Generic (PLEG): container finished" podID="30f2bd7b-8002-4f1e-bbaf-f7e53711718e" containerID="0f4ccc165dc6ccb48444c2efa9d3b4bbb1758786459459397fb6fb212a9b1b02" exitCode=0
Sep 16 02:45:01.475635 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:01.475582    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-4fe974-29825445-ptmj4" event={"ID":"30f2bd7b-8002-4f1e-bbaf-f7e53711718e","Type":"ContainerDied","Data":"0f4ccc165dc6ccb48444c2efa9d3b4bbb1758786459459397fb6fb212a9b1b02"}
Sep 16 02:45:01.487497 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:01.487451    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825445-pr5qj" podStartSLOduration=1.487437674 podStartE2EDuration="1.487437674s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:45:01.48349899 +0000 UTC m=+1579.533843509" watchObservedRunningTime="2026-09-16 02:45:01.487437674 +0000 UTC m=+1579.537782166"
Sep 16 02:45:01.497307 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:01.497267    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-e86d9e-29825445-stw6p" podStartSLOduration=1.497250132 podStartE2EDuration="1.497250132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:45:01.496725602 +0000 UTC m=+1579.547070116" watchObservedRunningTime="2026-09-16 02:45:01.497250132 +0000 UTC m=+1579.547594625"
Sep 16 02:45:01.525524 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:01.525476    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-eee708-29825445-m4c9g" podStartSLOduration=1.5254637739999999 podStartE2EDuration="1.525463774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:45:01.522905311 +0000 UTC m=+1579.573249823" watchObservedRunningTime="2026-09-16 02:45:01.525463774 +0000 UTC m=+1579.575808316"
Sep 16 02:45:02.333021 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:02.332984    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:02.483324 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:02.483287    2565 generic.go:356] "Generic (PLEG): container finished" podID="f733281e-00fb-48c6-8536-a22ce256c66e" containerID="abeca5f070cf3427e6b332d08820b2135905409eba29c7edd34621d23906e0f6" exitCode=0
Sep 16 02:45:02.483785 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:02.483344    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825445-pr5qj" event={"ID":"f733281e-00fb-48c6-8536-a22ce256c66e","Type":"ContainerDied","Data":"abeca5f070cf3427e6b332d08820b2135905409eba29c7edd34621d23906e0f6"}
Sep 16 02:45:02.485038 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:02.485006    2565 generic.go:356] "Generic (PLEG): container finished" podID="2beb8a89-5095-4b44-8919-87afc90ed8cf" containerID="0e9a0726d59fa6996c2c93c126fe2df1ba0cda3fef9b42f148b54a7c29379e55" exitCode=0
Sep 16 02:45:02.485163 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:02.485088    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-e86d9e-29825445-stw6p" event={"ID":"2beb8a89-5095-4b44-8919-87afc90ed8cf","Type":"ContainerDied","Data":"0e9a0726d59fa6996c2c93c126fe2df1ba0cda3fef9b42f148b54a7c29379e55"}
Sep 16 02:45:02.486604 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:02.486580    2565 generic.go:356] "Generic (PLEG): container finished" podID="3c99f0a6-4a89-4ae7-a8f6-a444c05de213" containerID="ece0b6fff8c9d19b83c7238d7457354097cb5d1aba983eb6de63009bf7716627" exitCode=0
Sep 16 02:45:02.486744 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:02.486642    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-eee708-29825445-m4c9g" event={"ID":"3c99f0a6-4a89-4ae7-a8f6-a444c05de213","Type":"ContainerDied","Data":"ece0b6fff8c9d19b83c7238d7457354097cb5d1aba983eb6de63009bf7716627"}
Sep 16 02:45:02.618704 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:02.618683    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-4fe974-29825445-ptmj4"
Sep 16 02:45:03.063543 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:03.063495    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:03.495182 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:03.495152    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-4fe974-29825445-ptmj4"
Sep 16 02:45:03.495673 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:03.495198    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-4fe974-29825445-ptmj4" event={"ID":"30f2bd7b-8002-4f1e-bbaf-f7e53711718e","Type":"ContainerDied","Data":"bb686cb33b82438e9caaf88538be1a028fd69738ed2bc3a27a6b52aac0d290aa"}
Sep 16 02:45:03.495673 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:03.495245    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb686cb33b82438e9caaf88538be1a028fd69738ed2bc3a27a6b52aac0d290aa"
Sep 16 02:45:03.665631 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:03.665590    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-e86d9e-29825445-stw6p"
Sep 16 02:45:03.712519 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:03.712465    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:03.715772 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:03.715747    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825445-pr5qj"
Sep 16 02:45:03.719584 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:03.719560    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-eee708-29825445-m4c9g"
Sep 16 02:45:03.779341 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:03.779244    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:03.861636 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:03.861600    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:04.122241 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.122124    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:04.398134 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.398031    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"]
Sep 16 02:45:04.398776 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.398742    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f733281e-00fb-48c6-8536-a22ce256c66e" containerName="cleanup"
Sep 16 02:45:04.398776 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.398771    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f733281e-00fb-48c6-8536-a22ce256c66e" containerName="cleanup"
Sep 16 02:45:04.398951 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.398804    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30f2bd7b-8002-4f1e-bbaf-f7e53711718e" containerName="cleanup"
Sep 16 02:45:04.398951 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.398813    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="30f2bd7b-8002-4f1e-bbaf-f7e53711718e" containerName="cleanup"
Sep 16 02:45:04.398951 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.398823    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c99f0a6-4a89-4ae7-a8f6-a444c05de213" containerName="cleanup"
Sep 16 02:45:04.398951 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.398832    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c99f0a6-4a89-4ae7-a8f6-a444c05de213" containerName="cleanup"
Sep 16 02:45:04.398951 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.398855    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2beb8a89-5095-4b44-8919-87afc90ed8cf" containerName="cleanup"
Sep 16 02:45:04.398951 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.398864    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2beb8a89-5095-4b44-8919-87afc90ed8cf" containerName="cleanup"
Sep 16 02:45:04.399402 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.398973    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="30f2bd7b-8002-4f1e-bbaf-f7e53711718e" containerName="cleanup"
Sep 16 02:45:04.399402 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.398986    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c99f0a6-4a89-4ae7-a8f6-a444c05de213" containerName="cleanup"
Sep 16 02:45:04.399402 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.398998    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f733281e-00fb-48c6-8536-a22ce256c66e" containerName="cleanup"
Sep 16 02:45:04.399402 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.399007    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2beb8a89-5095-4b44-8919-87afc90ed8cf" containerName="cleanup"
Sep 16 02:45:04.401571 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.401545    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:04.404300 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.404277    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-1a50f4-openshift-default-dockercfg-gzpqq\""
Sep 16 02:45:04.412751 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.412722    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"]
Sep 16 02:45:04.422754 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.422729    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:04.508264 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.508220    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-eee708-29825445-m4c9g" event={"ID":"3c99f0a6-4a89-4ae7-a8f6-a444c05de213","Type":"ContainerDied","Data":"136bbcc306dce063a4fdc37b66cb9f81d43b5e0714dc515c86a45b951875acb3"}
Sep 16 02:45:04.508744 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.508324    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="136bbcc306dce063a4fdc37b66cb9f81d43b5e0714dc515c86a45b951875acb3"
Sep 16 02:45:04.508744 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.508423    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-eee708-29825445-m4c9g"
Sep 16 02:45:04.516222 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.512919    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825445-pr5qj" event={"ID":"f733281e-00fb-48c6-8536-a22ce256c66e","Type":"ContainerDied","Data":"b8473d38ee7163e9e8e8b78c93663a3ef02381974f805c79f0e117f41c5f7655"}
Sep 16 02:45:04.516222 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.512969    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b8473d38ee7163e9e8e8b78c93663a3ef02381974f805c79f0e117f41c5f7655"
Sep 16 02:45:04.516222 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.513041    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825445-pr5qj"
Sep 16 02:45:04.535108 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.535068    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-e86d9e-29825445-stw6p" event={"ID":"2beb8a89-5095-4b44-8919-87afc90ed8cf","Type":"ContainerDied","Data":"d40a613b24ee6ce34329605358b7558669ce03b79797ddc1f4dc5c22e366aa4d"}
Sep 16 02:45:04.535327 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.535127    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d40a613b24ee6ce34329605358b7558669ce03b79797ddc1f4dc5c22e366aa4d"
Sep 16 02:45:04.535327 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.535207    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-e86d9e-29825445-stw6p"
Sep 16 02:45:04.552670 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.552634    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25f33366-06aa-4bd8-8dfb-daeafa572575-istio-data\") pod \"e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") " pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:04.552829 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.552673    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25f33366-06aa-4bd8-8dfb-daeafa572575-credential-socket\") pod \"e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") " pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:04.552829 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.552700    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25f33366-06aa-4bd8-8dfb-daeafa572575-istio-podinfo\") pod \"e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") " pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:04.552829 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.552767    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25f33366-06aa-4bd8-8dfb-daeafa572575-istio-envoy\") pod \"e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") " pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:04.552982 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.552842    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94h75\" (UniqueName: \"kubernetes.io/projected/25f33366-06aa-4bd8-8dfb-daeafa572575-kube-api-access-94h75\") pod \"e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") " pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:04.552982 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.552959    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25f33366-06aa-4bd8-8dfb-daeafa572575-istiod-ca-cert\") pod \"e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") " pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:04.553076 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.552990    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25f33366-06aa-4bd8-8dfb-daeafa572575-workload-certs\") pod \"e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") " pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:04.553076 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.553013    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25f33366-06aa-4bd8-8dfb-daeafa572575-istio-token\") pod \"e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") " pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:04.553076 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.553046    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25f33366-06aa-4bd8-8dfb-daeafa572575-workload-socket\") pod \"e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") " pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:04.636592 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.636528    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:04.654161 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.654083    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25f33366-06aa-4bd8-8dfb-daeafa572575-istiod-ca-cert\") pod \"e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") " pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:04.654161 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.654124    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25f33366-06aa-4bd8-8dfb-daeafa572575-workload-certs\") pod \"e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") " pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:04.654161 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.654148    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25f33366-06aa-4bd8-8dfb-daeafa572575-istio-token\") pod \"e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") " pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:04.654465 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.654179    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25f33366-06aa-4bd8-8dfb-daeafa572575-workload-socket\") pod \"e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") " pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:04.654465 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.654269    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25f33366-06aa-4bd8-8dfb-daeafa572575-istio-data\") pod \"e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") " pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:04.654465 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.654324    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25f33366-06aa-4bd8-8dfb-daeafa572575-credential-socket\") pod \"e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") " pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:04.654465 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.654356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25f33366-06aa-4bd8-8dfb-daeafa572575-istio-podinfo\") pod \"e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") " pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:04.654465 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.654411    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25f33366-06aa-4bd8-8dfb-daeafa572575-istio-envoy\") pod \"e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") " pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:04.654722 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.654492    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94h75\" (UniqueName: \"kubernetes.io/projected/25f33366-06aa-4bd8-8dfb-daeafa572575-kube-api-access-94h75\") pod \"e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") " pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:04.654722 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.654628    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25f33366-06aa-4bd8-8dfb-daeafa572575-workload-socket\") pod \"e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") " pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:04.654722 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.654691    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25f33366-06aa-4bd8-8dfb-daeafa572575-istio-data\") pod \"e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") " pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:04.654910 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.654885    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25f33366-06aa-4bd8-8dfb-daeafa572575-workload-certs\") pod \"e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") " pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:04.655001 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.654986    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25f33366-06aa-4bd8-8dfb-daeafa572575-istiod-ca-cert\") pod \"e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") " pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:04.655180 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.655145    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25f33366-06aa-4bd8-8dfb-daeafa572575-credential-socket\") pod \"e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") " pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:04.657438 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.657415    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25f33366-06aa-4bd8-8dfb-daeafa572575-istio-envoy\") pod \"e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") " pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:04.657554 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.657437    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25f33366-06aa-4bd8-8dfb-daeafa572575-istio-podinfo\") pod \"e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") " pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:04.661247 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.661223    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25f33366-06aa-4bd8-8dfb-daeafa572575-istio-token\") pod \"e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") " pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:04.661834 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.661816    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94h75\" (UniqueName: \"kubernetes.io/projected/25f33366-06aa-4bd8-8dfb-daeafa572575-kube-api-access-94h75\") pod \"e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") " pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:04.720125 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.720096    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:04.738947 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:04.736878    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:05.007177 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:05.007146    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"]
Sep 16 02:45:05.008111 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:45:05.008075    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25f33366_06aa_4bd8_8dfb_daeafa572575.slice/crio-6bf94f4e8354a9627f7e1df3a61e69b8660685c01964ed1307497303984bfc17 WatchSource:0}: Error finding container 6bf94f4e8354a9627f7e1df3a61e69b8660685c01964ed1307497303984bfc17: Status 404 returned error can't find the container with id 6bf94f4e8354a9627f7e1df3a61e69b8660685c01964ed1307497303984bfc17
Sep 16 02:45:05.011243 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:05.011213    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:45:05.011309 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:05.011280    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:45:05.011349 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:05.011307    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:45:05.545263 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:05.545220    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf" event={"ID":"25f33366-06aa-4bd8-8dfb-daeafa572575","Type":"ContainerStarted","Data":"401f2466a16ef212abd62512e3a32e066a4d2f12e3322e1f699b69d35a2d73ad"}
Sep 16 02:45:05.545797 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:05.545295    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf" event={"ID":"25f33366-06aa-4bd8-8dfb-daeafa572575","Type":"ContainerStarted","Data":"6bf94f4e8354a9627f7e1df3a61e69b8660685c01964ed1307497303984bfc17"}
Sep 16 02:45:05.566749 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:05.566695    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf" podStartSLOduration=1.566677351 podStartE2EDuration="1.566677351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:45:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:45:05.563097107 +0000 UTC m=+1583.613441622" watchObservedRunningTime="2026-09-16 02:45:05.566677351 +0000 UTC m=+1583.617021844"
Sep 16 02:45:05.720614 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:05.720575    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:06.726430 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:06.726396    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:06.825147 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:06.825114    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:07.432706 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:07.432625    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:07.531990 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:07.531956    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:07.559412 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:07.559380    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:07.560455 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:07.560434    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:07.641864 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:07.641831    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:08.635830 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:08.635792    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:09.331665 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:09.331611    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:10.039517 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:10.039476    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:10.837454 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:10.837420    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:11.425180 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:11.425144    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:12.044715 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:12.044682    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:12.143036 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:12.142994    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:12.197155 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:12.197110    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:12.567797 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:12.567766    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:12.667918 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:12.667856    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:12.674443 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:12.674415    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk"]
Sep 16 02:45:12.676972 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:12.676956    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk"
Sep 16 02:45:12.679285 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:12.679263    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-1a50f4-dockercfg-2cjv6\""
Sep 16 02:45:12.679285 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:12.679281    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-1a50f4\""
Sep 16 02:45:12.688201 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:12.688179    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk"]
Sep 16 02:45:12.705130 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:12.705107    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks"]
Sep 16 02:45:12.707555 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:12.707536    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks"
Sep 16 02:45:12.718027 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:12.718007    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks"]
Sep 16 02:45:12.842689 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:12.842608    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5456253d-6e0b-4915-893a-314d8587e8bb-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk\" (UID: \"5456253d-6e0b-4915-893a-314d8587e8bb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk"
Sep 16 02:45:12.842689 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:12.842664    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9a5f1e8-a128-4d16-9fba-441d733ed910-plugins-config-volume\") pod \"payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks\" (UID: \"a9a5f1e8-a128-4d16-9fba-441d733ed910\") " pod="openshift-ingress/payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks"
Sep 16 02:45:12.842879 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:12.842734    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmn4n\" (UniqueName: \"kubernetes.io/projected/5456253d-6e0b-4915-893a-314d8587e8bb-kube-api-access-kmn4n\") pod \"payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk\" (UID: \"5456253d-6e0b-4915-893a-314d8587e8bb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk"
Sep 16 02:45:12.842879 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:12.842800    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhwnw\" (UniqueName: \"kubernetes.io/projected/a9a5f1e8-a128-4d16-9fba-441d733ed910-kube-api-access-rhwnw\") pod \"payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks\" (UID: \"a9a5f1e8-a128-4d16-9fba-441d733ed910\") " pod="openshift-ingress/payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks"
Sep 16 02:45:12.944281 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:12.944234    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhwnw\" (UniqueName: \"kubernetes.io/projected/a9a5f1e8-a128-4d16-9fba-441d733ed910-kube-api-access-rhwnw\") pod \"payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks\" (UID: \"a9a5f1e8-a128-4d16-9fba-441d733ed910\") " pod="openshift-ingress/payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks"
Sep 16 02:45:12.944484 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:12.944305    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5456253d-6e0b-4915-893a-314d8587e8bb-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk\" (UID: \"5456253d-6e0b-4915-893a-314d8587e8bb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk"
Sep 16 02:45:12.944484 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:12.944383    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9a5f1e8-a128-4d16-9fba-441d733ed910-plugins-config-volume\") pod \"payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks\" (UID: \"a9a5f1e8-a128-4d16-9fba-441d733ed910\") " pod="openshift-ingress/payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks"
Sep 16 02:45:12.944484 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:12.944448    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmn4n\" (UniqueName: \"kubernetes.io/projected/5456253d-6e0b-4915-893a-314d8587e8bb-kube-api-access-kmn4n\") pod \"payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk\" (UID: \"5456253d-6e0b-4915-893a-314d8587e8bb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk"
Sep 16 02:45:12.945150 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:12.945125    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9a5f1e8-a128-4d16-9fba-441d733ed910-plugins-config-volume\") pod \"payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks\" (UID: \"a9a5f1e8-a128-4d16-9fba-441d733ed910\") " pod="openshift-ingress/payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks"
Sep 16 02:45:12.945249 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:12.945127    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5456253d-6e0b-4915-893a-314d8587e8bb-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk\" (UID: \"5456253d-6e0b-4915-893a-314d8587e8bb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk"
Sep 16 02:45:12.951948 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:12.951920    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhwnw\" (UniqueName: \"kubernetes.io/projected/a9a5f1e8-a128-4d16-9fba-441d733ed910-kube-api-access-rhwnw\") pod \"payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks\" (UID: \"a9a5f1e8-a128-4d16-9fba-441d733ed910\") " pod="openshift-ingress/payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks"
Sep 16 02:45:12.952062 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:12.951927    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmn4n\" (UniqueName: \"kubernetes.io/projected/5456253d-6e0b-4915-893a-314d8587e8bb-kube-api-access-kmn4n\") pod \"payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk\" (UID: \"5456253d-6e0b-4915-893a-314d8587e8bb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk"
Sep 16 02:45:12.989467 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:12.989440    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk"
Sep 16 02:45:13.018722 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:13.018694    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks"
Sep 16 02:45:13.226119 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:13.226078    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:13.262334 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:13.262309    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk"]
Sep 16 02:45:13.262711 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:45:13.262689    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5456253d_6e0b_4915_893a_314d8587e8bb.slice/crio-654b19b9d6bb0fbcd3f80abe0f99572097cf6701a53c5a387b031c3048ec1bfc WatchSource:0}: Error finding container 654b19b9d6bb0fbcd3f80abe0f99572097cf6701a53c5a387b031c3048ec1bfc: Status 404 returned error can't find the container with id 654b19b9d6bb0fbcd3f80abe0f99572097cf6701a53c5a387b031c3048ec1bfc
Sep 16 02:45:13.310000 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:13.309919    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks"]
Sep 16 02:45:13.313108 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:45:13.313068    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9a5f1e8_a128_4d16_9fba_441d733ed910.slice/crio-4b37805b7cbace33ce4cb4ca7d4cc94836d5407e572df9bb4973c3ea02bfe809 WatchSource:0}: Error finding container 4b37805b7cbace33ce4cb4ca7d4cc94836d5407e572df9bb4973c3ea02bfe809: Status 404 returned error can't find the container with id 4b37805b7cbace33ce4cb4ca7d4cc94836d5407e572df9bb4973c3ea02bfe809
Sep 16 02:45:13.609076 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:13.608966    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks" event={"ID":"a9a5f1e8-a128-4d16-9fba-441d733ed910","Type":"ContainerStarted","Data":"689575a1d30543927eafc5bd255db2cb5aa1b7a04626595da09bedde6114bd70"}
Sep 16 02:45:13.609076 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:13.609028    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks" event={"ID":"a9a5f1e8-a128-4d16-9fba-441d733ed910","Type":"ContainerStarted","Data":"4b37805b7cbace33ce4cb4ca7d4cc94836d5407e572df9bb4973c3ea02bfe809"}
Sep 16 02:45:13.609076 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:13.609060    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks"
Sep 16 02:45:13.610750 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:13.610715    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk" event={"ID":"5456253d-6e0b-4915-893a-314d8587e8bb","Type":"ContainerStarted","Data":"ce3ad7e9414b46847e0219b54c1432a8c18c7d7da44522c6ebb0b70a2da2afbb"}
Sep 16 02:45:13.610876 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:13.610777    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk"
Sep 16 02:45:13.610876 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:13.610804    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk" event={"ID":"5456253d-6e0b-4915-893a-314d8587e8bb","Type":"ContainerStarted","Data":"654b19b9d6bb0fbcd3f80abe0f99572097cf6701a53c5a387b031c3048ec1bfc"}
Sep 16 02:45:13.624238 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:13.624191    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks" podStartSLOduration=1.624177318 podStartE2EDuration="1.624177318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:45:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:45:13.623356285 +0000 UTC m=+1591.673700807" watchObservedRunningTime="2026-09-16 02:45:13.624177318 +0000 UTC m=+1591.674521811"
Sep 16 02:45:13.647238 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:13.643540    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk" podStartSLOduration=1.643522572 podStartE2EDuration="1.643522572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:45:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:45:13.638032789 +0000 UTC m=+1591.688377286" watchObservedRunningTime="2026-09-16 02:45:13.643522572 +0000 UTC m=+1591.693867065"
Sep 16 02:45:13.847097 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:13.847059    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:14.511037 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:14.511005    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:15.254330 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:15.254298    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:19.863522 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:19.863478    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:24.623744 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:24.623711    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk"
Sep 16 02:45:24.624208 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:24.623789    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks"
Sep 16 02:45:32.740877 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:32.740829    2565 generic.go:356] "Generic (PLEG): container finished" podID="25f33366-06aa-4bd8-8dfb-daeafa572575" containerID="401f2466a16ef212abd62512e3a32e066a4d2f12e3322e1f699b69d35a2d73ad" exitCode=0
Sep 16 02:45:32.741285 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:32.740901    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf" event={"ID":"25f33366-06aa-4bd8-8dfb-daeafa572575","Type":"ContainerDied","Data":"401f2466a16ef212abd62512e3a32e066a4d2f12e3322e1f699b69d35a2d73ad"}
Sep 16 02:45:32.741326 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:32.741304    2565 scope.go:117] "RemoveContainer" containerID="401f2466a16ef212abd62512e3a32e066a4d2f12e3322e1f699b69d35a2d73ad"
Sep 16 02:45:32.742515 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:32.742487    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:45:32.742613 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:32.742557    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:45:32.742613 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:32.742588    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 02:45:33.040566 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:33.040533    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:33.751378 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:33.751318    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf" event={"ID":"25f33366-06aa-4bd8-8dfb-daeafa572575","Type":"ContainerStarted","Data":"a62e14a128c6eaab2c860e19b5ee712c9e799887972cfaaf82964d12805fd6b3"}
Sep 16 02:45:34.474096 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:34.474065    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:34.720684 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:34.720645    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:34.721934 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:34.721906    2565 patch_prober.go:28] interesting pod/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 16 02:45:34.722049 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:34.721959    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf" podUID="25f33366-06aa-4bd8-8dfb-daeafa572575" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 16 02:45:35.254321 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:35.254217    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:35.721337 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:35.721295    2565 patch_prober.go:28] interesting pod/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 16 02:45:35.721546 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:35.721355    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf" podUID="25f33366-06aa-4bd8-8dfb-daeafa572575" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 16 02:45:36.107014 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:36.106929    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:36.685241 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:36.685209    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:36.721396 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:36.721303    2565 patch_prober.go:28] interesting pod/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 16 02:45:36.721562 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:36.721391    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf" podUID="25f33366-06aa-4bd8-8dfb-daeafa572575" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 16 02:45:37.478473 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:37.478432    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:37.560050 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:37.560003    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:37.645172 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:37.645132    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:37.720858 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:37.720812    2565 patch_prober.go:28] interesting pod/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 16 02:45:37.721343 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:37.720907    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf" podUID="25f33366-06aa-4bd8-8dfb-daeafa572575" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 16 02:45:38.347420 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:38.347356    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:38.720811 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:38.720771    2565 patch_prober.go:28] interesting pod/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 16 02:45:38.720989 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:38.720845    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf" podUID="25f33366-06aa-4bd8-8dfb-daeafa572575" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 16 02:45:38.968649 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:38.968613    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:39.724675 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:39.724640    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:39.725706 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:39.725685    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:45:39.728587 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:39.728563    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:40.634068 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:40.634031    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:41.414508 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:41.414456    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:42.125374 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:42.125335    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:42.534253 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:42.534224    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm_4eefb51d-070f-419b-af82-4a55d71da636/payload-processing/0.log"
Sep 16 02:45:42.661686 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:42.661654    2565 scope.go:117] "RemoveContainer" containerID="e73b3390bf83598a84cc7a3245eab7c8b67d71bf647e737ee6bbb523ff3be50e"
Sep 16 02:45:42.737316 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:42.737282    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:43.219687 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:43.219651    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:43.499592 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:43.499504    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:43.595648 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:43.595618    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:44.099698 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:44.099669    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:44.199978 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:44.199945    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:44.853241 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:44.853211    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:45.626454 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:45.626416    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:46.525418 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:46.525377    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:47.125880 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:47.125842    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:47.237063 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:47.237034    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:47.406517 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:47.406483    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:48.230335 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:48.230295    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:48.864839 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:48.864806    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:49.459483 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:49.459446    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:50.223532 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:50.223486    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:50.385537 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:50.385504    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8" secret="" err="secret \"payload-processing-dockercfg-7v8jt\" not found"
Sep 16 02:45:50.827377 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:50.827338    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:51.518674 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:51.518636    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:52.125607 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:52.125565    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:52.223415 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:52.223352    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:52.418940 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:52.418901    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:52.579352 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:52.579313    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:52.667326 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:52.667290    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:52.669580 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:52.669528    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc"]
Sep 16 02:45:52.672507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:52.672492    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc"
Sep 16 02:45:52.674822 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:52.674794    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-342933\""
Sep 16 02:45:52.674964 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:52.674942    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-342933-dockercfg-lmrdb\""
Sep 16 02:45:52.683624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:52.683600    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc"]
Sep 16 02:45:52.759053 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:52.759016    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a2e57e83-5d84-43d7-ab16-157f12082dfc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc\" (UID: \"a2e57e83-5d84-43d7-ab16-157f12082dfc\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc"
Sep 16 02:45:52.759242 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:52.759215    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c2fx\" (UniqueName: \"kubernetes.io/projected/a2e57e83-5d84-43d7-ab16-157f12082dfc-kube-api-access-4c2fx\") pod \"payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc\" (UID: \"a2e57e83-5d84-43d7-ab16-157f12082dfc\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc"
Sep 16 02:45:52.860353 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:52.860321    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c2fx\" (UniqueName: \"kubernetes.io/projected/a2e57e83-5d84-43d7-ab16-157f12082dfc-kube-api-access-4c2fx\") pod \"payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc\" (UID: \"a2e57e83-5d84-43d7-ab16-157f12082dfc\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc"
Sep 16 02:45:52.860581 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:52.860478    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a2e57e83-5d84-43d7-ab16-157f12082dfc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc\" (UID: \"a2e57e83-5d84-43d7-ab16-157f12082dfc\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc"
Sep 16 02:45:52.861197 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:52.861171    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a2e57e83-5d84-43d7-ab16-157f12082dfc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc\" (UID: \"a2e57e83-5d84-43d7-ab16-157f12082dfc\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc"
Sep 16 02:45:52.867659 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:52.867632    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c2fx\" (UniqueName: \"kubernetes.io/projected/a2e57e83-5d84-43d7-ab16-157f12082dfc-kube-api-access-4c2fx\") pod \"payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc\" (UID: \"a2e57e83-5d84-43d7-ab16-157f12082dfc\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc"
Sep 16 02:45:52.985325 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:52.985234    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc"
Sep 16 02:45:53.226904 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:53.226866    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:53.259424 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:53.259391    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc"]
Sep 16 02:45:53.260353 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:45:53.260325    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2e57e83_5d84_43d7_ab16_157f12082dfc.slice/crio-4ecdafa6480ed762e49ecd1913de40383218f32d65126c41dc4b0b2898c23924 WatchSource:0}: Error finding container 4ecdafa6480ed762e49ecd1913de40383218f32d65126c41dc4b0b2898c23924: Status 404 returned error can't find the container with id 4ecdafa6480ed762e49ecd1913de40383218f32d65126c41dc4b0b2898c23924
Sep 16 02:45:53.895625 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:53.895586    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc" event={"ID":"a2e57e83-5d84-43d7-ab16-157f12082dfc","Type":"ContainerStarted","Data":"dfc61ca2990b769571313d6ff19e07543e989bf99bb8efdcf8820414acea637f"}
Sep 16 02:45:53.895808 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:53.895643    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc" event={"ID":"a2e57e83-5d84-43d7-ab16-157f12082dfc","Type":"ContainerStarted","Data":"4ecdafa6480ed762e49ecd1913de40383218f32d65126c41dc4b0b2898c23924"}
Sep 16 02:45:53.895808 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:53.895680    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc"
Sep 16 02:45:53.913680 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:53.913645    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:53.915201 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:53.915150    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc" podStartSLOduration=1.915136402 podStartE2EDuration="1.915136402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:45:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:45:53.912019382 +0000 UTC m=+1631.962363899" watchObservedRunningTime="2026-09-16 02:45:53.915136402 +0000 UTC m=+1631.965480895"
Sep 16 02:45:58.138620 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:58.138551    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:58.205747 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:58.205712    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:58.256801 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:58.256747    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:58.310267 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:58.310229    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:58.361372 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:58.361320    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:58.652748 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:58.652702    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:58.741465 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:58.741429    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:59.325033 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:59.324997    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:45:59.957642 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:45:59.957597    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:00.734421 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:00.734383    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:01.356452 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:01.356410    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:02.128054 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:02.128007    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:02.741168 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:02.741132    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:03.629099 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:03.629069    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:04.427866 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:04.427834    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:04.525290 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:04.525262    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:04.649150 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:04.649113    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:04.759497 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:04.759391    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:04.903307 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:04.903275    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc"
Sep 16 02:46:05.522898 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:05.522856    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:06.120899 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:06.120865    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:06.716723 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:06.716682    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:06.815085 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:06.815045    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:07.422570 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:07.422538    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-342933-v9cjb"]
Sep 16 02:46:07.425243 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:07.425221    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-342933-v9cjb"
Sep 16 02:46:07.427400 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:07.427374    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w8hnp\""
Sep 16 02:46:07.427626 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:07.427611    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 02:46:07.432890 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:07.432864    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-342933-v9cjb"]
Sep 16 02:46:07.442690 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:07.442655    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:07.516928 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:07.516890    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a400237-edbe-4e99-b16d-1c7668e36cc7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-342933-v9cjb\" (UID: \"3a400237-edbe-4e99-b16d-1c7668e36cc7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-342933-v9cjb"
Sep 16 02:46:07.617969 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:07.617938    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a400237-edbe-4e99-b16d-1c7668e36cc7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-342933-v9cjb\" (UID: \"3a400237-edbe-4e99-b16d-1c7668e36cc7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-342933-v9cjb"
Sep 16 02:46:07.618639 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:07.618617    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a400237-edbe-4e99-b16d-1c7668e36cc7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-342933-v9cjb\" (UID: \"3a400237-edbe-4e99-b16d-1c7668e36cc7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-342933-v9cjb"
Sep 16 02:46:07.737660 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:07.737575    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-342933-v9cjb"
Sep 16 02:46:08.024993 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:46:08.024961    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a400237_edbe_4e99_b16d_1c7668e36cc7.slice/crio-4f50ee525d7456f311e634e3261c66fde26ca76152073e2f74d05a0bbbeed367 WatchSource:0}: Error finding container 4f50ee525d7456f311e634e3261c66fde26ca76152073e2f74d05a0bbbeed367: Status 404 returned error can't find the container with id 4f50ee525d7456f311e634e3261c66fde26ca76152073e2f74d05a0bbbeed367
Sep 16 02:46:08.025976 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:08.025945    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-342933-v9cjb"]
Sep 16 02:46:08.124122 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:08.124075    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:08.830636 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:08.830605    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:08.995065 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:08.995027    2565 generic.go:356] "Generic (PLEG): container finished" podID="3a400237-edbe-4e99-b16d-1c7668e36cc7" containerID="19433515695a24b02673a7ddaa3c4e9b7af5638a31216416972017ee0893912d" exitCode=0
Sep 16 02:46:08.995230 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:08.995114    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-342933-v9cjb" event={"ID":"3a400237-edbe-4e99-b16d-1c7668e36cc7","Type":"ContainerDied","Data":"19433515695a24b02673a7ddaa3c4e9b7af5638a31216416972017ee0893912d"}
Sep 16 02:46:08.995230 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:08.995173    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-342933-v9cjb" event={"ID":"3a400237-edbe-4e99-b16d-1c7668e36cc7","Type":"ContainerStarted","Data":"4f50ee525d7456f311e634e3261c66fde26ca76152073e2f74d05a0bbbeed367"}
Sep 16 02:46:09.424056 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:09.424019    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:10.153709 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:10.153682    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-342933-v9cjb"
Sep 16 02:46:10.243955 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:10.243925    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a400237-edbe-4e99-b16d-1c7668e36cc7-maas-api-service-ca\") pod \"3a400237-edbe-4e99-b16d-1c7668e36cc7\" (UID: \"3a400237-edbe-4e99-b16d-1c7668e36cc7\") "
Sep 16 02:46:10.244301 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:10.244280    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a400237-edbe-4e99-b16d-1c7668e36cc7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3a400237-edbe-4e99-b16d-1c7668e36cc7" (UID: "3a400237-edbe-4e99-b16d-1c7668e36cc7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:46:10.246905 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:10.246870    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:10.345760 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:10.345662    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a400237-edbe-4e99-b16d-1c7668e36cc7-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:10.843401 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:10.843339    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:11.009808 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:11.009774    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-342933-v9cjb" event={"ID":"3a400237-edbe-4e99-b16d-1c7668e36cc7","Type":"ContainerDied","Data":"4f50ee525d7456f311e634e3261c66fde26ca76152073e2f74d05a0bbbeed367"}
Sep 16 02:46:11.009808 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:11.009801    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-342933-v9cjb"
Sep 16 02:46:11.010018 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:11.009823    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f50ee525d7456f311e634e3261c66fde26ca76152073e2f74d05a0bbbeed367"
Sep 16 02:46:11.612268 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:11.612227    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:12.198958 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:12.198921    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:12.947331 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:12.947295    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:13.591963 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:13.591935    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:14.192253 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:14.192219    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:15.121958 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:15.121925    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:17.620467 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:17.620434    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:18.279899 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:18.279860    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:18.317744 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:18.317711    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc"]
Sep 16 02:46:18.317992 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:18.317966    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc" podUID="a2e57e83-5d84-43d7-ab16-157f12082dfc" containerName="payload-pre-processing" containerID="cri-o://dfc61ca2990b769571313d6ff19e07543e989bf99bb8efdcf8820414acea637f" gracePeriod=30
Sep 16 02:46:18.343211 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:18.343184    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:18.397721 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:18.397687    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:18.458527 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:18.458492    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:18.459574 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:18.459558    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-342933-v9cjb"]
Sep 16 02:46:18.464885 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:18.464717    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-342933-v9cjb"]
Sep 16 02:46:18.516095 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:18.516066    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:18.614282 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:18.614245    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc"
Sep 16 02:46:18.732001 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:18.731963    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4c2fx\" (UniqueName: \"kubernetes.io/projected/a2e57e83-5d84-43d7-ab16-157f12082dfc-kube-api-access-4c2fx\") pod \"a2e57e83-5d84-43d7-ab16-157f12082dfc\" (UID: \"a2e57e83-5d84-43d7-ab16-157f12082dfc\") "
Sep 16 02:46:18.732484 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:18.732026    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a2e57e83-5d84-43d7-ab16-157f12082dfc-plugins-config-volume\") pod \"a2e57e83-5d84-43d7-ab16-157f12082dfc\" (UID: \"a2e57e83-5d84-43d7-ab16-157f12082dfc\") "
Sep 16 02:46:18.732484 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:18.732408    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2e57e83-5d84-43d7-ab16-157f12082dfc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a2e57e83-5d84-43d7-ab16-157f12082dfc" (UID: "a2e57e83-5d84-43d7-ab16-157f12082dfc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:46:18.734022 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:18.734001    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2e57e83-5d84-43d7-ab16-157f12082dfc-kube-api-access-4c2fx" (OuterVolumeSpecName: "kube-api-access-4c2fx") pod "a2e57e83-5d84-43d7-ab16-157f12082dfc" (UID: "a2e57e83-5d84-43d7-ab16-157f12082dfc"). InnerVolumeSpecName "kube-api-access-4c2fx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:46:18.815659 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:18.815624    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:18.833643 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:18.833606    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4c2fx\" (UniqueName: \"kubernetes.io/projected/a2e57e83-5d84-43d7-ab16-157f12082dfc-kube-api-access-4c2fx\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:18.833643 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:18.833636    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a2e57e83-5d84-43d7-ab16-157f12082dfc-plugins-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:19.062751 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:19.062715    2565 generic.go:356] "Generic (PLEG): container finished" podID="a2e57e83-5d84-43d7-ab16-157f12082dfc" containerID="dfc61ca2990b769571313d6ff19e07543e989bf99bb8efdcf8820414acea637f" exitCode=0
Sep 16 02:46:19.062941 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:19.062762    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc"
Sep 16 02:46:19.062941 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:19.062799    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc" event={"ID":"a2e57e83-5d84-43d7-ab16-157f12082dfc","Type":"ContainerDied","Data":"dfc61ca2990b769571313d6ff19e07543e989bf99bb8efdcf8820414acea637f"}
Sep 16 02:46:19.062941 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:19.062851    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc" event={"ID":"a2e57e83-5d84-43d7-ab16-157f12082dfc","Type":"ContainerDied","Data":"4ecdafa6480ed762e49ecd1913de40383218f32d65126c41dc4b0b2898c23924"}
Sep 16 02:46:19.062941 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:19.062874    2565 scope.go:117] "RemoveContainer" containerID="dfc61ca2990b769571313d6ff19e07543e989bf99bb8efdcf8820414acea637f"
Sep 16 02:46:19.073313 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:19.073298    2565 scope.go:117] "RemoveContainer" containerID="dfc61ca2990b769571313d6ff19e07543e989bf99bb8efdcf8820414acea637f"
Sep 16 02:46:19.073620 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:46:19.073601    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfc61ca2990b769571313d6ff19e07543e989bf99bb8efdcf8820414acea637f\": container with ID starting with dfc61ca2990b769571313d6ff19e07543e989bf99bb8efdcf8820414acea637f not found: ID does not exist" containerID="dfc61ca2990b769571313d6ff19e07543e989bf99bb8efdcf8820414acea637f"
Sep 16 02:46:19.073668 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:19.073630    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfc61ca2990b769571313d6ff19e07543e989bf99bb8efdcf8820414acea637f"} err="failed to get container status \"dfc61ca2990b769571313d6ff19e07543e989bf99bb8efdcf8820414acea637f\": rpc error: code = NotFound desc = could not find container \"dfc61ca2990b769571313d6ff19e07543e989bf99bb8efdcf8820414acea637f\": container with ID starting with dfc61ca2990b769571313d6ff19e07543e989bf99bb8efdcf8820414acea637f not found: ID does not exist"
Sep 16 02:46:19.085570 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:19.085544    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc"]
Sep 16 02:46:19.089008 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:19.088988    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc"]
Sep 16 02:46:19.139404 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:19.139352    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:19.724674 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:19.724641    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:20.391355 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:20.391275    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a400237-edbe-4e99-b16d-1c7668e36cc7" path="/var/lib/kubelet/pods/3a400237-edbe-4e99-b16d-1c7668e36cc7/volumes"
Sep 16 02:46:20.391708 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:20.391700    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2e57e83-5d84-43d7-ab16-157f12082dfc" path="/var/lib/kubelet/pods/a2e57e83-5d84-43d7-ab16-157f12082dfc/volumes"
Sep 16 02:46:20.517506 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:20.517471    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:21.257950 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:21.257916    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:21.857867 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:21.857820    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:22.530735 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:22.530701    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:23.060449 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:23.060407    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:23.091126 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:23.091087    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks"]
Sep 16 02:46:23.091654 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:23.091620    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks" podUID="a9a5f1e8-a128-4d16-9fba-441d733ed910" containerName="payload-processing" containerID="cri-o://689575a1d30543927eafc5bd255db2cb5aa1b7a04626595da09bedde6114bd70" gracePeriod=30
Sep 16 02:46:23.096639 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:23.096613    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk"]
Sep 16 02:46:23.097002 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:23.096978    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk" podUID="5456253d-6e0b-4915-893a-314d8587e8bb" containerName="payload-pre-processing" containerID="cri-o://ce3ad7e9414b46847e0219b54c1432a8c18c7d7da44522c6ebb0b70a2da2afbb" gracePeriod=30
Sep 16 02:46:23.130045 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:23.130013    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:23.182965 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:23.182930    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:23.277982 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:23.277887    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:23.405542 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:23.405506    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk"
Sep 16 02:46:23.440433 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:23.440406    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks"
Sep 16 02:46:23.483122 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:23.483081    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5456253d-6e0b-4915-893a-314d8587e8bb-plugins-config-volume\") pod \"5456253d-6e0b-4915-893a-314d8587e8bb\" (UID: \"5456253d-6e0b-4915-893a-314d8587e8bb\") "
Sep 16 02:46:23.483122 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:23.483121    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmn4n\" (UniqueName: \"kubernetes.io/projected/5456253d-6e0b-4915-893a-314d8587e8bb-kube-api-access-kmn4n\") pod \"5456253d-6e0b-4915-893a-314d8587e8bb\" (UID: \"5456253d-6e0b-4915-893a-314d8587e8bb\") "
Sep 16 02:46:23.483588 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:23.483554    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5456253d-6e0b-4915-893a-314d8587e8bb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5456253d-6e0b-4915-893a-314d8587e8bb" (UID: "5456253d-6e0b-4915-893a-314d8587e8bb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:46:23.485230 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:23.485204    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5456253d-6e0b-4915-893a-314d8587e8bb-kube-api-access-kmn4n" (OuterVolumeSpecName: "kube-api-access-kmn4n") pod "5456253d-6e0b-4915-893a-314d8587e8bb" (UID: "5456253d-6e0b-4915-893a-314d8587e8bb"). InnerVolumeSpecName "kube-api-access-kmn4n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:46:23.584497 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:23.584407    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhwnw\" (UniqueName: \"kubernetes.io/projected/a9a5f1e8-a128-4d16-9fba-441d733ed910-kube-api-access-rhwnw\") pod \"a9a5f1e8-a128-4d16-9fba-441d733ed910\" (UID: \"a9a5f1e8-a128-4d16-9fba-441d733ed910\") "
Sep 16 02:46:23.584668 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:23.584569    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9a5f1e8-a128-4d16-9fba-441d733ed910-plugins-config-volume\") pod \"a9a5f1e8-a128-4d16-9fba-441d733ed910\" (UID: \"a9a5f1e8-a128-4d16-9fba-441d733ed910\") "
Sep 16 02:46:23.584822 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:23.584806    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5456253d-6e0b-4915-893a-314d8587e8bb-plugins-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:23.584888 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:23.584822    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmn4n\" (UniqueName: \"kubernetes.io/projected/5456253d-6e0b-4915-893a-314d8587e8bb-kube-api-access-kmn4n\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:23.584946 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:23.584903    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9a5f1e8-a128-4d16-9fba-441d733ed910-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a9a5f1e8-a128-4d16-9fba-441d733ed910" (UID: "a9a5f1e8-a128-4d16-9fba-441d733ed910"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:46:23.586509 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:23.586483    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9a5f1e8-a128-4d16-9fba-441d733ed910-kube-api-access-rhwnw" (OuterVolumeSpecName: "kube-api-access-rhwnw") pod "a9a5f1e8-a128-4d16-9fba-441d733ed910" (UID: "a9a5f1e8-a128-4d16-9fba-441d733ed910"). InnerVolumeSpecName "kube-api-access-rhwnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:46:23.616780 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:23.616754    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:23.686306 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:23.686267    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9a5f1e8-a128-4d16-9fba-441d733ed910-plugins-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:23.686306 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:23.686295    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhwnw\" (UniqueName: \"kubernetes.io/projected/a9a5f1e8-a128-4d16-9fba-441d733ed910-kube-api-access-rhwnw\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:23.880585 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:23.880502    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:24.100700 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:24.100661    2565 generic.go:356] "Generic (PLEG): container finished" podID="5456253d-6e0b-4915-893a-314d8587e8bb" containerID="ce3ad7e9414b46847e0219b54c1432a8c18c7d7da44522c6ebb0b70a2da2afbb" exitCode=0
Sep 16 02:46:24.101183 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:24.100715    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk"
Sep 16 02:46:24.101183 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:24.100771    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk" event={"ID":"5456253d-6e0b-4915-893a-314d8587e8bb","Type":"ContainerDied","Data":"ce3ad7e9414b46847e0219b54c1432a8c18c7d7da44522c6ebb0b70a2da2afbb"}
Sep 16 02:46:24.101183 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:24.100836    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk" event={"ID":"5456253d-6e0b-4915-893a-314d8587e8bb","Type":"ContainerDied","Data":"654b19b9d6bb0fbcd3f80abe0f99572097cf6701a53c5a387b031c3048ec1bfc"}
Sep 16 02:46:24.101183 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:24.100867    2565 scope.go:117] "RemoveContainer" containerID="ce3ad7e9414b46847e0219b54c1432a8c18c7d7da44522c6ebb0b70a2da2afbb"
Sep 16 02:46:24.102587 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:24.102564    2565 generic.go:356] "Generic (PLEG): container finished" podID="a9a5f1e8-a128-4d16-9fba-441d733ed910" containerID="689575a1d30543927eafc5bd255db2cb5aa1b7a04626595da09bedde6114bd70" exitCode=0
Sep 16 02:46:24.102689 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:24.102615    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks"
Sep 16 02:46:24.102727 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:24.102615    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks" event={"ID":"a9a5f1e8-a128-4d16-9fba-441d733ed910","Type":"ContainerDied","Data":"689575a1d30543927eafc5bd255db2cb5aa1b7a04626595da09bedde6114bd70"}
Sep 16 02:46:24.102763 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:24.102734    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks" event={"ID":"a9a5f1e8-a128-4d16-9fba-441d733ed910","Type":"ContainerDied","Data":"4b37805b7cbace33ce4cb4ca7d4cc94836d5407e572df9bb4973c3ea02bfe809"}
Sep 16 02:46:24.111482 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:24.111464    2565 scope.go:117] "RemoveContainer" containerID="ce3ad7e9414b46847e0219b54c1432a8c18c7d7da44522c6ebb0b70a2da2afbb"
Sep 16 02:46:24.111969 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:46:24.111725    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce3ad7e9414b46847e0219b54c1432a8c18c7d7da44522c6ebb0b70a2da2afbb\": container with ID starting with ce3ad7e9414b46847e0219b54c1432a8c18c7d7da44522c6ebb0b70a2da2afbb not found: ID does not exist" containerID="ce3ad7e9414b46847e0219b54c1432a8c18c7d7da44522c6ebb0b70a2da2afbb"
Sep 16 02:46:24.111969 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:24.111755    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce3ad7e9414b46847e0219b54c1432a8c18c7d7da44522c6ebb0b70a2da2afbb"} err="failed to get container status \"ce3ad7e9414b46847e0219b54c1432a8c18c7d7da44522c6ebb0b70a2da2afbb\": rpc error: code = NotFound desc = could not find container \"ce3ad7e9414b46847e0219b54c1432a8c18c7d7da44522c6ebb0b70a2da2afbb\": container with ID starting with ce3ad7e9414b46847e0219b54c1432a8c18c7d7da44522c6ebb0b70a2da2afbb not found: ID does not exist"
Sep 16 02:46:24.111969 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:24.111777    2565 scope.go:117] "RemoveContainer" containerID="689575a1d30543927eafc5bd255db2cb5aa1b7a04626595da09bedde6114bd70"
Sep 16 02:46:24.120480 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:24.120455    2565 scope.go:117] "RemoveContainer" containerID="689575a1d30543927eafc5bd255db2cb5aa1b7a04626595da09bedde6114bd70"
Sep 16 02:46:24.120967 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:46:24.120944    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"689575a1d30543927eafc5bd255db2cb5aa1b7a04626595da09bedde6114bd70\": container with ID starting with 689575a1d30543927eafc5bd255db2cb5aa1b7a04626595da09bedde6114bd70 not found: ID does not exist" containerID="689575a1d30543927eafc5bd255db2cb5aa1b7a04626595da09bedde6114bd70"
Sep 16 02:46:24.121056 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:24.120969    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"689575a1d30543927eafc5bd255db2cb5aa1b7a04626595da09bedde6114bd70"} err="failed to get container status \"689575a1d30543927eafc5bd255db2cb5aa1b7a04626595da09bedde6114bd70\": rpc error: code = NotFound desc = could not find container \"689575a1d30543927eafc5bd255db2cb5aa1b7a04626595da09bedde6114bd70\": container with ID starting with 689575a1d30543927eafc5bd255db2cb5aa1b7a04626595da09bedde6114bd70 not found: ID does not exist"
Sep 16 02:46:24.129327 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:24.129304    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk"]
Sep 16 02:46:24.132540 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:24.132493    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk"]
Sep 16 02:46:24.142746 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:24.142622    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks"]
Sep 16 02:46:24.145940 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:24.145921    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks"]
Sep 16 02:46:24.391870 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:24.391783    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5456253d-6e0b-4915-893a-314d8587e8bb" path="/var/lib/kubelet/pods/5456253d-6e0b-4915-893a-314d8587e8bb/volumes"
Sep 16 02:46:24.392185 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:24.392171    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9a5f1e8-a128-4d16-9fba-441d733ed910" path="/var/lib/kubelet/pods/a9a5f1e8-a128-4d16-9fba-441d733ed910/volumes"
Sep 16 02:46:24.700296 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:24.700261    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:25.329978 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:25.329930    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:25.438654 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:25.438599    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:25.538713 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:25.538682    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:25.714546 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:25.714498    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:25.959794 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:25.959761    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:26.217034 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:26.217004    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:26.317398 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:26.317344    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:26.728830 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:26.728796    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:27.332604 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:27.332572    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:28.701958 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:28.701909    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:29.445264 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:29.445233    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:29.910772 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:29.910742    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:30.011196 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:30.011167    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:30.138021 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:30.137984    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"]
Sep 16 02:46:30.138307 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:30.138272    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf" podUID="25f33366-06aa-4bd8-8dfb-daeafa572575" containerName="istio-proxy" containerID="cri-o://a62e14a128c6eaab2c860e19b5ee712c9e799887972cfaaf82964d12805fd6b3" gracePeriod=30
Sep 16 02:46:30.152044 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:30.152020    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:30.416278 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:30.416244    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:30.465063 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:30.465029    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-fe9d17-hs2vc"]
Sep 16 02:46:30.465736 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:30.465715    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9a5f1e8-a128-4d16-9fba-441d733ed910" containerName="payload-processing"
Sep 16 02:46:30.465811 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:30.465739    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9a5f1e8-a128-4d16-9fba-441d733ed910" containerName="payload-processing"
Sep 16 02:46:30.465811 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:30.465761    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5456253d-6e0b-4915-893a-314d8587e8bb" containerName="payload-pre-processing"
Sep 16 02:46:30.465811 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:30.465777    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5456253d-6e0b-4915-893a-314d8587e8bb" containerName="payload-pre-processing"
Sep 16 02:46:30.465811 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:30.465801    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a400237-edbe-4e99-b16d-1c7668e36cc7" containerName="revoke-keys"
Sep 16 02:46:30.465811 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:30.465809    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a400237-edbe-4e99-b16d-1c7668e36cc7" containerName="revoke-keys"
Sep 16 02:46:30.465970 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:30.465823    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2e57e83-5d84-43d7-ab16-157f12082dfc" containerName="payload-pre-processing"
Sep 16 02:46:30.465970 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:30.465832    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2e57e83-5d84-43d7-ab16-157f12082dfc" containerName="payload-pre-processing"
Sep 16 02:46:30.465970 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:30.465930    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9a5f1e8-a128-4d16-9fba-441d733ed910" containerName="payload-processing"
Sep 16 02:46:30.465970 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:30.465941    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2e57e83-5d84-43d7-ab16-157f12082dfc" containerName="payload-pre-processing"
Sep 16 02:46:30.465970 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:30.465955    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5456253d-6e0b-4915-893a-314d8587e8bb" containerName="payload-pre-processing"
Sep 16 02:46:30.465970 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:30.465964    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a400237-edbe-4e99-b16d-1c7668e36cc7" containerName="revoke-keys"
Sep 16 02:46:30.471011 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:30.470986    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-fe9d17-hs2vc"
Sep 16 02:46:30.473614 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:30.473586    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-fe9d17-hs2vc"]
Sep 16 02:46:30.473754 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:30.473727    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w8hnp\""
Sep 16 02:46:30.473754 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:30.473746    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 02:46:30.561037 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:30.561002    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/765a9485-ef6a-44ec-9e72-15d152a551bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w1-fe9d17-hs2vc\" (UID: \"765a9485-ef6a-44ec-9e72-15d152a551bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-fe9d17-hs2vc"
Sep 16 02:46:30.661991 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:30.661954    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/765a9485-ef6a-44ec-9e72-15d152a551bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w1-fe9d17-hs2vc\" (UID: \"765a9485-ef6a-44ec-9e72-15d152a551bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-fe9d17-hs2vc"
Sep 16 02:46:30.662564 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:30.662546    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/765a9485-ef6a-44ec-9e72-15d152a551bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w1-fe9d17-hs2vc\" (UID: \"765a9485-ef6a-44ec-9e72-15d152a551bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-fe9d17-hs2vc"
Sep 16 02:46:30.785105 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:30.785013    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-fe9d17-hs2vc"
Sep 16 02:46:31.057009 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:31.056983    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-fe9d17-hs2vc"]
Sep 16 02:46:31.058669 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:46:31.058640    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod765a9485_ef6a_44ec_9e72_15d152a551bc.slice/crio-2c0246762a3f5f3f7df500e97efebdf73f3a31dbfbfac080f061ccb79d262f5e WatchSource:0}: Error finding container 2c0246762a3f5f3f7df500e97efebdf73f3a31dbfbfac080f061ccb79d262f5e: Status 404 returned error can't find the container with id 2c0246762a3f5f3f7df500e97efebdf73f3a31dbfbfac080f061ccb79d262f5e
Sep 16 02:46:31.153623 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:31.153597    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-fe9d17-hs2vc" event={"ID":"765a9485-ef6a-44ec-9e72-15d152a551bc","Type":"ContainerStarted","Data":"2c0246762a3f5f3f7df500e97efebdf73f3a31dbfbfac080f061ccb79d262f5e"}
Sep 16 02:46:31.322513 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:31.322433    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:31.918870 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:31.918832    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:32.162518 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:32.162486    2565 generic.go:356] "Generic (PLEG): container finished" podID="765a9485-ef6a-44ec-9e72-15d152a551bc" containerID="578b1030f7d8c3e51c3ee3805a9570f9f771795d9d794ab953913c202d79d162" exitCode=0
Sep 16 02:46:32.162888 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:32.162566    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-fe9d17-hs2vc" event={"ID":"765a9485-ef6a-44ec-9e72-15d152a551bc","Type":"ContainerDied","Data":"578b1030f7d8c3e51c3ee3805a9570f9f771795d9d794ab953913c202d79d162"}
Sep 16 02:46:32.390269 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:32.390229    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:32.515553 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:32.515457    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:33.247564 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:33.247533    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:33.316053 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:33.315758    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-fe9d17-hs2vc"
Sep 16 02:46:33.491732 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:33.491642    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/765a9485-ef6a-44ec-9e72-15d152a551bc-maas-api-service-ca\") pod \"765a9485-ef6a-44ec-9e72-15d152a551bc\" (UID: \"765a9485-ef6a-44ec-9e72-15d152a551bc\") "
Sep 16 02:46:33.492039 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:33.492004    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/765a9485-ef6a-44ec-9e72-15d152a551bc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "765a9485-ef6a-44ec-9e72-15d152a551bc" (UID: "765a9485-ef6a-44ec-9e72-15d152a551bc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:46:33.492160 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:33.492146    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/765a9485-ef6a-44ec-9e72-15d152a551bc-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:33.845373 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:33.845265    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:34.178342 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:34.178314    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-fe9d17-hs2vc"
Sep 16 02:46:34.178548 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:34.178351    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-fe9d17-hs2vc" event={"ID":"765a9485-ef6a-44ec-9e72-15d152a551bc","Type":"ContainerDied","Data":"2c0246762a3f5f3f7df500e97efebdf73f3a31dbfbfac080f061ccb79d262f5e"}
Sep 16 02:46:34.178548 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:34.178433    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c0246762a3f5f3f7df500e97efebdf73f3a31dbfbfac080f061ccb79d262f5e"
Sep 16 02:46:34.642541 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:34.642449    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:35.410063 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:35.410038    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:46:35.511072 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:35.511041    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25f33366-06aa-4bd8-8dfb-daeafa572575-istio-data\") pod \"25f33366-06aa-4bd8-8dfb-daeafa572575\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") "
Sep 16 02:46:35.511265 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:35.511120    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25f33366-06aa-4bd8-8dfb-daeafa572575-istio-podinfo\") pod \"25f33366-06aa-4bd8-8dfb-daeafa572575\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") "
Sep 16 02:46:35.511265 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:35.511153    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25f33366-06aa-4bd8-8dfb-daeafa572575-workload-certs\") pod \"25f33366-06aa-4bd8-8dfb-daeafa572575\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") "
Sep 16 02:46:35.511265 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:35.511189    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25f33366-06aa-4bd8-8dfb-daeafa572575-istiod-ca-cert\") pod \"25f33366-06aa-4bd8-8dfb-daeafa572575\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") "
Sep 16 02:46:35.511460 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:35.511327    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25f33366-06aa-4bd8-8dfb-daeafa572575-istio-token\") pod \"25f33366-06aa-4bd8-8dfb-daeafa572575\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") "
Sep 16 02:46:35.511460 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:35.511424    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94h75\" (UniqueName: \"kubernetes.io/projected/25f33366-06aa-4bd8-8dfb-daeafa572575-kube-api-access-94h75\") pod \"25f33366-06aa-4bd8-8dfb-daeafa572575\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") "
Sep 16 02:46:35.511460 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:35.511397    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25f33366-06aa-4bd8-8dfb-daeafa572575-istio-data" (OuterVolumeSpecName: "istio-data") pod "25f33366-06aa-4bd8-8dfb-daeafa572575" (UID: "25f33366-06aa-4bd8-8dfb-daeafa572575"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:46:35.511460 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:35.511454    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25f33366-06aa-4bd8-8dfb-daeafa572575-istio-envoy\") pod \"25f33366-06aa-4bd8-8dfb-daeafa572575\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") "
Sep 16 02:46:35.511669 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:35.511485    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25f33366-06aa-4bd8-8dfb-daeafa572575-workload-socket\") pod \"25f33366-06aa-4bd8-8dfb-daeafa572575\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") "
Sep 16 02:46:35.511669 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:35.511492    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25f33366-06aa-4bd8-8dfb-daeafa572575-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "25f33366-06aa-4bd8-8dfb-daeafa572575" (UID: "25f33366-06aa-4bd8-8dfb-daeafa572575"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:46:35.511669 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:35.511521    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25f33366-06aa-4bd8-8dfb-daeafa572575-credential-socket\") pod \"25f33366-06aa-4bd8-8dfb-daeafa572575\" (UID: \"25f33366-06aa-4bd8-8dfb-daeafa572575\") "
Sep 16 02:46:35.511669 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:35.511612    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25f33366-06aa-4bd8-8dfb-daeafa572575-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "25f33366-06aa-4bd8-8dfb-daeafa572575" (UID: "25f33366-06aa-4bd8-8dfb-daeafa572575"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:46:35.512837 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:35.512080    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25f33366-06aa-4bd8-8dfb-daeafa572575-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:35.512837 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:35.512107    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25f33366-06aa-4bd8-8dfb-daeafa572575-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:35.512837 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:35.512122    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25f33366-06aa-4bd8-8dfb-daeafa572575-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:35.512837 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:35.512240    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25f33366-06aa-4bd8-8dfb-daeafa572575-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "25f33366-06aa-4bd8-8dfb-daeafa572575" (UID: "25f33366-06aa-4bd8-8dfb-daeafa572575"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:46:35.512837 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:35.512466    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25f33366-06aa-4bd8-8dfb-daeafa572575-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "25f33366-06aa-4bd8-8dfb-daeafa572575" (UID: "25f33366-06aa-4bd8-8dfb-daeafa572575"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:46:35.514259 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:35.514224    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/25f33366-06aa-4bd8-8dfb-daeafa572575-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "25f33366-06aa-4bd8-8dfb-daeafa572575" (UID: "25f33366-06aa-4bd8-8dfb-daeafa572575"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 02:46:35.514407 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:35.514326    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25f33366-06aa-4bd8-8dfb-daeafa572575-istio-token" (OuterVolumeSpecName: "istio-token") pod "25f33366-06aa-4bd8-8dfb-daeafa572575" (UID: "25f33366-06aa-4bd8-8dfb-daeafa572575"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:46:35.514674 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:35.514653    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25f33366-06aa-4bd8-8dfb-daeafa572575-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "25f33366-06aa-4bd8-8dfb-daeafa572575" (UID: "25f33366-06aa-4bd8-8dfb-daeafa572575"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:46:35.514804 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:35.514787    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25f33366-06aa-4bd8-8dfb-daeafa572575-kube-api-access-94h75" (OuterVolumeSpecName: "kube-api-access-94h75") pod "25f33366-06aa-4bd8-8dfb-daeafa572575" (UID: "25f33366-06aa-4bd8-8dfb-daeafa572575"). InnerVolumeSpecName "kube-api-access-94h75". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:46:35.613054 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:35.613016    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25f33366-06aa-4bd8-8dfb-daeafa572575-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:35.613054 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:35.613049    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94h75\" (UniqueName: \"kubernetes.io/projected/25f33366-06aa-4bd8-8dfb-daeafa572575-kube-api-access-94h75\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:35.613054 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:35.613063    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25f33366-06aa-4bd8-8dfb-daeafa572575-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:35.613290 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:35.613074    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25f33366-06aa-4bd8-8dfb-daeafa572575-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:35.613290 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:35.613086    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25f33366-06aa-4bd8-8dfb-daeafa572575-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:35.613290 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:35.613097    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25f33366-06aa-4bd8-8dfb-daeafa572575-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:36.192540 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:36.192509    2565 generic.go:356] "Generic (PLEG): container finished" podID="25f33366-06aa-4bd8-8dfb-daeafa572575" containerID="a62e14a128c6eaab2c860e19b5ee712c9e799887972cfaaf82964d12805fd6b3" exitCode=0
Sep 16 02:46:36.192952 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:36.192558    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"
Sep 16 02:46:36.192952 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:36.192590    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf" event={"ID":"25f33366-06aa-4bd8-8dfb-daeafa572575","Type":"ContainerDied","Data":"a62e14a128c6eaab2c860e19b5ee712c9e799887972cfaaf82964d12805fd6b3"}
Sep 16 02:46:36.192952 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:36.192646    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf" event={"ID":"25f33366-06aa-4bd8-8dfb-daeafa572575","Type":"ContainerDied","Data":"6bf94f4e8354a9627f7e1df3a61e69b8660685c01964ed1307497303984bfc17"}
Sep 16 02:46:36.192952 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:36.192668    2565 scope.go:117] "RemoveContainer" containerID="a62e14a128c6eaab2c860e19b5ee712c9e799887972cfaaf82964d12805fd6b3"
Sep 16 02:46:36.202896 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:36.202878    2565 scope.go:117] "RemoveContainer" containerID="401f2466a16ef212abd62512e3a32e066a4d2f12e3322e1f699b69d35a2d73ad"
Sep 16 02:46:36.212531 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:36.212509    2565 scope.go:117] "RemoveContainer" containerID="a62e14a128c6eaab2c860e19b5ee712c9e799887972cfaaf82964d12805fd6b3"
Sep 16 02:46:36.212965 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:46:36.212941    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a62e14a128c6eaab2c860e19b5ee712c9e799887972cfaaf82964d12805fd6b3\": container with ID starting with a62e14a128c6eaab2c860e19b5ee712c9e799887972cfaaf82964d12805fd6b3 not found: ID does not exist" containerID="a62e14a128c6eaab2c860e19b5ee712c9e799887972cfaaf82964d12805fd6b3"
Sep 16 02:46:36.213132 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:36.212977    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a62e14a128c6eaab2c860e19b5ee712c9e799887972cfaaf82964d12805fd6b3"} err="failed to get container status \"a62e14a128c6eaab2c860e19b5ee712c9e799887972cfaaf82964d12805fd6b3\": rpc error: code = NotFound desc = could not find container \"a62e14a128c6eaab2c860e19b5ee712c9e799887972cfaaf82964d12805fd6b3\": container with ID starting with a62e14a128c6eaab2c860e19b5ee712c9e799887972cfaaf82964d12805fd6b3 not found: ID does not exist"
Sep 16 02:46:36.213132 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:36.213003    2565 scope.go:117] "RemoveContainer" containerID="401f2466a16ef212abd62512e3a32e066a4d2f12e3322e1f699b69d35a2d73ad"
Sep 16 02:46:36.213851 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:46:36.213820    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"401f2466a16ef212abd62512e3a32e066a4d2f12e3322e1f699b69d35a2d73ad\": container with ID starting with 401f2466a16ef212abd62512e3a32e066a4d2f12e3322e1f699b69d35a2d73ad not found: ID does not exist" containerID="401f2466a16ef212abd62512e3a32e066a4d2f12e3322e1f699b69d35a2d73ad"
Sep 16 02:46:36.213964 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:36.213859    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"401f2466a16ef212abd62512e3a32e066a4d2f12e3322e1f699b69d35a2d73ad"} err="failed to get container status \"401f2466a16ef212abd62512e3a32e066a4d2f12e3322e1f699b69d35a2d73ad\": rpc error: code = NotFound desc = could not find container \"401f2466a16ef212abd62512e3a32e066a4d2f12e3322e1f699b69d35a2d73ad\": container with ID starting with 401f2466a16ef212abd62512e3a32e066a4d2f12e3322e1f699b69d35a2d73ad not found: ID does not exist"
Sep 16 02:46:36.215571 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:36.215556    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"]
Sep 16 02:46:36.218915 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:36.218895    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf"]
Sep 16 02:46:36.392339 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:36.392305    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25f33366-06aa-4bd8-8dfb-daeafa572575" path="/var/lib/kubelet/pods/25f33366-06aa-4bd8-8dfb-daeafa572575/volumes"
Sep 16 02:46:39.222055 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:39.222006    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:40.744837 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:40.744800    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:41.284982 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:41.284950    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q"]
Sep 16 02:46:41.285247 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:41.285204    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q" podUID="fd863ae8-6b3d-4c78-95e4-2251d4aacc26" containerName="payload-pre-processing" containerID="cri-o://f744360faf5519ab85b36159adde6ea15edafe7b96d65a27ee46e3d79c4a6a6d" gracePeriod=30
Sep 16 02:46:41.344859 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:41.344795    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:41.427238 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:41.427192    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-fe9d17-hs2vc"]
Sep 16 02:46:41.429979 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:41.429952    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-fe9d17-hs2vc"]
Sep 16 02:46:41.492507 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:41.492477    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:41.549734 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:41.549690    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:41.577565 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:41.577541    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q"
Sep 16 02:46:41.772898 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:41.772860    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd863ae8-6b3d-4c78-95e4-2251d4aacc26-plugins-config-volume\") pod \"fd863ae8-6b3d-4c78-95e4-2251d4aacc26\" (UID: \"fd863ae8-6b3d-4c78-95e4-2251d4aacc26\") "
Sep 16 02:46:41.773284 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:41.772922    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcwwj\" (UniqueName: \"kubernetes.io/projected/fd863ae8-6b3d-4c78-95e4-2251d4aacc26-kube-api-access-dcwwj\") pod \"fd863ae8-6b3d-4c78-95e4-2251d4aacc26\" (UID: \"fd863ae8-6b3d-4c78-95e4-2251d4aacc26\") "
Sep 16 02:46:41.773284 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:41.773221    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd863ae8-6b3d-4c78-95e4-2251d4aacc26-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fd863ae8-6b3d-4c78-95e4-2251d4aacc26" (UID: "fd863ae8-6b3d-4c78-95e4-2251d4aacc26"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:46:41.775029 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:41.774995    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd863ae8-6b3d-4c78-95e4-2251d4aacc26-kube-api-access-dcwwj" (OuterVolumeSpecName: "kube-api-access-dcwwj") pod "fd863ae8-6b3d-4c78-95e4-2251d4aacc26" (UID: "fd863ae8-6b3d-4c78-95e4-2251d4aacc26"). InnerVolumeSpecName "kube-api-access-dcwwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:46:41.779316 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:41.779288    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:41.874747 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:41.874670    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd863ae8-6b3d-4c78-95e4-2251d4aacc26-plugins-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:41.874747 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:41.874698    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcwwj\" (UniqueName: \"kubernetes.io/projected/fd863ae8-6b3d-4c78-95e4-2251d4aacc26-kube-api-access-dcwwj\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:41.880550 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:41.880518    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:42.236883 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:42.236844    2565 generic.go:356] "Generic (PLEG): container finished" podID="fd863ae8-6b3d-4c78-95e4-2251d4aacc26" containerID="f744360faf5519ab85b36159adde6ea15edafe7b96d65a27ee46e3d79c4a6a6d" exitCode=0
Sep 16 02:46:42.237057 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:42.236905    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q"
Sep 16 02:46:42.237057 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:42.236930    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q" event={"ID":"fd863ae8-6b3d-4c78-95e4-2251d4aacc26","Type":"ContainerDied","Data":"f744360faf5519ab85b36159adde6ea15edafe7b96d65a27ee46e3d79c4a6a6d"}
Sep 16 02:46:42.237057 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:42.237010    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q" event={"ID":"fd863ae8-6b3d-4c78-95e4-2251d4aacc26","Type":"ContainerDied","Data":"c7f5837ceb7d9529c720d9b98321ea9a70c57982dc84f245244a10a82ce68455"}
Sep 16 02:46:42.237057 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:42.237033    2565 scope.go:117] "RemoveContainer" containerID="f744360faf5519ab85b36159adde6ea15edafe7b96d65a27ee46e3d79c4a6a6d"
Sep 16 02:46:42.247403 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:42.247351    2565 scope.go:117] "RemoveContainer" containerID="f744360faf5519ab85b36159adde6ea15edafe7b96d65a27ee46e3d79c4a6a6d"
Sep 16 02:46:42.247673 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:46:42.247653    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f744360faf5519ab85b36159adde6ea15edafe7b96d65a27ee46e3d79c4a6a6d\": container with ID starting with f744360faf5519ab85b36159adde6ea15edafe7b96d65a27ee46e3d79c4a6a6d not found: ID does not exist" containerID="f744360faf5519ab85b36159adde6ea15edafe7b96d65a27ee46e3d79c4a6a6d"
Sep 16 02:46:42.247721 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:42.247682    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f744360faf5519ab85b36159adde6ea15edafe7b96d65a27ee46e3d79c4a6a6d"} err="failed to get container status \"f744360faf5519ab85b36159adde6ea15edafe7b96d65a27ee46e3d79c4a6a6d\": rpc error: code = NotFound desc = could not find container \"f744360faf5519ab85b36159adde6ea15edafe7b96d65a27ee46e3d79c4a6a6d\": container with ID starting with f744360faf5519ab85b36159adde6ea15edafe7b96d65a27ee46e3d79c4a6a6d not found: ID does not exist"
Sep 16 02:46:42.258790 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:42.258764    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q"]
Sep 16 02:46:42.262702 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:42.262669    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q"]
Sep 16 02:46:42.391629 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:42.391593    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="765a9485-ef6a-44ec-9e72-15d152a551bc" path="/var/lib/kubelet/pods/765a9485-ef6a-44ec-9e72-15d152a551bc/volumes"
Sep 16 02:46:42.391951 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:42.391938    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd863ae8-6b3d-4c78-95e4-2251d4aacc26" path="/var/lib/kubelet/pods/fd863ae8-6b3d-4c78-95e4-2251d4aacc26/volumes"
Sep 16 02:46:42.713878 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:42.713844    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:43.330520 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:43.330482    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:43.384345 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:43.384308    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm"]
Sep 16 02:46:43.384597 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:43.384569    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm" podUID="4eefb51d-070f-419b-af82-4a55d71da636" containerName="payload-processing" containerID="cri-o://445fdb60851ae0e374adb333065890ee65f49ba44215a873bfd2447769d0c3d4" gracePeriod=30
Sep 16 02:46:43.392033 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:43.391679    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6"]
Sep 16 02:46:43.392033 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:43.391881    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6" podUID="c52a7f8f-53ca-41f9-9f70-18a598d5ea00" containerName="payload-pre-processing" containerID="cri-o://98c00e8661ee80e05ded03d7701456cea13d043f366cb191c7d4875480d6adb3" gracePeriod=30
Sep 16 02:46:43.416246 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:43.416215    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:43.517102 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:43.517064    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:43.616963 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:43.616917    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:43.650646 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:43.650624    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm"
Sep 16 02:46:43.677581 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:43.677549    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6"
Sep 16 02:46:43.682168 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:43.682139    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:43.695450 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:43.695426    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4eefb51d-070f-419b-af82-4a55d71da636-plugins-config-volume\") pod \"4eefb51d-070f-419b-af82-4a55d71da636\" (UID: \"4eefb51d-070f-419b-af82-4a55d71da636\") "
Sep 16 02:46:43.695612 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:43.695479    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c52a7f8f-53ca-41f9-9f70-18a598d5ea00-plugins-config-volume\") pod \"c52a7f8f-53ca-41f9-9f70-18a598d5ea00\" (UID: \"c52a7f8f-53ca-41f9-9f70-18a598d5ea00\") "
Sep 16 02:46:43.695612 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:43.695550    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fz97\" (UniqueName: \"kubernetes.io/projected/c52a7f8f-53ca-41f9-9f70-18a598d5ea00-kube-api-access-9fz97\") pod \"c52a7f8f-53ca-41f9-9f70-18a598d5ea00\" (UID: \"c52a7f8f-53ca-41f9-9f70-18a598d5ea00\") "
Sep 16 02:46:43.695745 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:43.695626    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4n6js\" (UniqueName: \"kubernetes.io/projected/4eefb51d-070f-419b-af82-4a55d71da636-kube-api-access-4n6js\") pod \"4eefb51d-070f-419b-af82-4a55d71da636\" (UID: \"4eefb51d-070f-419b-af82-4a55d71da636\") "
Sep 16 02:46:43.696028 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:43.695829    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4eefb51d-070f-419b-af82-4a55d71da636-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4eefb51d-070f-419b-af82-4a55d71da636" (UID: "4eefb51d-070f-419b-af82-4a55d71da636"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:46:43.697619 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:43.697546    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4eefb51d-070f-419b-af82-4a55d71da636-plugins-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:43.699264 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:43.699221    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c52a7f8f-53ca-41f9-9f70-18a598d5ea00-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c52a7f8f-53ca-41f9-9f70-18a598d5ea00" (UID: "c52a7f8f-53ca-41f9-9f70-18a598d5ea00"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:46:43.700845 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:43.700811    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c52a7f8f-53ca-41f9-9f70-18a598d5ea00-kube-api-access-9fz97" (OuterVolumeSpecName: "kube-api-access-9fz97") pod "c52a7f8f-53ca-41f9-9f70-18a598d5ea00" (UID: "c52a7f8f-53ca-41f9-9f70-18a598d5ea00"). InnerVolumeSpecName "kube-api-access-9fz97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:46:43.705456 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:43.702435    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4eefb51d-070f-419b-af82-4a55d71da636-kube-api-access-4n6js" (OuterVolumeSpecName: "kube-api-access-4n6js") pod "4eefb51d-070f-419b-af82-4a55d71da636" (UID: "4eefb51d-070f-419b-af82-4a55d71da636"). InnerVolumeSpecName "kube-api-access-4n6js". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:46:43.799057 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:43.799020    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c52a7f8f-53ca-41f9-9f70-18a598d5ea00-plugins-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:43.799057 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:43.799050    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fz97\" (UniqueName: \"kubernetes.io/projected/c52a7f8f-53ca-41f9-9f70-18a598d5ea00-kube-api-access-9fz97\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:43.799057 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:43.799061    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4n6js\" (UniqueName: \"kubernetes.io/projected/4eefb51d-070f-419b-af82-4a55d71da636-kube-api-access-4n6js\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:43.950482 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:43.950449    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:44.254948 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:44.254864    2565 generic.go:356] "Generic (PLEG): container finished" podID="4eefb51d-070f-419b-af82-4a55d71da636" containerID="445fdb60851ae0e374adb333065890ee65f49ba44215a873bfd2447769d0c3d4" exitCode=0
Sep 16 02:46:44.254948 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:44.254908    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm"
Sep 16 02:46:44.255150 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:44.254949    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm" event={"ID":"4eefb51d-070f-419b-af82-4a55d71da636","Type":"ContainerDied","Data":"445fdb60851ae0e374adb333065890ee65f49ba44215a873bfd2447769d0c3d4"}
Sep 16 02:46:44.255150 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:44.255010    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm" event={"ID":"4eefb51d-070f-419b-af82-4a55d71da636","Type":"ContainerDied","Data":"1d474acd65e0acb3fa880fe1196a4e00365672e190123ea7eca77b3241639a1e"}
Sep 16 02:46:44.255150 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:44.255039    2565 scope.go:117] "RemoveContainer" containerID="445fdb60851ae0e374adb333065890ee65f49ba44215a873bfd2447769d0c3d4"
Sep 16 02:46:44.256572 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:44.256550    2565 generic.go:356] "Generic (PLEG): container finished" podID="c52a7f8f-53ca-41f9-9f70-18a598d5ea00" containerID="98c00e8661ee80e05ded03d7701456cea13d043f366cb191c7d4875480d6adb3" exitCode=0
Sep 16 02:46:44.256646 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:44.256599    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6"
Sep 16 02:46:44.256646 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:44.256620    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6" event={"ID":"c52a7f8f-53ca-41f9-9f70-18a598d5ea00","Type":"ContainerDied","Data":"98c00e8661ee80e05ded03d7701456cea13d043f366cb191c7d4875480d6adb3"}
Sep 16 02:46:44.256734 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:44.256664    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6" event={"ID":"c52a7f8f-53ca-41f9-9f70-18a598d5ea00","Type":"ContainerDied","Data":"4b48e0671c09d9c6044e6a9483763ac3adf20f85a6e01b0474dd027e00ea5a3c"}
Sep 16 02:46:44.269182 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:44.265749    2565 scope.go:117] "RemoveContainer" containerID="445fdb60851ae0e374adb333065890ee65f49ba44215a873bfd2447769d0c3d4"
Sep 16 02:46:44.269182 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:46:44.266718    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"445fdb60851ae0e374adb333065890ee65f49ba44215a873bfd2447769d0c3d4\": container with ID starting with 445fdb60851ae0e374adb333065890ee65f49ba44215a873bfd2447769d0c3d4 not found: ID does not exist" containerID="445fdb60851ae0e374adb333065890ee65f49ba44215a873bfd2447769d0c3d4"
Sep 16 02:46:44.269182 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:44.266754    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"445fdb60851ae0e374adb333065890ee65f49ba44215a873bfd2447769d0c3d4"} err="failed to get container status \"445fdb60851ae0e374adb333065890ee65f49ba44215a873bfd2447769d0c3d4\": rpc error: code = NotFound desc = could not find container \"445fdb60851ae0e374adb333065890ee65f49ba44215a873bfd2447769d0c3d4\": container with ID starting with 445fdb60851ae0e374adb333065890ee65f49ba44215a873bfd2447769d0c3d4 not found: ID does not exist"
Sep 16 02:46:44.269182 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:44.266777    2565 scope.go:117] "RemoveContainer" containerID="98c00e8661ee80e05ded03d7701456cea13d043f366cb191c7d4875480d6adb3"
Sep 16 02:46:44.271886 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:44.271858    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:44.278971 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:44.278955    2565 scope.go:117] "RemoveContainer" containerID="98c00e8661ee80e05ded03d7701456cea13d043f366cb191c7d4875480d6adb3"
Sep 16 02:46:44.279235 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:46:44.279211    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98c00e8661ee80e05ded03d7701456cea13d043f366cb191c7d4875480d6adb3\": container with ID starting with 98c00e8661ee80e05ded03d7701456cea13d043f366cb191c7d4875480d6adb3 not found: ID does not exist" containerID="98c00e8661ee80e05ded03d7701456cea13d043f366cb191c7d4875480d6adb3"
Sep 16 02:46:44.279320 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:44.279239    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98c00e8661ee80e05ded03d7701456cea13d043f366cb191c7d4875480d6adb3"} err="failed to get container status \"98c00e8661ee80e05ded03d7701456cea13d043f366cb191c7d4875480d6adb3\": rpc error: code = NotFound desc = could not find container \"98c00e8661ee80e05ded03d7701456cea13d043f366cb191c7d4875480d6adb3\": container with ID starting with 98c00e8661ee80e05ded03d7701456cea13d043f366cb191c7d4875480d6adb3 not found: ID does not exist"
Sep 16 02:46:44.285999 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:44.285976    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm"]
Sep 16 02:46:44.289815 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:44.289795    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm"]
Sep 16 02:46:44.300480 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:44.300460    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6"]
Sep 16 02:46:44.305627 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:44.305606    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6"]
Sep 16 02:46:44.394096 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:44.394064    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4eefb51d-070f-419b-af82-4a55d71da636" path="/var/lib/kubelet/pods/4eefb51d-070f-419b-af82-4a55d71da636/volumes"
Sep 16 02:46:44.394519 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:44.394504    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c52a7f8f-53ca-41f9-9f70-18a598d5ea00" path="/var/lib/kubelet/pods/c52a7f8f-53ca-41f9-9f70-18a598d5ea00/volumes"
Sep 16 02:46:45.138309 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:45.138272    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:45.754390 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:45.754341    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:46.335962 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:46.335911    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:47.448778 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:47.448742    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:47.549265 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:47.549232    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:47.683989 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:47.683952    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"]
Sep 16 02:46:47.684268 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:47.684199    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4" podUID="6529c04b-957f-4eb3-adb0-8e0c34c5908c" containerName="istio-proxy" containerID="cri-o://375190791ba7c498a76f2c521c33bc638f7fa24a8f4cc25d97f5cf8eb676c860" gracePeriod=30
Sep 16 02:46:47.704609 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:47.704530    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:48.145276 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:48.145160    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:48.839410 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:48.839356    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 02:46:48.839865 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:48.839447    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4" podUID="6529c04b-957f-4eb3-adb0-8e0c34c5908c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 02:46:48.842236 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:48.842212    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:49.043929 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:49.043883    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:49.535092 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:49.535052    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:50.222275 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:50.222227    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:50.839522 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:50.839477    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:52.945744 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:52.945691    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:46:52.988687 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:52.988656    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6529c04b-957f-4eb3-adb0-8e0c34c5908c-istio-envoy\") pod \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") "
Sep 16 02:46:52.988819 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:52.988703    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6529c04b-957f-4eb3-adb0-8e0c34c5908c-workload-socket\") pod \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") "
Sep 16 02:46:52.988819 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:52.988732    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6529c04b-957f-4eb3-adb0-8e0c34c5908c-istio-podinfo\") pod \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") "
Sep 16 02:46:52.988819 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:52.988796    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6529c04b-957f-4eb3-adb0-8e0c34c5908c-credential-socket\") pod \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") "
Sep 16 02:46:52.989006 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:52.988843    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6cx6\" (UniqueName: \"kubernetes.io/projected/6529c04b-957f-4eb3-adb0-8e0c34c5908c-kube-api-access-g6cx6\") pod \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") "
Sep 16 02:46:52.989006 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:52.988886    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6529c04b-957f-4eb3-adb0-8e0c34c5908c-istiod-ca-cert\") pod \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") "
Sep 16 02:46:52.989006 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:52.988922    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6529c04b-957f-4eb3-adb0-8e0c34c5908c-istio-data\") pod \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") "
Sep 16 02:46:52.989006 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:52.988988    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6529c04b-957f-4eb3-adb0-8e0c34c5908c-istio-token\") pod \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") "
Sep 16 02:46:52.989006 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:52.988991    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6529c04b-957f-4eb3-adb0-8e0c34c5908c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6529c04b-957f-4eb3-adb0-8e0c34c5908c" (UID: "6529c04b-957f-4eb3-adb0-8e0c34c5908c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:46:52.989263 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:52.989022    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6529c04b-957f-4eb3-adb0-8e0c34c5908c-workload-certs\") pod \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\" (UID: \"6529c04b-957f-4eb3-adb0-8e0c34c5908c\") "
Sep 16 02:46:52.989263 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:52.989097    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6529c04b-957f-4eb3-adb0-8e0c34c5908c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6529c04b-957f-4eb3-adb0-8e0c34c5908c" (UID: "6529c04b-957f-4eb3-adb0-8e0c34c5908c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:46:52.989263 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:52.989221    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6529c04b-957f-4eb3-adb0-8e0c34c5908c-istio-data" (OuterVolumeSpecName: "istio-data") pod "6529c04b-957f-4eb3-adb0-8e0c34c5908c" (UID: "6529c04b-957f-4eb3-adb0-8e0c34c5908c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:46:52.989496 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:52.989475    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6529c04b-957f-4eb3-adb0-8e0c34c5908c-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:52.989496 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:52.989482    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6529c04b-957f-4eb3-adb0-8e0c34c5908c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6529c04b-957f-4eb3-adb0-8e0c34c5908c" (UID: "6529c04b-957f-4eb3-adb0-8e0c34c5908c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:46:52.989623 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:52.989498    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6529c04b-957f-4eb3-adb0-8e0c34c5908c-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:52.989623 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:52.989504    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6529c04b-957f-4eb3-adb0-8e0c34c5908c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6529c04b-957f-4eb3-adb0-8e0c34c5908c" (UID: "6529c04b-957f-4eb3-adb0-8e0c34c5908c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:46:52.989623 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:52.989514    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6529c04b-957f-4eb3-adb0-8e0c34c5908c-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:52.990972 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:52.990949    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6529c04b-957f-4eb3-adb0-8e0c34c5908c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6529c04b-957f-4eb3-adb0-8e0c34c5908c" (UID: "6529c04b-957f-4eb3-adb0-8e0c34c5908c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 02:46:52.991076 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:52.991013    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6529c04b-957f-4eb3-adb0-8e0c34c5908c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6529c04b-957f-4eb3-adb0-8e0c34c5908c" (UID: "6529c04b-957f-4eb3-adb0-8e0c34c5908c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:46:52.991180 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:52.991164    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6529c04b-957f-4eb3-adb0-8e0c34c5908c-istio-token" (OuterVolumeSpecName: "istio-token") pod "6529c04b-957f-4eb3-adb0-8e0c34c5908c" (UID: "6529c04b-957f-4eb3-adb0-8e0c34c5908c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:46:52.991699 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:52.991674    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6529c04b-957f-4eb3-adb0-8e0c34c5908c-kube-api-access-g6cx6" (OuterVolumeSpecName: "kube-api-access-g6cx6") pod "6529c04b-957f-4eb3-adb0-8e0c34c5908c" (UID: "6529c04b-957f-4eb3-adb0-8e0c34c5908c"). InnerVolumeSpecName "kube-api-access-g6cx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:46:53.090474 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:53.090434    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6529c04b-957f-4eb3-adb0-8e0c34c5908c-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:53.090474 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:53.090472    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6529c04b-957f-4eb3-adb0-8e0c34c5908c-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:53.090632 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:53.090485    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6cx6\" (UniqueName: \"kubernetes.io/projected/6529c04b-957f-4eb3-adb0-8e0c34c5908c-kube-api-access-g6cx6\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:53.090632 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:53.090500    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6529c04b-957f-4eb3-adb0-8e0c34c5908c-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:53.090632 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:53.090512    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6529c04b-957f-4eb3-adb0-8e0c34c5908c-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:53.090632 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:53.090523    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6529c04b-957f-4eb3-adb0-8e0c34c5908c-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:53.320509 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:53.320425    2565 generic.go:356] "Generic (PLEG): container finished" podID="6529c04b-957f-4eb3-adb0-8e0c34c5908c" containerID="375190791ba7c498a76f2c521c33bc638f7fa24a8f4cc25d97f5cf8eb676c860" exitCode=0
Sep 16 02:46:53.320509 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:53.320475    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"
Sep 16 02:46:53.320730 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:53.320513    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4" event={"ID":"6529c04b-957f-4eb3-adb0-8e0c34c5908c","Type":"ContainerDied","Data":"375190791ba7c498a76f2c521c33bc638f7fa24a8f4cc25d97f5cf8eb676c860"}
Sep 16 02:46:53.320730 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:53.320578    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4" event={"ID":"6529c04b-957f-4eb3-adb0-8e0c34c5908c","Type":"ContainerDied","Data":"035eae592cd6b8ff45119346e128fab18a7d6aa97bef6ef02e5c495f1949bc80"}
Sep 16 02:46:53.320730 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:53.320614    2565 scope.go:117] "RemoveContainer" containerID="375190791ba7c498a76f2c521c33bc638f7fa24a8f4cc25d97f5cf8eb676c860"
Sep 16 02:46:53.330931 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:53.330914    2565 scope.go:117] "RemoveContainer" containerID="c7bfe83f8793bb6df28487ad54c056177e1674122ab10232e8cd123a7e30f36e"
Sep 16 02:46:53.340590 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:53.340572    2565 scope.go:117] "RemoveContainer" containerID="375190791ba7c498a76f2c521c33bc638f7fa24a8f4cc25d97f5cf8eb676c860"
Sep 16 02:46:53.340870 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:46:53.340847    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"375190791ba7c498a76f2c521c33bc638f7fa24a8f4cc25d97f5cf8eb676c860\": container with ID starting with 375190791ba7c498a76f2c521c33bc638f7fa24a8f4cc25d97f5cf8eb676c860 not found: ID does not exist" containerID="375190791ba7c498a76f2c521c33bc638f7fa24a8f4cc25d97f5cf8eb676c860"
Sep 16 02:46:53.340937 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:53.340883    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"375190791ba7c498a76f2c521c33bc638f7fa24a8f4cc25d97f5cf8eb676c860"} err="failed to get container status \"375190791ba7c498a76f2c521c33bc638f7fa24a8f4cc25d97f5cf8eb676c860\": rpc error: code = NotFound desc = could not find container \"375190791ba7c498a76f2c521c33bc638f7fa24a8f4cc25d97f5cf8eb676c860\": container with ID starting with 375190791ba7c498a76f2c521c33bc638f7fa24a8f4cc25d97f5cf8eb676c860 not found: ID does not exist"
Sep 16 02:46:53.340937 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:53.340906    2565 scope.go:117] "RemoveContainer" containerID="c7bfe83f8793bb6df28487ad54c056177e1674122ab10232e8cd123a7e30f36e"
Sep 16 02:46:53.341162 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:46:53.341142    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7bfe83f8793bb6df28487ad54c056177e1674122ab10232e8cd123a7e30f36e\": container with ID starting with c7bfe83f8793bb6df28487ad54c056177e1674122ab10232e8cd123a7e30f36e not found: ID does not exist" containerID="c7bfe83f8793bb6df28487ad54c056177e1674122ab10232e8cd123a7e30f36e"
Sep 16 02:46:53.341203 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:53.341168    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7bfe83f8793bb6df28487ad54c056177e1674122ab10232e8cd123a7e30f36e"} err="failed to get container status \"c7bfe83f8793bb6df28487ad54c056177e1674122ab10232e8cd123a7e30f36e\": rpc error: code = NotFound desc = could not find container \"c7bfe83f8793bb6df28487ad54c056177e1674122ab10232e8cd123a7e30f36e\": container with ID starting with c7bfe83f8793bb6df28487ad54c056177e1674122ab10232e8cd123a7e30f36e not found: ID does not exist"
Sep 16 02:46:53.342144 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:53.342125    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"]
Sep 16 02:46:53.347018 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:53.346996    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4"]
Sep 16 02:46:54.391489 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:54.391454    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6529c04b-957f-4eb3-adb0-8e0c34c5908c" path="/var/lib/kubelet/pods/6529c04b-957f-4eb3-adb0-8e0c34c5908c/volumes"
Sep 16 02:46:58.493045 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:58.493012    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-e86d9e-29825445-stw6p"]
Sep 16 02:46:58.493944 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:58.493907    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:58.495911 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:58.495886    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-e86d9e-29825445-stw6p"]
Sep 16 02:46:58.513248 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:58.513227    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l"]
Sep 16 02:46:58.513442 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:58.513422    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l" podUID="04d068c3-9d02-4804-bfca-71c90360edf3" containerName="payload-processing" containerID="cri-o://015c988ed89bdff12d8fdda7a5e9d20f3a08cdfbe3b32be98eb3edbb5d72b572" gracePeriod=30
Sep 16 02:46:58.520356 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:58.520330    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk"]
Sep 16 02:46:58.520581 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:58.520558    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk" podUID="3b9ba53a-a0c5-4710-b342-aeb6047b0da6" containerName="payload-pre-processing" containerID="cri-o://95d918a4eda9262f1e3637408c3d1bf6cad409e307b9aeb2684f49533daf2278" gracePeriod=30
Sep 16 02:46:58.553264 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:58.552888    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:58.600340 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:58.600289    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:58.724420 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:58.724387    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:58.787540 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:58.787513    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l"
Sep 16 02:46:58.790234 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:58.790201    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:58.820283 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:58.820265    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk"
Sep 16 02:46:58.840712 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:58.840688    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04d068c3-9d02-4804-bfca-71c90360edf3-plugins-config-volume\") pod \"04d068c3-9d02-4804-bfca-71c90360edf3\" (UID: \"04d068c3-9d02-4804-bfca-71c90360edf3\") "
Sep 16 02:46:58.840804 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:58.840762    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swvwq\" (UniqueName: \"kubernetes.io/projected/04d068c3-9d02-4804-bfca-71c90360edf3-kube-api-access-swvwq\") pod \"04d068c3-9d02-4804-bfca-71c90360edf3\" (UID: \"04d068c3-9d02-4804-bfca-71c90360edf3\") "
Sep 16 02:46:58.841118 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:58.841088    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04d068c3-9d02-4804-bfca-71c90360edf3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "04d068c3-9d02-4804-bfca-71c90360edf3" (UID: "04d068c3-9d02-4804-bfca-71c90360edf3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:46:58.843103 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:58.843079    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04d068c3-9d02-4804-bfca-71c90360edf3-kube-api-access-swvwq" (OuterVolumeSpecName: "kube-api-access-swvwq") pod "04d068c3-9d02-4804-bfca-71c90360edf3" (UID: "04d068c3-9d02-4804-bfca-71c90360edf3"). InnerVolumeSpecName "kube-api-access-swvwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:46:58.941501 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:58.941470    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxctx\" (UniqueName: \"kubernetes.io/projected/3b9ba53a-a0c5-4710-b342-aeb6047b0da6-kube-api-access-dxctx\") pod \"3b9ba53a-a0c5-4710-b342-aeb6047b0da6\" (UID: \"3b9ba53a-a0c5-4710-b342-aeb6047b0da6\") "
Sep 16 02:46:58.941642 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:58.941519    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b9ba53a-a0c5-4710-b342-aeb6047b0da6-plugins-config-volume\") pod \"3b9ba53a-a0c5-4710-b342-aeb6047b0da6\" (UID: \"3b9ba53a-a0c5-4710-b342-aeb6047b0da6\") "
Sep 16 02:46:58.941806 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:58.941793    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04d068c3-9d02-4804-bfca-71c90360edf3-plugins-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:58.941843 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:58.941807    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swvwq\" (UniqueName: \"kubernetes.io/projected/04d068c3-9d02-4804-bfca-71c90360edf3-kube-api-access-swvwq\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:58.941899 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:58.941877    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b9ba53a-a0c5-4710-b342-aeb6047b0da6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3b9ba53a-a0c5-4710-b342-aeb6047b0da6" (UID: "3b9ba53a-a0c5-4710-b342-aeb6047b0da6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:46:58.943597 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:58.943579    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b9ba53a-a0c5-4710-b342-aeb6047b0da6-kube-api-access-dxctx" (OuterVolumeSpecName: "kube-api-access-dxctx") pod "3b9ba53a-a0c5-4710-b342-aeb6047b0da6" (UID: "3b9ba53a-a0c5-4710-b342-aeb6047b0da6"). InnerVolumeSpecName "kube-api-access-dxctx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:46:59.043109 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:59.043041    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxctx\" (UniqueName: \"kubernetes.io/projected/3b9ba53a-a0c5-4710-b342-aeb6047b0da6-kube-api-access-dxctx\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:59.043109 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:59.043064    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b9ba53a-a0c5-4710-b342-aeb6047b0da6-plugins-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:46:59.121578 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:59.121548    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:59.325982 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:59.325900    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:46:59.369577 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:59.369548    2565 generic.go:356] "Generic (PLEG): container finished" podID="04d068c3-9d02-4804-bfca-71c90360edf3" containerID="015c988ed89bdff12d8fdda7a5e9d20f3a08cdfbe3b32be98eb3edbb5d72b572" exitCode=0
Sep 16 02:46:59.369717 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:59.369592    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l"
Sep 16 02:46:59.369717 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:59.369624    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l" event={"ID":"04d068c3-9d02-4804-bfca-71c90360edf3","Type":"ContainerDied","Data":"015c988ed89bdff12d8fdda7a5e9d20f3a08cdfbe3b32be98eb3edbb5d72b572"}
Sep 16 02:46:59.369717 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:59.369673    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l" event={"ID":"04d068c3-9d02-4804-bfca-71c90360edf3","Type":"ContainerDied","Data":"5a4631cf71030c4814ae198c16757fadaea2c24f77a8503418bb610eb56f6d2d"}
Sep 16 02:46:59.369717 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:59.369700    2565 scope.go:117] "RemoveContainer" containerID="015c988ed89bdff12d8fdda7a5e9d20f3a08cdfbe3b32be98eb3edbb5d72b572"
Sep 16 02:46:59.371167 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:59.371147    2565 generic.go:356] "Generic (PLEG): container finished" podID="3b9ba53a-a0c5-4710-b342-aeb6047b0da6" containerID="95d918a4eda9262f1e3637408c3d1bf6cad409e307b9aeb2684f49533daf2278" exitCode=0
Sep 16 02:46:59.371270 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:59.371192    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk"
Sep 16 02:46:59.371270 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:59.371213    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk" event={"ID":"3b9ba53a-a0c5-4710-b342-aeb6047b0da6","Type":"ContainerDied","Data":"95d918a4eda9262f1e3637408c3d1bf6cad409e307b9aeb2684f49533daf2278"}
Sep 16 02:46:59.371270 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:59.371245    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk" event={"ID":"3b9ba53a-a0c5-4710-b342-aeb6047b0da6","Type":"ContainerDied","Data":"cfcd2f80fbffe294f5b6669bc43cb57b0df75848caa20cedf3e2d8dfcf86d281"}
Sep 16 02:46:59.380158 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:59.380134    2565 scope.go:117] "RemoveContainer" containerID="015c988ed89bdff12d8fdda7a5e9d20f3a08cdfbe3b32be98eb3edbb5d72b572"
Sep 16 02:46:59.380455 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:46:59.380428    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"015c988ed89bdff12d8fdda7a5e9d20f3a08cdfbe3b32be98eb3edbb5d72b572\": container with ID starting with 015c988ed89bdff12d8fdda7a5e9d20f3a08cdfbe3b32be98eb3edbb5d72b572 not found: ID does not exist" containerID="015c988ed89bdff12d8fdda7a5e9d20f3a08cdfbe3b32be98eb3edbb5d72b572"
Sep 16 02:46:59.380516 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:59.380465    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"015c988ed89bdff12d8fdda7a5e9d20f3a08cdfbe3b32be98eb3edbb5d72b572"} err="failed to get container status \"015c988ed89bdff12d8fdda7a5e9d20f3a08cdfbe3b32be98eb3edbb5d72b572\": rpc error: code = NotFound desc = could not find container \"015c988ed89bdff12d8fdda7a5e9d20f3a08cdfbe3b32be98eb3edbb5d72b572\": container with ID starting with 015c988ed89bdff12d8fdda7a5e9d20f3a08cdfbe3b32be98eb3edbb5d72b572 not found: ID does not exist"
Sep 16 02:46:59.380516 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:59.380486    2565 scope.go:117] "RemoveContainer" containerID="95d918a4eda9262f1e3637408c3d1bf6cad409e307b9aeb2684f49533daf2278"
Sep 16 02:46:59.389038 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:59.389009    2565 scope.go:117] "RemoveContainer" containerID="95d918a4eda9262f1e3637408c3d1bf6cad409e307b9aeb2684f49533daf2278"
Sep 16 02:46:59.389294 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:46:59.389273    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95d918a4eda9262f1e3637408c3d1bf6cad409e307b9aeb2684f49533daf2278\": container with ID starting with 95d918a4eda9262f1e3637408c3d1bf6cad409e307b9aeb2684f49533daf2278 not found: ID does not exist" containerID="95d918a4eda9262f1e3637408c3d1bf6cad409e307b9aeb2684f49533daf2278"
Sep 16 02:46:59.389405 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:59.389300    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95d918a4eda9262f1e3637408c3d1bf6cad409e307b9aeb2684f49533daf2278"} err="failed to get container status \"95d918a4eda9262f1e3637408c3d1bf6cad409e307b9aeb2684f49533daf2278\": rpc error: code = NotFound desc = could not find container \"95d918a4eda9262f1e3637408c3d1bf6cad409e307b9aeb2684f49533daf2278\": container with ID starting with 95d918a4eda9262f1e3637408c3d1bf6cad409e307b9aeb2684f49533daf2278 not found: ID does not exist"
Sep 16 02:46:59.399258 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:59.399203    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l"]
Sep 16 02:46:59.403062 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:59.403038    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l"]
Sep 16 02:46:59.410793 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:59.410770    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk"]
Sep 16 02:46:59.414111 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:59.414089    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk"]
Sep 16 02:46:59.759466 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:59.759437    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk" podUID="3b9ba53a-a0c5-4710-b342-aeb6047b0da6" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.74:9004: i/o timeout"
Sep 16 02:46:59.759466 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:59.759455    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l" podUID="04d068c3-9d02-4804-bfca-71c90360edf3" containerName="payload-processing" probeResult="failure" output="dial tcp 10.133.0.75:9004: i/o timeout"
Sep 16 02:46:59.932549 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:46:59.932522    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:47:00.391186 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:00.391147    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04d068c3-9d02-4804-bfca-71c90360edf3" path="/var/lib/kubelet/pods/04d068c3-9d02-4804-bfca-71c90360edf3/volumes"
Sep 16 02:47:00.391541 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:00.391523    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2beb8a89-5095-4b44-8919-87afc90ed8cf" path="/var/lib/kubelet/pods/2beb8a89-5095-4b44-8919-87afc90ed8cf/volumes"
Sep 16 02:47:00.391817 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:00.391806    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b9ba53a-a0c5-4710-b342-aeb6047b0da6" path="/var/lib/kubelet/pods/3b9ba53a-a0c5-4710-b342-aeb6047b0da6/volumes"
Sep 16 02:47:00.712706 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:00.712672    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:47:04.384924 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:04.384895    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8" secret="" err="secret \"payload-processing-dockercfg-7v8jt\" not found"
Sep 16 02:47:05.143974 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:05.143893    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:47:05.198404 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:05.198355    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:47:05.421583 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:05.421547    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:47:25.082914 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:25.082880    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:47:26.045702 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:26.045663    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:47:31.434991 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:31.434954    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:47:31.532065 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:31.532030    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:47:31.704485 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:31.704410    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"]
Sep 16 02:47:31.704641 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:31.704618    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps" podUID="e69e4dbf-7413-4d6c-82a1-1ec4666c5d98" containerName="istio-proxy" containerID="cri-o://95f80e0b24e2489fbd56e34257c1b0169c13cdd67d17d0fa20fc5432c249a78f" gracePeriod=30
Sep 16 02:47:31.726761 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:31.726729    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:47:32.076246 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.076169    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4fe974-pvmv8"]
Sep 16 02:47:32.076589 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.076575    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eefb51d-070f-419b-af82-4a55d71da636" containerName="payload-processing"
Sep 16 02:47:32.076631 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.076591    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eefb51d-070f-419b-af82-4a55d71da636" containerName="payload-processing"
Sep 16 02:47:32.076631 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.076600    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="765a9485-ef6a-44ec-9e72-15d152a551bc" containerName="revoke-keys"
Sep 16 02:47:32.076631 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.076606    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="765a9485-ef6a-44ec-9e72-15d152a551bc" containerName="revoke-keys"
Sep 16 02:47:32.076631 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.076620    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6529c04b-957f-4eb3-adb0-8e0c34c5908c" containerName="istio-proxy"
Sep 16 02:47:32.076631 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.076625    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6529c04b-957f-4eb3-adb0-8e0c34c5908c" containerName="istio-proxy"
Sep 16 02:47:32.076631 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.076631    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b9ba53a-a0c5-4710-b342-aeb6047b0da6" containerName="payload-pre-processing"
Sep 16 02:47:32.076824 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.076638    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b9ba53a-a0c5-4710-b342-aeb6047b0da6" containerName="payload-pre-processing"
Sep 16 02:47:32.076824 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.076646    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd863ae8-6b3d-4c78-95e4-2251d4aacc26" containerName="payload-pre-processing"
Sep 16 02:47:32.076824 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.076651    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd863ae8-6b3d-4c78-95e4-2251d4aacc26" containerName="payload-pre-processing"
Sep 16 02:47:32.076824 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.076658    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c52a7f8f-53ca-41f9-9f70-18a598d5ea00" containerName="payload-pre-processing"
Sep 16 02:47:32.076824 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.076663    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c52a7f8f-53ca-41f9-9f70-18a598d5ea00" containerName="payload-pre-processing"
Sep 16 02:47:32.076824 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.076669    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25f33366-06aa-4bd8-8dfb-daeafa572575" containerName="istio-proxy"
Sep 16 02:47:32.076824 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.076676    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="25f33366-06aa-4bd8-8dfb-daeafa572575" containerName="istio-proxy"
Sep 16 02:47:32.076824 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.076684    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04d068c3-9d02-4804-bfca-71c90360edf3" containerName="payload-processing"
Sep 16 02:47:32.076824 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.076689    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="04d068c3-9d02-4804-bfca-71c90360edf3" containerName="payload-processing"
Sep 16 02:47:32.076824 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.076702    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6529c04b-957f-4eb3-adb0-8e0c34c5908c" containerName="istio-proxy"
Sep 16 02:47:32.076824 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.076707    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6529c04b-957f-4eb3-adb0-8e0c34c5908c" containerName="istio-proxy"
Sep 16 02:47:32.076824 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.076770    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c52a7f8f-53ca-41f9-9f70-18a598d5ea00" containerName="payload-pre-processing"
Sep 16 02:47:32.076824 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.076778    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4eefb51d-070f-419b-af82-4a55d71da636" containerName="payload-processing"
Sep 16 02:47:32.076824 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.076785    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6529c04b-957f-4eb3-adb0-8e0c34c5908c" containerName="istio-proxy"
Sep 16 02:47:32.076824 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.076790    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="25f33366-06aa-4bd8-8dfb-daeafa572575" containerName="istio-proxy"
Sep 16 02:47:32.076824 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.076795    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="25f33366-06aa-4bd8-8dfb-daeafa572575" containerName="istio-proxy"
Sep 16 02:47:32.076824 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.076801    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd863ae8-6b3d-4c78-95e4-2251d4aacc26" containerName="payload-pre-processing"
Sep 16 02:47:32.076824 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.076808    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="765a9485-ef6a-44ec-9e72-15d152a551bc" containerName="revoke-keys"
Sep 16 02:47:32.076824 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.076812    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="04d068c3-9d02-4804-bfca-71c90360edf3" containerName="payload-processing"
Sep 16 02:47:32.076824 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.076817    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6529c04b-957f-4eb3-adb0-8e0c34c5908c" containerName="istio-proxy"
Sep 16 02:47:32.076824 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.076822    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b9ba53a-a0c5-4710-b342-aeb6047b0da6" containerName="payload-pre-processing"
Sep 16 02:47:32.079492 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.079475    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4fe974-pvmv8"
Sep 16 02:47:32.081756 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.081730    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w8hnp\""
Sep 16 02:47:32.082100 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.081771    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 02:47:32.085613 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.085590    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4fe974-pvmv8"]
Sep 16 02:47:32.208895 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.208869    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/64aad461-75a8-4f13-aade-0cac3d6298c0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-4fe974-pvmv8\" (UID: \"64aad461-75a8-4f13-aade-0cac3d6298c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4fe974-pvmv8"
Sep 16 02:47:32.309804 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.309775    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/64aad461-75a8-4f13-aade-0cac3d6298c0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-4fe974-pvmv8\" (UID: \"64aad461-75a8-4f13-aade-0cac3d6298c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4fe974-pvmv8"
Sep 16 02:47:32.310430 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.310406    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/64aad461-75a8-4f13-aade-0cac3d6298c0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-4fe974-pvmv8\" (UID: \"64aad461-75a8-4f13-aade-0cac3d6298c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4fe974-pvmv8"
Sep 16 02:47:32.391809 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.391747    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4fe974-pvmv8"
Sep 16 02:47:32.659577 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:32.659555    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4fe974-pvmv8"]
Sep 16 02:47:32.661603 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:47:32.661574    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64aad461_75a8_4f13_aade_0cac3d6298c0.slice/crio-1e93a3d5c4b473b9f31405b1bc821ce030965c6bdae25794c8f0026359053ca3 WatchSource:0}: Error finding container 1e93a3d5c4b473b9f31405b1bc821ce030965c6bdae25794c8f0026359053ca3: Status 404 returned error can't find the container with id 1e93a3d5c4b473b9f31405b1bc821ce030965c6bdae25794c8f0026359053ca3
Sep 16 02:47:33.157280 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:33.157245    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:47:33.588316 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:33.588286    2565 generic.go:356] "Generic (PLEG): container finished" podID="64aad461-75a8-4f13-aade-0cac3d6298c0" containerID="6f99d6ec7d529512cc7db63a8349fdd4f87cb36814bd8d8b3936479ad94f2257" exitCode=0
Sep 16 02:47:33.588497 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:33.588376    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4fe974-pvmv8" event={"ID":"64aad461-75a8-4f13-aade-0cac3d6298c0","Type":"ContainerDied","Data":"6f99d6ec7d529512cc7db63a8349fdd4f87cb36814bd8d8b3936479ad94f2257"}
Sep 16 02:47:33.588497 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:33.588426    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4fe974-pvmv8" event={"ID":"64aad461-75a8-4f13-aade-0cac3d6298c0","Type":"ContainerStarted","Data":"1e93a3d5c4b473b9f31405b1bc821ce030965c6bdae25794c8f0026359053ca3"}
Sep 16 02:47:33.753031 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:33.752947    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:47:34.627290 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:34.627257    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:47:34.718156 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:34.718133    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4fe974-pvmv8"
Sep 16 02:47:34.834284 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:34.834257    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/64aad461-75a8-4f13-aade-0cac3d6298c0-maas-api-service-ca\") pod \"64aad461-75a8-4f13-aade-0cac3d6298c0\" (UID: \"64aad461-75a8-4f13-aade-0cac3d6298c0\") "
Sep 16 02:47:34.834607 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:34.834571    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64aad461-75a8-4f13-aade-0cac3d6298c0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "64aad461-75a8-4f13-aade-0cac3d6298c0" (UID: "64aad461-75a8-4f13-aade-0cac3d6298c0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:47:34.935694 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:34.935665    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/64aad461-75a8-4f13-aade-0cac3d6298c0-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:47:35.602197 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:35.602168    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4fe974-pvmv8"
Sep 16 02:47:35.602468 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:35.602198    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4fe974-pvmv8" event={"ID":"64aad461-75a8-4f13-aade-0cac3d6298c0","Type":"ContainerDied","Data":"1e93a3d5c4b473b9f31405b1bc821ce030965c6bdae25794c8f0026359053ca3"}
Sep 16 02:47:35.602468 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:35.602256    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e93a3d5c4b473b9f31405b1bc821ce030965c6bdae25794c8f0026359053ca3"
Sep 16 02:47:36.963751 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:36.963723    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:47:37.155602 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.155577    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4c28r\" (UniqueName: \"kubernetes.io/projected/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-kube-api-access-4c28r\") pod \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") "
Sep 16 02:47:37.155774 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.155612    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-credential-socket\") pod \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") "
Sep 16 02:47:37.155774 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.155630    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-workload-certs\") pod \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") "
Sep 16 02:47:37.155774 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.155676    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-istio-data\") pod \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") "
Sep 16 02:47:37.155774 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.155692    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-istio-token\") pod \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") "
Sep 16 02:47:37.155774 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.155708    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-workload-socket\") pod \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") "
Sep 16 02:47:37.155774 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.155745    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-istiod-ca-cert\") pod \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") "
Sep 16 02:47:37.155774 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.155770    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-istio-envoy\") pod \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") "
Sep 16 02:47:37.156145 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.155859    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-istio-podinfo\") pod \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\" (UID: \"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98\") "
Sep 16 02:47:37.156145 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.155939    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e69e4dbf-7413-4d6c-82a1-1ec4666c5d98" (UID: "e69e4dbf-7413-4d6c-82a1-1ec4666c5d98"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:47:37.156145 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.155981    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-istio-data" (OuterVolumeSpecName: "istio-data") pod "e69e4dbf-7413-4d6c-82a1-1ec4666c5d98" (UID: "e69e4dbf-7413-4d6c-82a1-1ec4666c5d98"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:47:37.156145 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.155992    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e69e4dbf-7413-4d6c-82a1-1ec4666c5d98" (UID: "e69e4dbf-7413-4d6c-82a1-1ec4666c5d98"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:47:37.156145 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.156012    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e69e4dbf-7413-4d6c-82a1-1ec4666c5d98" (UID: "e69e4dbf-7413-4d6c-82a1-1ec4666c5d98"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:47:37.156439 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.156241    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:47:37.156439 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.156261    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:47:37.156439 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.156275    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:47:37.156439 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.156287    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:47:37.156439 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.156304    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e69e4dbf-7413-4d6c-82a1-1ec4666c5d98" (UID: "e69e4dbf-7413-4d6c-82a1-1ec4666c5d98"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:47:37.157914 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.157887    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-istio-token" (OuterVolumeSpecName: "istio-token") pod "e69e4dbf-7413-4d6c-82a1-1ec4666c5d98" (UID: "e69e4dbf-7413-4d6c-82a1-1ec4666c5d98"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:47:37.157988 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.157937    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e69e4dbf-7413-4d6c-82a1-1ec4666c5d98" (UID: "e69e4dbf-7413-4d6c-82a1-1ec4666c5d98"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:47:37.158101 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.158079    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-kube-api-access-4c28r" (OuterVolumeSpecName: "kube-api-access-4c28r") pod "e69e4dbf-7413-4d6c-82a1-1ec4666c5d98" (UID: "e69e4dbf-7413-4d6c-82a1-1ec4666c5d98"). InnerVolumeSpecName "kube-api-access-4c28r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:47:37.158227 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.158148    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e69e4dbf-7413-4d6c-82a1-1ec4666c5d98" (UID: "e69e4dbf-7413-4d6c-82a1-1ec4666c5d98"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 02:47:37.257497 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.257476    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:47:37.257497 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.257496    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4c28r\" (UniqueName: \"kubernetes.io/projected/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-kube-api-access-4c28r\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:47:37.257623 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.257505    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:47:37.257623 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.257514    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:47:37.257623 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.257522    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:47:37.616746 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.616668    2565 generic.go:356] "Generic (PLEG): container finished" podID="e69e4dbf-7413-4d6c-82a1-1ec4666c5d98" containerID="95f80e0b24e2489fbd56e34257c1b0169c13cdd67d17d0fa20fc5432c249a78f" exitCode=0
Sep 16 02:47:37.616746 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.616719    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"
Sep 16 02:47:37.616954 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.616763    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps" event={"ID":"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98","Type":"ContainerDied","Data":"95f80e0b24e2489fbd56e34257c1b0169c13cdd67d17d0fa20fc5432c249a78f"}
Sep 16 02:47:37.616954 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.616821    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps" event={"ID":"e69e4dbf-7413-4d6c-82a1-1ec4666c5d98","Type":"ContainerDied","Data":"6d039440ede9e4437a1ad2ac520320da45c2fc8c44fd7b699be831692a2d1532"}
Sep 16 02:47:37.616954 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.616852    2565 scope.go:117] "RemoveContainer" containerID="95f80e0b24e2489fbd56e34257c1b0169c13cdd67d17d0fa20fc5432c249a78f"
Sep 16 02:47:37.626745 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.626727    2565 scope.go:117] "RemoveContainer" containerID="d8ed8ebc0054e646d68b2457784b6fc4b5fbf36d9b8b267337b4423df1d42798"
Sep 16 02:47:37.635271 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.635245    2565 scope.go:117] "RemoveContainer" containerID="95f80e0b24e2489fbd56e34257c1b0169c13cdd67d17d0fa20fc5432c249a78f"
Sep 16 02:47:37.635811 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:47:37.635788    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95f80e0b24e2489fbd56e34257c1b0169c13cdd67d17d0fa20fc5432c249a78f\": container with ID starting with 95f80e0b24e2489fbd56e34257c1b0169c13cdd67d17d0fa20fc5432c249a78f not found: ID does not exist" containerID="95f80e0b24e2489fbd56e34257c1b0169c13cdd67d17d0fa20fc5432c249a78f"
Sep 16 02:47:37.635911 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.635819    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95f80e0b24e2489fbd56e34257c1b0169c13cdd67d17d0fa20fc5432c249a78f"} err="failed to get container status \"95f80e0b24e2489fbd56e34257c1b0169c13cdd67d17d0fa20fc5432c249a78f\": rpc error: code = NotFound desc = could not find container \"95f80e0b24e2489fbd56e34257c1b0169c13cdd67d17d0fa20fc5432c249a78f\": container with ID starting with 95f80e0b24e2489fbd56e34257c1b0169c13cdd67d17d0fa20fc5432c249a78f not found: ID does not exist"
Sep 16 02:47:37.635911 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.635834    2565 scope.go:117] "RemoveContainer" containerID="d8ed8ebc0054e646d68b2457784b6fc4b5fbf36d9b8b267337b4423df1d42798"
Sep 16 02:47:37.636042 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:47:37.636028    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8ed8ebc0054e646d68b2457784b6fc4b5fbf36d9b8b267337b4423df1d42798\": container with ID starting with d8ed8ebc0054e646d68b2457784b6fc4b5fbf36d9b8b267337b4423df1d42798 not found: ID does not exist" containerID="d8ed8ebc0054e646d68b2457784b6fc4b5fbf36d9b8b267337b4423df1d42798"
Sep 16 02:47:37.636086 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.636044    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8ed8ebc0054e646d68b2457784b6fc4b5fbf36d9b8b267337b4423df1d42798"} err="failed to get container status \"d8ed8ebc0054e646d68b2457784b6fc4b5fbf36d9b8b267337b4423df1d42798\": rpc error: code = NotFound desc = could not find container \"d8ed8ebc0054e646d68b2457784b6fc4b5fbf36d9b8b267337b4423df1d42798\": container with ID starting with d8ed8ebc0054e646d68b2457784b6fc4b5fbf36d9b8b267337b4423df1d42798 not found: ID does not exist"
Sep 16 02:47:37.638186 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.638166    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"]
Sep 16 02:47:37.643444 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:37.643424    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps"]
Sep 16 02:47:38.392009 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:38.391969    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e69e4dbf-7413-4d6c-82a1-1ec4666c5d98" path="/var/lib/kubelet/pods/e69e4dbf-7413-4d6c-82a1-1ec4666c5d98/volumes"
Sep 16 02:47:42.486839 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:42.486802    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-4fe974-29825445-ptmj4"]
Sep 16 02:47:42.488993 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:42.488962    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:47:42.492013 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:42.491994    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-4fe974-29825445-ptmj4"]
Sep 16 02:47:42.552354 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:42.552328    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:47:42.611714 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:42.611687    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:47:42.658688 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:42.658664    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4fe974-pvmv8"]
Sep 16 02:47:42.661141 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:42.661123    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4fe974-pvmv8"]
Sep 16 02:47:42.671655 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:42.671615    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:47:43.038943 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:43.038868    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:47:43.343074 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:43.342997    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:47:43.959159 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:43.959129    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:47:44.392037 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:44.391958    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30f2bd7b-8002-4f1e-bbaf-f7e53711718e" path="/var/lib/kubelet/pods/30f2bd7b-8002-4f1e-bbaf-f7e53711718e/volumes"
Sep 16 02:47:44.392350 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:44.392334    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64aad461-75a8-4f13-aade-0cac3d6298c0" path="/var/lib/kubelet/pods/64aad461-75a8-4f13-aade-0cac3d6298c0/volumes"
Sep 16 02:47:48.687808 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:48.687777    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:47:48.788714 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:48.788680    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:47:48.946312 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:48.946233    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:47:49.262859 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:49.262780    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-db1ed7-gvglf"]
Sep 16 02:47:49.263399 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:49.263379    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25f33366-06aa-4bd8-8dfb-daeafa572575" containerName="istio-proxy"
Sep 16 02:47:49.263474 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:49.263403    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="25f33366-06aa-4bd8-8dfb-daeafa572575" containerName="istio-proxy"
Sep 16 02:47:49.263474 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:49.263438    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64aad461-75a8-4f13-aade-0cac3d6298c0" containerName="revoke-keys"
Sep 16 02:47:49.263474 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:49.263447    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="64aad461-75a8-4f13-aade-0cac3d6298c0" containerName="revoke-keys"
Sep 16 02:47:49.263474 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:49.263458    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e69e4dbf-7413-4d6c-82a1-1ec4666c5d98" containerName="istio-proxy"
Sep 16 02:47:49.263474 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:49.263468    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e69e4dbf-7413-4d6c-82a1-1ec4666c5d98" containerName="istio-proxy"
Sep 16 02:47:49.263633 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:49.263481    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e69e4dbf-7413-4d6c-82a1-1ec4666c5d98" containerName="istio-proxy"
Sep 16 02:47:49.263633 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:49.263490    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e69e4dbf-7413-4d6c-82a1-1ec4666c5d98" containerName="istio-proxy"
Sep 16 02:47:49.263633 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:49.263607    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="64aad461-75a8-4f13-aade-0cac3d6298c0" containerName="revoke-keys"
Sep 16 02:47:49.263633 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:49.263624    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e69e4dbf-7413-4d6c-82a1-1ec4666c5d98" containerName="istio-proxy"
Sep 16 02:47:49.263752 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:49.263634    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e69e4dbf-7413-4d6c-82a1-1ec4666c5d98" containerName="istio-proxy"
Sep 16 02:47:49.267054 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:49.267029    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-db1ed7-gvglf"
Sep 16 02:47:49.270207 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:49.270188    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w8hnp\""
Sep 16 02:47:49.270445 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:49.270192    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 02:47:49.271077 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:49.271056    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-db1ed7-gvglf"]
Sep 16 02:47:49.361381 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:49.361329    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35945ff1-4459-4db0-90be-46ce4eacd850-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-db1ed7-gvglf\" (UID: \"35945ff1-4459-4db0-90be-46ce4eacd850\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-db1ed7-gvglf"
Sep 16 02:47:49.462597 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:49.462563    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35945ff1-4459-4db0-90be-46ce4eacd850-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-db1ed7-gvglf\" (UID: \"35945ff1-4459-4db0-90be-46ce4eacd850\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-db1ed7-gvglf"
Sep 16 02:47:49.463160 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:49.463139    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35945ff1-4459-4db0-90be-46ce4eacd850-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-db1ed7-gvglf\" (UID: \"35945ff1-4459-4db0-90be-46ce4eacd850\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-db1ed7-gvglf"
Sep 16 02:47:49.533319 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:49.533261    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:47:49.582399 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:49.582354    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-db1ed7-gvglf"
Sep 16 02:47:49.854588 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:49.854566    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-db1ed7-gvglf"]
Sep 16 02:47:49.855510 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:47:49.855480    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35945ff1_4459_4db0_90be_46ce4eacd850.slice/crio-a425473ba79910a1991aed24eb7565b76412e6557805186d4a973658800e64da WatchSource:0}: Error finding container a425473ba79910a1991aed24eb7565b76412e6557805186d4a973658800e64da: Status 404 returned error can't find the container with id a425473ba79910a1991aed24eb7565b76412e6557805186d4a973658800e64da
Sep 16 02:47:50.341761 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:50.341725    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:47:50.699905 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:50.699872    2565 generic.go:356] "Generic (PLEG): container finished" podID="35945ff1-4459-4db0-90be-46ce4eacd850" containerID="9ef13d7b9c8d26b510982d5de02117e541d63872a7e92e817ccd18198f9abeac" exitCode=0
Sep 16 02:47:50.700040 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:50.699947    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-db1ed7-gvglf" event={"ID":"35945ff1-4459-4db0-90be-46ce4eacd850","Type":"ContainerDied","Data":"9ef13d7b9c8d26b510982d5de02117e541d63872a7e92e817ccd18198f9abeac"}
Sep 16 02:47:50.700040 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:50.699988    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-db1ed7-gvglf" event={"ID":"35945ff1-4459-4db0-90be-46ce4eacd850","Type":"ContainerStarted","Data":"a425473ba79910a1991aed24eb7565b76412e6557805186d4a973658800e64da"}
Sep 16 02:47:50.946631 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:50.946595    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:47:51.842806 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:51.842779    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-db1ed7-gvglf"
Sep 16 02:47:51.884648 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:51.884622    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35945ff1-4459-4db0-90be-46ce4eacd850-maas-api-service-ca\") pod \"35945ff1-4459-4db0-90be-46ce4eacd850\" (UID: \"35945ff1-4459-4db0-90be-46ce4eacd850\") "
Sep 16 02:47:51.885031 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:51.885005    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35945ff1-4459-4db0-90be-46ce4eacd850-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "35945ff1-4459-4db0-90be-46ce4eacd850" (UID: "35945ff1-4459-4db0-90be-46ce4eacd850"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:47:51.985464 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:51.985400    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35945ff1-4459-4db0-90be-46ce4eacd850-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:47:52.714237 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:52.714204    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-db1ed7-gvglf"
Sep 16 02:47:52.714237 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:52.714231    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-db1ed7-gvglf" event={"ID":"35945ff1-4459-4db0-90be-46ce4eacd850","Type":"ContainerDied","Data":"a425473ba79910a1991aed24eb7565b76412e6557805186d4a973658800e64da"}
Sep 16 02:47:52.714528 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:52.714274    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a425473ba79910a1991aed24eb7565b76412e6557805186d4a973658800e64da"
Sep 16 02:47:59.799240 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:59.799192    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:47:59.824416 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:59.824388    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x"]
Sep 16 02:47:59.824645 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:59.824620    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x" podUID="cec5b1f8-4075-426b-bd74-7d80ad9748c1" containerName="payload-processing" containerID="cri-o://469c74ec05630c292e05ad24032fd8a16db7c128e62ae9bc0d0876c1bb5c1302" gracePeriod=30
Sep 16 02:47:59.897594 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:59.897558    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:47:59.921792 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:59.921757    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x" podUID="cec5b1f8-4075-426b-bd74-7d80ad9748c1" containerName="payload-processing" probeResult="failure" output="dial tcp 10.133.0.63:9004: connect: connection refused"
Sep 16 02:47:59.968250 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:59.968217    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-db1ed7-gvglf"]
Sep 16 02:47:59.968529 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:59.968501    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:47:59.971815 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:47:59.971792    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-db1ed7-gvglf"]
Sep 16 02:48:00.086423 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:00.086389    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:48:00.094223 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:00.094196    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x"
Sep 16 02:48:00.153955 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:00.153923    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jbd6\" (UniqueName: \"kubernetes.io/projected/cec5b1f8-4075-426b-bd74-7d80ad9748c1-kube-api-access-9jbd6\") pod \"cec5b1f8-4075-426b-bd74-7d80ad9748c1\" (UID: \"cec5b1f8-4075-426b-bd74-7d80ad9748c1\") "
Sep 16 02:48:00.154135 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:00.154027    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cec5b1f8-4075-426b-bd74-7d80ad9748c1-plugins-config-volume\") pod \"cec5b1f8-4075-426b-bd74-7d80ad9748c1\" (UID: \"cec5b1f8-4075-426b-bd74-7d80ad9748c1\") "
Sep 16 02:48:00.154453 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:00.154427    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cec5b1f8-4075-426b-bd74-7d80ad9748c1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cec5b1f8-4075-426b-bd74-7d80ad9748c1" (UID: "cec5b1f8-4075-426b-bd74-7d80ad9748c1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:48:00.155991 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:00.155970    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cec5b1f8-4075-426b-bd74-7d80ad9748c1-kube-api-access-9jbd6" (OuterVolumeSpecName: "kube-api-access-9jbd6") pod "cec5b1f8-4075-426b-bd74-7d80ad9748c1" (UID: "cec5b1f8-4075-426b-bd74-7d80ad9748c1"). InnerVolumeSpecName "kube-api-access-9jbd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:48:00.254987 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:00.254947    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cec5b1f8-4075-426b-bd74-7d80ad9748c1-plugins-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:48:00.254987 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:00.254975    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jbd6\" (UniqueName: \"kubernetes.io/projected/cec5b1f8-4075-426b-bd74-7d80ad9748c1-kube-api-access-9jbd6\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:48:00.335338 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:00.335208    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:48:00.391627 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:00.391588    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35945ff1-4459-4db0-90be-46ce4eacd850" path="/var/lib/kubelet/pods/35945ff1-4459-4db0-90be-46ce4eacd850/volumes"
Sep 16 02:48:00.523422 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:00.523388    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:48:00.767586 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:00.767555    2565 generic.go:356] "Generic (PLEG): container finished" podID="cec5b1f8-4075-426b-bd74-7d80ad9748c1" containerID="469c74ec05630c292e05ad24032fd8a16db7c128e62ae9bc0d0876c1bb5c1302" exitCode=0
Sep 16 02:48:00.767786 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:00.767603    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x" event={"ID":"cec5b1f8-4075-426b-bd74-7d80ad9748c1","Type":"ContainerDied","Data":"469c74ec05630c292e05ad24032fd8a16db7c128e62ae9bc0d0876c1bb5c1302"}
Sep 16 02:48:00.767786 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:00.767654    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x" event={"ID":"cec5b1f8-4075-426b-bd74-7d80ad9748c1","Type":"ContainerDied","Data":"1b67554147ef2f71911ae823671aeadb425ba628c8624124f282cbc7bf2ff168"}
Sep 16 02:48:00.767786 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:00.767609    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x"
Sep 16 02:48:00.767786 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:00.767676    2565 scope.go:117] "RemoveContainer" containerID="469c74ec05630c292e05ad24032fd8a16db7c128e62ae9bc0d0876c1bb5c1302"
Sep 16 02:48:00.777527 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:00.777509    2565 scope.go:117] "RemoveContainer" containerID="469c74ec05630c292e05ad24032fd8a16db7c128e62ae9bc0d0876c1bb5c1302"
Sep 16 02:48:00.777807 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:48:00.777784    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"469c74ec05630c292e05ad24032fd8a16db7c128e62ae9bc0d0876c1bb5c1302\": container with ID starting with 469c74ec05630c292e05ad24032fd8a16db7c128e62ae9bc0d0876c1bb5c1302 not found: ID does not exist" containerID="469c74ec05630c292e05ad24032fd8a16db7c128e62ae9bc0d0876c1bb5c1302"
Sep 16 02:48:00.777883 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:00.777815    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"469c74ec05630c292e05ad24032fd8a16db7c128e62ae9bc0d0876c1bb5c1302"} err="failed to get container status \"469c74ec05630c292e05ad24032fd8a16db7c128e62ae9bc0d0876c1bb5c1302\": rpc error: code = NotFound desc = could not find container \"469c74ec05630c292e05ad24032fd8a16db7c128e62ae9bc0d0876c1bb5c1302\": container with ID starting with 469c74ec05630c292e05ad24032fd8a16db7c128e62ae9bc0d0876c1bb5c1302 not found: ID does not exist"
Sep 16 02:48:00.783567 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:00.783539    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x"]
Sep 16 02:48:00.786568 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:00.786549    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x"]
Sep 16 02:48:02.391887 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:02.391851    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cec5b1f8-4075-426b-bd74-7d80ad9748c1" path="/var/lib/kubelet/pods/cec5b1f8-4075-426b-bd74-7d80ad9748c1/volumes"
Sep 16 02:48:06.118168 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:06.118127    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:48:06.179334 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:06.179305    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:48:06.345965 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:06.345931    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"]
Sep 16 02:48:06.346206 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:06.346182    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd" podUID="040944c9-d831-4757-96ff-667b76585c7a" containerName="istio-proxy" containerID="cri-o://c6ba2b75ec72738fb78d219f3e74b7c0e56b8cf7c500d4d61efc8af53256a159" gracePeriod=30
Sep 16 02:48:06.370930 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:06.370864    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:48:06.410566 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:06.410539    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 02:48:06.410675 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:06.410590    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd" podUID="040944c9-d831-4757-96ff-667b76585c7a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 02:48:06.736971 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:06.736937    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-eee708-c9smn"]
Sep 16 02:48:06.737317 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:06.737304    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cec5b1f8-4075-426b-bd74-7d80ad9748c1" containerName="payload-processing"
Sep 16 02:48:06.737378 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:06.737318    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cec5b1f8-4075-426b-bd74-7d80ad9748c1" containerName="payload-processing"
Sep 16 02:48:06.737378 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:06.737326    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35945ff1-4459-4db0-90be-46ce4eacd850" containerName="revoke-keys"
Sep 16 02:48:06.737378 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:06.737332    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="35945ff1-4459-4db0-90be-46ce4eacd850" containerName="revoke-keys"
Sep 16 02:48:06.737478 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:06.737409    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cec5b1f8-4075-426b-bd74-7d80ad9748c1" containerName="payload-processing"
Sep 16 02:48:06.737478 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:06.737420    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="35945ff1-4459-4db0-90be-46ce4eacd850" containerName="revoke-keys"
Sep 16 02:48:06.741497 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:06.741481    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-eee708-c9smn"
Sep 16 02:48:06.743940 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:06.743917    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w8hnp\""
Sep 16 02:48:06.744078 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:06.743921    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 02:48:06.748569 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:06.748535    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-eee708-c9smn"]
Sep 16 02:48:06.808265 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:06.808236    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84dcca79-6444-408d-985a-a4daf79fd07b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-eee708-c9smn\" (UID: \"84dcca79-6444-408d-985a-a4daf79fd07b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-eee708-c9smn"
Sep 16 02:48:06.909132 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:06.909107    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84dcca79-6444-408d-985a-a4daf79fd07b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-eee708-c9smn\" (UID: \"84dcca79-6444-408d-985a-a4daf79fd07b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-eee708-c9smn"
Sep 16 02:48:06.909712 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:06.909693    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84dcca79-6444-408d-985a-a4daf79fd07b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-eee708-c9smn\" (UID: \"84dcca79-6444-408d-985a-a4daf79fd07b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-eee708-c9smn"
Sep 16 02:48:07.054446 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:07.054384    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-eee708-c9smn"
Sep 16 02:48:07.324473 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:07.324447    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-eee708-c9smn"]
Sep 16 02:48:07.325899 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:48:07.325870    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84dcca79_6444_408d_985a_a4daf79fd07b.slice/crio-c5d8cf504e403921f95354a01988d44c7d10d1b97d131511286fabfd79e66fce WatchSource:0}: Error finding container c5d8cf504e403921f95354a01988d44c7d10d1b97d131511286fabfd79e66fce: Status 404 returned error can't find the container with id c5d8cf504e403921f95354a01988d44c7d10d1b97d131511286fabfd79e66fce
Sep 16 02:48:07.812354 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:07.812325    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-eee708-c9smn" event={"ID":"84dcca79-6444-408d-985a-a4daf79fd07b","Type":"ContainerStarted","Data":"c7ede3689663d20aec2ce04caf51682977db86eba4417197f63e4b297bcf6dc5"}
Sep 16 02:48:07.812475 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:07.812404    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-eee708-c9smn" event={"ID":"84dcca79-6444-408d-985a-a4daf79fd07b","Type":"ContainerStarted","Data":"c5d8cf504e403921f95354a01988d44c7d10d1b97d131511286fabfd79e66fce"}
Sep 16 02:48:07.826896 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:07.826849    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-eee708-c9smn" podStartSLOduration=1.8268333079999999 podStartE2EDuration="1.826833308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:48:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:48:07.825284473 +0000 UTC m=+1765.875628996" watchObservedRunningTime="2026-09-16 02:48:07.826833308 +0000 UTC m=+1765.877177801"
Sep 16 02:48:08.822138 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:08.822101    2565 generic.go:356] "Generic (PLEG): container finished" podID="84dcca79-6444-408d-985a-a4daf79fd07b" containerID="c7ede3689663d20aec2ce04caf51682977db86eba4417197f63e4b297bcf6dc5" exitCode=0
Sep 16 02:48:08.822522 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:08.822162    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-eee708-c9smn" event={"ID":"84dcca79-6444-408d-985a-a4daf79fd07b","Type":"ContainerDied","Data":"c7ede3689663d20aec2ce04caf51682977db86eba4417197f63e4b297bcf6dc5"}
Sep 16 02:48:09.961405 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:09.961382    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-eee708-c9smn"
Sep 16 02:48:10.034372 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:10.034344    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84dcca79-6444-408d-985a-a4daf79fd07b-maas-api-service-ca\") pod \"84dcca79-6444-408d-985a-a4daf79fd07b\" (UID: \"84dcca79-6444-408d-985a-a4daf79fd07b\") "
Sep 16 02:48:10.034634 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:10.034613    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84dcca79-6444-408d-985a-a4daf79fd07b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "84dcca79-6444-408d-985a-a4daf79fd07b" (UID: "84dcca79-6444-408d-985a-a4daf79fd07b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:48:10.135508 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:10.135454    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84dcca79-6444-408d-985a-a4daf79fd07b-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:48:10.835130 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:10.835099    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-eee708-c9smn"
Sep 16 02:48:10.835280 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:10.835149    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-eee708-c9smn" event={"ID":"84dcca79-6444-408d-985a-a4daf79fd07b","Type":"ContainerDied","Data":"c5d8cf504e403921f95354a01988d44c7d10d1b97d131511286fabfd79e66fce"}
Sep 16 02:48:10.835280 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:10.835197    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5d8cf504e403921f95354a01988d44c7d10d1b97d131511286fabfd79e66fce"
Sep 16 02:48:11.598115 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.598091    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:48:11.748165 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.748145    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/040944c9-d831-4757-96ff-667b76585c7a-istio-podinfo\") pod \"040944c9-d831-4757-96ff-667b76585c7a\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") "
Sep 16 02:48:11.748316 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.748174    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swtk9\" (UniqueName: \"kubernetes.io/projected/040944c9-d831-4757-96ff-667b76585c7a-kube-api-access-swtk9\") pod \"040944c9-d831-4757-96ff-667b76585c7a\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") "
Sep 16 02:48:11.748316 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.748199    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/040944c9-d831-4757-96ff-667b76585c7a-workload-socket\") pod \"040944c9-d831-4757-96ff-667b76585c7a\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") "
Sep 16 02:48:11.748316 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.748213    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/040944c9-d831-4757-96ff-667b76585c7a-istio-token\") pod \"040944c9-d831-4757-96ff-667b76585c7a\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") "
Sep 16 02:48:11.748316 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.748236    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/040944c9-d831-4757-96ff-667b76585c7a-istiod-ca-cert\") pod \"040944c9-d831-4757-96ff-667b76585c7a\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") "
Sep 16 02:48:11.748316 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.748308    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/040944c9-d831-4757-96ff-667b76585c7a-workload-certs\") pod \"040944c9-d831-4757-96ff-667b76585c7a\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") "
Sep 16 02:48:11.748650 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.748380    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/040944c9-d831-4757-96ff-667b76585c7a-istio-envoy\") pod \"040944c9-d831-4757-96ff-667b76585c7a\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") "
Sep 16 02:48:11.748650 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.748443    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/040944c9-d831-4757-96ff-667b76585c7a-istio-data\") pod \"040944c9-d831-4757-96ff-667b76585c7a\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") "
Sep 16 02:48:11.748650 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.748482    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/040944c9-d831-4757-96ff-667b76585c7a-credential-socket\") pod \"040944c9-d831-4757-96ff-667b76585c7a\" (UID: \"040944c9-d831-4757-96ff-667b76585c7a\") "
Sep 16 02:48:11.748650 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.748571    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/040944c9-d831-4757-96ff-667b76585c7a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "040944c9-d831-4757-96ff-667b76585c7a" (UID: "040944c9-d831-4757-96ff-667b76585c7a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:48:11.748650 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.748630    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/040944c9-d831-4757-96ff-667b76585c7a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "040944c9-d831-4757-96ff-667b76585c7a" (UID: "040944c9-d831-4757-96ff-667b76585c7a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:48:11.748983 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.748674    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/040944c9-d831-4757-96ff-667b76585c7a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "040944c9-d831-4757-96ff-667b76585c7a" (UID: "040944c9-d831-4757-96ff-667b76585c7a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:48:11.748983 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.748841    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/040944c9-d831-4757-96ff-667b76585c7a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "040944c9-d831-4757-96ff-667b76585c7a" (UID: "040944c9-d831-4757-96ff-667b76585c7a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:48:11.748983 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.748884    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/040944c9-d831-4757-96ff-667b76585c7a-istio-data" (OuterVolumeSpecName: "istio-data") pod "040944c9-d831-4757-96ff-667b76585c7a" (UID: "040944c9-d831-4757-96ff-667b76585c7a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:48:11.748983 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.748941    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/040944c9-d831-4757-96ff-667b76585c7a-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:48:11.748983 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.748959    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/040944c9-d831-4757-96ff-667b76585c7a-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:48:11.748983 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.748972    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/040944c9-d831-4757-96ff-667b76585c7a-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:48:11.748983 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.748984    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/040944c9-d831-4757-96ff-667b76585c7a-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:48:11.750487 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.750459    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/040944c9-d831-4757-96ff-667b76585c7a-kube-api-access-swtk9" (OuterVolumeSpecName: "kube-api-access-swtk9") pod "040944c9-d831-4757-96ff-667b76585c7a" (UID: "040944c9-d831-4757-96ff-667b76585c7a"). InnerVolumeSpecName "kube-api-access-swtk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:48:11.750582 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.750492    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/040944c9-d831-4757-96ff-667b76585c7a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "040944c9-d831-4757-96ff-667b76585c7a" (UID: "040944c9-d831-4757-96ff-667b76585c7a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 02:48:11.750582 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.750517    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/040944c9-d831-4757-96ff-667b76585c7a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "040944c9-d831-4757-96ff-667b76585c7a" (UID: "040944c9-d831-4757-96ff-667b76585c7a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:48:11.750582 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.750538    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/040944c9-d831-4757-96ff-667b76585c7a-istio-token" (OuterVolumeSpecName: "istio-token") pod "040944c9-d831-4757-96ff-667b76585c7a" (UID: "040944c9-d831-4757-96ff-667b76585c7a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:48:11.842643 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.842622    2565 generic.go:356] "Generic (PLEG): container finished" podID="040944c9-d831-4757-96ff-667b76585c7a" containerID="c6ba2b75ec72738fb78d219f3e74b7c0e56b8cf7c500d4d61efc8af53256a159" exitCode=0
Sep 16 02:48:11.842745 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.842668    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"
Sep 16 02:48:11.842745 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.842713    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd" event={"ID":"040944c9-d831-4757-96ff-667b76585c7a","Type":"ContainerDied","Data":"c6ba2b75ec72738fb78d219f3e74b7c0e56b8cf7c500d4d61efc8af53256a159"}
Sep 16 02:48:11.842863 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.842773    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd" event={"ID":"040944c9-d831-4757-96ff-667b76585c7a","Type":"ContainerDied","Data":"b109638ca97e367d65bc2a04bc610a3c3c3463ec4e9205ec947b9d74eaa56944"}
Sep 16 02:48:11.842863 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.842808    2565 scope.go:117] "RemoveContainer" containerID="c6ba2b75ec72738fb78d219f3e74b7c0e56b8cf7c500d4d61efc8af53256a159"
Sep 16 02:48:11.849821 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.849797    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/040944c9-d831-4757-96ff-667b76585c7a-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:48:11.849910 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.849826    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swtk9\" (UniqueName: \"kubernetes.io/projected/040944c9-d831-4757-96ff-667b76585c7a-kube-api-access-swtk9\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:48:11.849910 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.849842    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/040944c9-d831-4757-96ff-667b76585c7a-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:48:11.849910 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.849858    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/040944c9-d831-4757-96ff-667b76585c7a-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:48:11.849910 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.849871    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/040944c9-d831-4757-96ff-667b76585c7a-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:48:11.851871 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.851855    2565 scope.go:117] "RemoveContainer" containerID="50db097ac7e691a7dca543cf4072346e7e1f12410ac92f6565fdc2183891fba3"
Sep 16 02:48:11.860173 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.860154    2565 scope.go:117] "RemoveContainer" containerID="c6ba2b75ec72738fb78d219f3e74b7c0e56b8cf7c500d4d61efc8af53256a159"
Sep 16 02:48:11.860808 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:48:11.860703    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6ba2b75ec72738fb78d219f3e74b7c0e56b8cf7c500d4d61efc8af53256a159\": container with ID starting with c6ba2b75ec72738fb78d219f3e74b7c0e56b8cf7c500d4d61efc8af53256a159 not found: ID does not exist" containerID="c6ba2b75ec72738fb78d219f3e74b7c0e56b8cf7c500d4d61efc8af53256a159"
Sep 16 02:48:11.860808 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.860747    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6ba2b75ec72738fb78d219f3e74b7c0e56b8cf7c500d4d61efc8af53256a159"} err="failed to get container status \"c6ba2b75ec72738fb78d219f3e74b7c0e56b8cf7c500d4d61efc8af53256a159\": rpc error: code = NotFound desc = could not find container \"c6ba2b75ec72738fb78d219f3e74b7c0e56b8cf7c500d4d61efc8af53256a159\": container with ID starting with c6ba2b75ec72738fb78d219f3e74b7c0e56b8cf7c500d4d61efc8af53256a159 not found: ID does not exist"
Sep 16 02:48:11.860808 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.860769    2565 scope.go:117] "RemoveContainer" containerID="50db097ac7e691a7dca543cf4072346e7e1f12410ac92f6565fdc2183891fba3"
Sep 16 02:48:11.861051 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:48:11.861034    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50db097ac7e691a7dca543cf4072346e7e1f12410ac92f6565fdc2183891fba3\": container with ID starting with 50db097ac7e691a7dca543cf4072346e7e1f12410ac92f6565fdc2183891fba3 not found: ID does not exist" containerID="50db097ac7e691a7dca543cf4072346e7e1f12410ac92f6565fdc2183891fba3"
Sep 16 02:48:11.861094 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.861056    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50db097ac7e691a7dca543cf4072346e7e1f12410ac92f6565fdc2183891fba3"} err="failed to get container status \"50db097ac7e691a7dca543cf4072346e7e1f12410ac92f6565fdc2183891fba3\": rpc error: code = NotFound desc = could not find container \"50db097ac7e691a7dca543cf4072346e7e1f12410ac92f6565fdc2183891fba3\": container with ID starting with 50db097ac7e691a7dca543cf4072346e7e1f12410ac92f6565fdc2183891fba3 not found: ID does not exist"
Sep 16 02:48:11.863757 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.863734    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"]
Sep 16 02:48:11.866953 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:11.866933    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd"]
Sep 16 02:48:12.391530 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:12.391502    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="040944c9-d831-4757-96ff-667b76585c7a" path="/var/lib/kubelet/pods/040944c9-d831-4757-96ff-667b76585c7a/volumes"
Sep 16 02:48:13.385185 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:13.385152    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8" secret="" err="secret \"payload-processing-dockercfg-7v8jt\" not found"
Sep 16 02:48:17.236429 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:17.236394    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-eee708-29825445-m4c9g"]
Sep 16 02:48:17.237570 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:17.237544    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:48:17.239030 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:17.239010    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-eee708-29825445-m4c9g"]
Sep 16 02:48:17.265020 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:17.264996    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq"]
Sep 16 02:48:17.265259 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:17.265233    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq" podUID="02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2" containerName="payload-pre-processing" containerID="cri-o://2aea132380f30a334e7adecda826875d48b967cb397ded73d6c7417a732576bd" gracePeriod=30
Sep 16 02:48:17.303200 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:17.303152    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:48:17.401624 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:17.401584    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-eee708-c9smn"]
Sep 16 02:48:17.402752 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:17.402711    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:48:17.404386 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:17.404348    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-eee708-c9smn"]
Sep 16 02:48:17.478063 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:17.478033    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:48:17.520678 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:17.520658    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq"
Sep 16 02:48:17.597962 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:17.597931    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6qln\" (UniqueName: \"kubernetes.io/projected/02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2-kube-api-access-z6qln\") pod \"02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2\" (UID: \"02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2\") "
Sep 16 02:48:17.598180 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:17.598156    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2-plugins-config-volume\") pod \"02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2\" (UID: \"02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2\") "
Sep 16 02:48:17.598575 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:17.598542    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2" (UID: "02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:48:17.600152 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:17.600128    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2-kube-api-access-z6qln" (OuterVolumeSpecName: "kube-api-access-z6qln") pod "02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2" (UID: "02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2"). InnerVolumeSpecName "kube-api-access-z6qln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:48:17.699027 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:17.699001    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2-plugins-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:48:17.699027 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:17.699024    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6qln\" (UniqueName: \"kubernetes.io/projected/02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2-kube-api-access-z6qln\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:48:17.767215 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:17.767136    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:48:17.885414 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:17.885382    2565 generic.go:356] "Generic (PLEG): container finished" podID="02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2" containerID="2aea132380f30a334e7adecda826875d48b967cb397ded73d6c7417a732576bd" exitCode=0
Sep 16 02:48:17.885553 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:17.885421    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq"
Sep 16 02:48:17.885553 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:17.885451    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq" event={"ID":"02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2","Type":"ContainerDied","Data":"2aea132380f30a334e7adecda826875d48b967cb397ded73d6c7417a732576bd"}
Sep 16 02:48:17.885553 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:17.885509    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq" event={"ID":"02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2","Type":"ContainerDied","Data":"c9e717709d470403b9034c37f0c754c8af16ce1e362adbe790da037a9d916c1f"}
Sep 16 02:48:17.885553 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:17.885536    2565 scope.go:117] "RemoveContainer" containerID="2aea132380f30a334e7adecda826875d48b967cb397ded73d6c7417a732576bd"
Sep 16 02:48:17.895212 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:17.895189    2565 scope.go:117] "RemoveContainer" containerID="2aea132380f30a334e7adecda826875d48b967cb397ded73d6c7417a732576bd"
Sep 16 02:48:17.895535 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:48:17.895513    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2aea132380f30a334e7adecda826875d48b967cb397ded73d6c7417a732576bd\": container with ID starting with 2aea132380f30a334e7adecda826875d48b967cb397ded73d6c7417a732576bd not found: ID does not exist" containerID="2aea132380f30a334e7adecda826875d48b967cb397ded73d6c7417a732576bd"
Sep 16 02:48:17.895607 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:17.895543    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2aea132380f30a334e7adecda826875d48b967cb397ded73d6c7417a732576bd"} err="failed to get container status \"2aea132380f30a334e7adecda826875d48b967cb397ded73d6c7417a732576bd\": rpc error: code = NotFound desc = could not find container \"2aea132380f30a334e7adecda826875d48b967cb397ded73d6c7417a732576bd\": container with ID starting with 2aea132380f30a334e7adecda826875d48b967cb397ded73d6c7417a732576bd not found: ID does not exist"
Sep 16 02:48:17.906608 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:17.906584    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq"]
Sep 16 02:48:17.911749 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:17.911727    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq"]
Sep 16 02:48:18.391061 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:18.391027    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2" path="/var/lib/kubelet/pods/02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2/volumes"
Sep 16 02:48:18.391555 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:18.391430    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c99f0a6-4a89-4ae7-a8f6-a444c05de213" path="/var/lib/kubelet/pods/3c99f0a6-4a89-4ae7-a8f6-a444c05de213/volumes"
Sep 16 02:48:18.391780 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:18.391760    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84dcca79-6444-408d-985a-a4daf79fd07b" path="/var/lib/kubelet/pods/84dcca79-6444-408d-985a-a4daf79fd07b/volumes"
Sep 16 02:48:23.469620 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:23.469585    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:48:23.570127 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:23.570083    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:48:23.750571 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:23.750495    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"]
Sep 16 02:48:23.750739 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:23.750713    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r" podUID="65aee6e8-258a-46db-946e-35165a96aacd" containerName="istio-proxy" containerID="cri-o://5d531691e65a36af846c1f272e53dd756f2d27c5e4b636c0890432de9c43739e" gracePeriod=30
Sep 16 02:48:23.812110 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:23.812077    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:48:25.909594 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:25.909555    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f594795b-82vx5"]
Sep 16 02:48:25.934346 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:25.934309    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6f594795b-82vx5" podUID="8c308ccb-4eba-44e8-b72e-68eb989e071e" containerName="manager" containerID="cri-o://ee67ed90a0e093aa8b5829b5450dca49fc99583f96404576aa8c03dfe7e9aa2e" gracePeriod=30
Sep 16 02:48:26.184765 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:26.184739    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f594795b-82vx5"
Sep 16 02:48:26.362380 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:26.362318    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 02:48:26.362540 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:26.362402    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r" podUID="65aee6e8-258a-46db-946e-35165a96aacd" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 02:48:26.373547 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:26.373524    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c308ccb-4eba-44e8-b72e-68eb989e071e-metrics-certs\") pod \"8c308ccb-4eba-44e8-b72e-68eb989e071e\" (UID: \"8c308ccb-4eba-44e8-b72e-68eb989e071e\") "
Sep 16 02:48:26.373668 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:26.373566    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c308ccb-4eba-44e8-b72e-68eb989e071e-webhook-cert\") pod \"8c308ccb-4eba-44e8-b72e-68eb989e071e\" (UID: \"8c308ccb-4eba-44e8-b72e-68eb989e071e\") "
Sep 16 02:48:26.373668 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:26.373592    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwdgr\" (UniqueName: \"kubernetes.io/projected/8c308ccb-4eba-44e8-b72e-68eb989e071e-kube-api-access-wwdgr\") pod \"8c308ccb-4eba-44e8-b72e-68eb989e071e\" (UID: \"8c308ccb-4eba-44e8-b72e-68eb989e071e\") "
Sep 16 02:48:26.375746 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:26.375716    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c308ccb-4eba-44e8-b72e-68eb989e071e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8c308ccb-4eba-44e8-b72e-68eb989e071e" (UID: "8c308ccb-4eba-44e8-b72e-68eb989e071e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:48:26.375840 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:26.375767    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c308ccb-4eba-44e8-b72e-68eb989e071e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8c308ccb-4eba-44e8-b72e-68eb989e071e" (UID: "8c308ccb-4eba-44e8-b72e-68eb989e071e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:48:26.375880 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:26.375835    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c308ccb-4eba-44e8-b72e-68eb989e071e-kube-api-access-wwdgr" (OuterVolumeSpecName: "kube-api-access-wwdgr") pod "8c308ccb-4eba-44e8-b72e-68eb989e071e" (UID: "8c308ccb-4eba-44e8-b72e-68eb989e071e"). InnerVolumeSpecName "kube-api-access-wwdgr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:48:26.474426 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:26.474377    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c308ccb-4eba-44e8-b72e-68eb989e071e-metrics-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:48:26.474426 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:26.474395    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c308ccb-4eba-44e8-b72e-68eb989e071e-webhook-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:48:26.474426 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:26.474404    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwdgr\" (UniqueName: \"kubernetes.io/projected/8c308ccb-4eba-44e8-b72e-68eb989e071e-kube-api-access-wwdgr\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:48:26.942069 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:26.942036    2565 generic.go:356] "Generic (PLEG): container finished" podID="8c308ccb-4eba-44e8-b72e-68eb989e071e" containerID="ee67ed90a0e093aa8b5829b5450dca49fc99583f96404576aa8c03dfe7e9aa2e" exitCode=0
Sep 16 02:48:26.942513 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:26.942090    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f594795b-82vx5"
Sep 16 02:48:26.942513 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:26.942131    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f594795b-82vx5" event={"ID":"8c308ccb-4eba-44e8-b72e-68eb989e071e","Type":"ContainerDied","Data":"ee67ed90a0e093aa8b5829b5450dca49fc99583f96404576aa8c03dfe7e9aa2e"}
Sep 16 02:48:26.942513 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:26.942211    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f594795b-82vx5" event={"ID":"8c308ccb-4eba-44e8-b72e-68eb989e071e","Type":"ContainerDied","Data":"047295c7b65e0a363495ce8d5dec09008756b139742ec28aff451b44d89ed104"}
Sep 16 02:48:26.942513 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:26.942249    2565 scope.go:117] "RemoveContainer" containerID="ee67ed90a0e093aa8b5829b5450dca49fc99583f96404576aa8c03dfe7e9aa2e"
Sep 16 02:48:26.953715 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:26.953697    2565 scope.go:117] "RemoveContainer" containerID="ee67ed90a0e093aa8b5829b5450dca49fc99583f96404576aa8c03dfe7e9aa2e"
Sep 16 02:48:26.953996 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:48:26.953977    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee67ed90a0e093aa8b5829b5450dca49fc99583f96404576aa8c03dfe7e9aa2e\": container with ID starting with ee67ed90a0e093aa8b5829b5450dca49fc99583f96404576aa8c03dfe7e9aa2e not found: ID does not exist" containerID="ee67ed90a0e093aa8b5829b5450dca49fc99583f96404576aa8c03dfe7e9aa2e"
Sep 16 02:48:26.954046 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:26.954005    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee67ed90a0e093aa8b5829b5450dca49fc99583f96404576aa8c03dfe7e9aa2e"} err="failed to get container status \"ee67ed90a0e093aa8b5829b5450dca49fc99583f96404576aa8c03dfe7e9aa2e\": rpc error: code = NotFound desc = could not find container \"ee67ed90a0e093aa8b5829b5450dca49fc99583f96404576aa8c03dfe7e9aa2e\": container with ID starting with ee67ed90a0e093aa8b5829b5450dca49fc99583f96404576aa8c03dfe7e9aa2e not found: ID does not exist"
Sep 16 02:48:26.958118 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:26.958093    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f594795b-82vx5"]
Sep 16 02:48:26.961672 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:26.961649    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6f594795b-82vx5"]
Sep 16 02:48:27.636334 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:27.636297    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:48:27.737023 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:27.736995    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:48:28.396334 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:28.396291    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c308ccb-4eba-44e8-b72e-68eb989e071e" path="/var/lib/kubelet/pods/8c308ccb-4eba-44e8-b72e-68eb989e071e/volumes"
Sep 16 02:48:28.958419 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:28.958390    2565 generic.go:356] "Generic (PLEG): container finished" podID="65aee6e8-258a-46db-946e-35165a96aacd" containerID="5d531691e65a36af846c1f272e53dd756f2d27c5e4b636c0890432de9c43739e" exitCode=0
Sep 16 02:48:28.958585 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:28.958427    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r" event={"ID":"65aee6e8-258a-46db-946e-35165a96aacd","Type":"ContainerDied","Data":"5d531691e65a36af846c1f272e53dd756f2d27c5e4b636c0890432de9c43739e"}
Sep 16 02:48:28.958585 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:28.958474    2565 scope.go:117] "RemoveContainer" containerID="6e79293e8b92e556c46a803235ddbb6e829dd23c6c1956d8479b8e3dfb84940e"
Sep 16 02:48:28.994008 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:28.993989    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:48:29.096736 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.096679    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65aee6e8-258a-46db-946e-35165a96aacd-istio-envoy\") pod \"65aee6e8-258a-46db-946e-35165a96aacd\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") "
Sep 16 02:48:29.096736 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.096718    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qrcz\" (UniqueName: \"kubernetes.io/projected/65aee6e8-258a-46db-946e-35165a96aacd-kube-api-access-6qrcz\") pod \"65aee6e8-258a-46db-946e-35165a96aacd\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") "
Sep 16 02:48:29.096895 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.096745    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65aee6e8-258a-46db-946e-35165a96aacd-istiod-ca-cert\") pod \"65aee6e8-258a-46db-946e-35165a96aacd\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") "
Sep 16 02:48:29.096895 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.096773    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65aee6e8-258a-46db-946e-35165a96aacd-workload-certs\") pod \"65aee6e8-258a-46db-946e-35165a96aacd\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") "
Sep 16 02:48:29.096895 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.096872    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65aee6e8-258a-46db-946e-35165a96aacd-istio-podinfo\") pod \"65aee6e8-258a-46db-946e-35165a96aacd\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") "
Sep 16 02:48:29.097052 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.096897    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65aee6e8-258a-46db-946e-35165a96aacd-istio-data\") pod \"65aee6e8-258a-46db-946e-35165a96aacd\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") "
Sep 16 02:48:29.097052 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.096926    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65aee6e8-258a-46db-946e-35165a96aacd-istio-token\") pod \"65aee6e8-258a-46db-946e-35165a96aacd\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") "
Sep 16 02:48:29.097052 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.096954    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65aee6e8-258a-46db-946e-35165a96aacd-workload-socket\") pod \"65aee6e8-258a-46db-946e-35165a96aacd\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") "
Sep 16 02:48:29.097052 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.096991    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65aee6e8-258a-46db-946e-35165a96aacd-credential-socket\") pod \"65aee6e8-258a-46db-946e-35165a96aacd\" (UID: \"65aee6e8-258a-46db-946e-35165a96aacd\") "
Sep 16 02:48:29.097278 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.097052    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65aee6e8-258a-46db-946e-35165a96aacd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "65aee6e8-258a-46db-946e-35165a96aacd" (UID: "65aee6e8-258a-46db-946e-35165a96aacd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:48:29.097278 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.097155    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65aee6e8-258a-46db-946e-35165a96aacd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "65aee6e8-258a-46db-946e-35165a96aacd" (UID: "65aee6e8-258a-46db-946e-35165a96aacd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:48:29.097418 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.097287    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65aee6e8-258a-46db-946e-35165a96aacd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "65aee6e8-258a-46db-946e-35165a96aacd" (UID: "65aee6e8-258a-46db-946e-35165a96aacd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:48:29.097478 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.097423    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65aee6e8-258a-46db-946e-35165a96aacd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "65aee6e8-258a-46db-946e-35165a96aacd" (UID: "65aee6e8-258a-46db-946e-35165a96aacd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:48:29.097478 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.097438    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65aee6e8-258a-46db-946e-35165a96aacd-istio-data" (OuterVolumeSpecName: "istio-data") pod "65aee6e8-258a-46db-946e-35165a96aacd" (UID: "65aee6e8-258a-46db-946e-35165a96aacd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:48:29.097575 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.097485    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65aee6e8-258a-46db-946e-35165a96aacd-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:48:29.097575 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.097516    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65aee6e8-258a-46db-946e-35165a96aacd-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:48:29.097575 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.097527    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65aee6e8-258a-46db-946e-35165a96aacd-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:48:29.098965 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.098943    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65aee6e8-258a-46db-946e-35165a96aacd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "65aee6e8-258a-46db-946e-35165a96aacd" (UID: "65aee6e8-258a-46db-946e-35165a96aacd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:48:29.099111 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.098998    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65aee6e8-258a-46db-946e-35165a96aacd-kube-api-access-6qrcz" (OuterVolumeSpecName: "kube-api-access-6qrcz") pod "65aee6e8-258a-46db-946e-35165a96aacd" (UID: "65aee6e8-258a-46db-946e-35165a96aacd"). InnerVolumeSpecName "kube-api-access-6qrcz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:48:29.099325 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.099305    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65aee6e8-258a-46db-946e-35165a96aacd-istio-token" (OuterVolumeSpecName: "istio-token") pod "65aee6e8-258a-46db-946e-35165a96aacd" (UID: "65aee6e8-258a-46db-946e-35165a96aacd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:48:29.099440 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.099382    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/65aee6e8-258a-46db-946e-35165a96aacd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "65aee6e8-258a-46db-946e-35165a96aacd" (UID: "65aee6e8-258a-46db-946e-35165a96aacd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 02:48:29.198041 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.198017    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65aee6e8-258a-46db-946e-35165a96aacd-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:48:29.198041 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.198041    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qrcz\" (UniqueName: \"kubernetes.io/projected/65aee6e8-258a-46db-946e-35165a96aacd-kube-api-access-6qrcz\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:48:29.198174 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.198052    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65aee6e8-258a-46db-946e-35165a96aacd-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:48:29.198174 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.198061    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65aee6e8-258a-46db-946e-35165a96aacd-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:48:29.198174 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.198069    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65aee6e8-258a-46db-946e-35165a96aacd-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:48:29.198174 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.198076    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65aee6e8-258a-46db-946e-35165a96aacd-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:48:29.966274 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.966233    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"
Sep 16 02:48:29.966707 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.966241    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r" event={"ID":"65aee6e8-258a-46db-946e-35165a96aacd","Type":"ContainerDied","Data":"09e374501a1ec957b517bc57a6e207d177c62532af89c519494a4d7a3a9b8e32"}
Sep 16 02:48:29.966707 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.966399    2565 scope.go:117] "RemoveContainer" containerID="5d531691e65a36af846c1f272e53dd756f2d27c5e4b636c0890432de9c43739e"
Sep 16 02:48:29.991418 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.991346    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"]
Sep 16 02:48:29.994833 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:29.994805    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r"]
Sep 16 02:48:30.390986 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:30.390908    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65aee6e8-258a-46db-946e-35165a96aacd" path="/var/lib/kubelet/pods/65aee6e8-258a-46db-946e-35165a96aacd/volumes"
Sep 16 02:48:42.765872 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:42.765837    2565 scope.go:117] "RemoveContainer" containerID="2743bb876049f68313664dba31a1fa6ff47578efc399cb29026cdda2a6c1fda9"
Sep 16 02:48:52.901553 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:52.901517    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:48:54.464568 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:48:54.464525    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:49:27.795554 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:27.795505    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6f594795b-48bhs"]
Sep 16 02:49:27.796181 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:27.796075    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2" containerName="payload-pre-processing"
Sep 16 02:49:27.796181 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:27.796102    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2" containerName="payload-pre-processing"
Sep 16 02:49:27.796181 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:27.796115    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84dcca79-6444-408d-985a-a4daf79fd07b" containerName="revoke-keys"
Sep 16 02:49:27.796181 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:27.796124    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="84dcca79-6444-408d-985a-a4daf79fd07b" containerName="revoke-keys"
Sep 16 02:49:27.796181 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:27.796143    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="040944c9-d831-4757-96ff-667b76585c7a" containerName="istio-proxy"
Sep 16 02:49:27.796181 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:27.796153    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="040944c9-d831-4757-96ff-667b76585c7a" containerName="istio-proxy"
Sep 16 02:49:27.796181 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:27.796167    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c308ccb-4eba-44e8-b72e-68eb989e071e" containerName="manager"
Sep 16 02:49:27.796181 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:27.796176    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c308ccb-4eba-44e8-b72e-68eb989e071e" containerName="manager"
Sep 16 02:49:27.796638 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:27.796195    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65aee6e8-258a-46db-946e-35165a96aacd" containerName="istio-proxy"
Sep 16 02:49:27.796638 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:27.796204    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="65aee6e8-258a-46db-946e-35165a96aacd" containerName="istio-proxy"
Sep 16 02:49:27.796638 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:27.796225    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65aee6e8-258a-46db-946e-35165a96aacd" containerName="istio-proxy"
Sep 16 02:49:27.796638 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:27.796234    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="65aee6e8-258a-46db-946e-35165a96aacd" containerName="istio-proxy"
Sep 16 02:49:27.796638 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:27.796329    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c308ccb-4eba-44e8-b72e-68eb989e071e" containerName="manager"
Sep 16 02:49:27.796638 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:27.796340    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="65aee6e8-258a-46db-946e-35165a96aacd" containerName="istio-proxy"
Sep 16 02:49:27.796638 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:27.796348    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="02a61744-9d02-4e1a-b6d9-2d4f3f7d86e2" containerName="payload-pre-processing"
Sep 16 02:49:27.796638 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:27.796381    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="040944c9-d831-4757-96ff-667b76585c7a" containerName="istio-proxy"
Sep 16 02:49:27.796638 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:27.796395    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="040944c9-d831-4757-96ff-667b76585c7a" containerName="istio-proxy"
Sep 16 02:49:27.796638 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:27.796403    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="84dcca79-6444-408d-985a-a4daf79fd07b" containerName="revoke-keys"
Sep 16 02:49:27.799700 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:27.799675    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f594795b-48bhs"
Sep 16 02:49:27.802033 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:27.801999    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rvmxp\""
Sep 16 02:49:27.803132 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:27.803100    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 16 02:49:27.803263 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:27.803187    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 16 02:49:27.803354 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:27.803337    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 16 02:49:27.809417 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:27.809390    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f594795b-48bhs"]
Sep 16 02:49:27.961215 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:27.961181    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a81a1c4-de5d-4a86-89b7-d5a99a5a6328-metrics-certs\") pod \"maas-controller-6f594795b-48bhs\" (UID: \"1a81a1c4-de5d-4a86-89b7-d5a99a5a6328\") " pod="opendatahub/maas-controller-6f594795b-48bhs"
Sep 16 02:49:27.961417 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:27.961237    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a81a1c4-de5d-4a86-89b7-d5a99a5a6328-webhook-cert\") pod \"maas-controller-6f594795b-48bhs\" (UID: \"1a81a1c4-de5d-4a86-89b7-d5a99a5a6328\") " pod="opendatahub/maas-controller-6f594795b-48bhs"
Sep 16 02:49:27.961417 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:27.961318    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whtwz\" (UniqueName: \"kubernetes.io/projected/1a81a1c4-de5d-4a86-89b7-d5a99a5a6328-kube-api-access-whtwz\") pod \"maas-controller-6f594795b-48bhs\" (UID: \"1a81a1c4-de5d-4a86-89b7-d5a99a5a6328\") " pod="opendatahub/maas-controller-6f594795b-48bhs"
Sep 16 02:49:28.061915 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:28.061851    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a81a1c4-de5d-4a86-89b7-d5a99a5a6328-metrics-certs\") pod \"maas-controller-6f594795b-48bhs\" (UID: \"1a81a1c4-de5d-4a86-89b7-d5a99a5a6328\") " pod="opendatahub/maas-controller-6f594795b-48bhs"
Sep 16 02:49:28.061915 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:28.061909    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a81a1c4-de5d-4a86-89b7-d5a99a5a6328-webhook-cert\") pod \"maas-controller-6f594795b-48bhs\" (UID: \"1a81a1c4-de5d-4a86-89b7-d5a99a5a6328\") " pod="opendatahub/maas-controller-6f594795b-48bhs"
Sep 16 02:49:28.062053 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:28.061965    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whtwz\" (UniqueName: \"kubernetes.io/projected/1a81a1c4-de5d-4a86-89b7-d5a99a5a6328-kube-api-access-whtwz\") pod \"maas-controller-6f594795b-48bhs\" (UID: \"1a81a1c4-de5d-4a86-89b7-d5a99a5a6328\") " pod="opendatahub/maas-controller-6f594795b-48bhs"
Sep 16 02:49:28.064724 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:28.064698    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a81a1c4-de5d-4a86-89b7-d5a99a5a6328-webhook-cert\") pod \"maas-controller-6f594795b-48bhs\" (UID: \"1a81a1c4-de5d-4a86-89b7-d5a99a5a6328\") " pod="opendatahub/maas-controller-6f594795b-48bhs"
Sep 16 02:49:28.064839 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:28.064741    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a81a1c4-de5d-4a86-89b7-d5a99a5a6328-metrics-certs\") pod \"maas-controller-6f594795b-48bhs\" (UID: \"1a81a1c4-de5d-4a86-89b7-d5a99a5a6328\") " pod="opendatahub/maas-controller-6f594795b-48bhs"
Sep 16 02:49:28.069565 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:28.069532    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whtwz\" (UniqueName: \"kubernetes.io/projected/1a81a1c4-de5d-4a86-89b7-d5a99a5a6328-kube-api-access-whtwz\") pod \"maas-controller-6f594795b-48bhs\" (UID: \"1a81a1c4-de5d-4a86-89b7-d5a99a5a6328\") " pod="opendatahub/maas-controller-6f594795b-48bhs"
Sep 16 02:49:28.112283 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:28.112260    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f594795b-48bhs"
Sep 16 02:49:28.383190 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:28.383164    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f594795b-48bhs"]
Sep 16 02:49:28.384859 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:49:28.384833    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a81a1c4_de5d_4a86_89b7_d5a99a5a6328.slice/crio-67044ef102a2778397102ed17f662628583cf7b129fb5370f89c77db773739ad WatchSource:0}: Error finding container 67044ef102a2778397102ed17f662628583cf7b129fb5370f89c77db773739ad: Status 404 returned error can't find the container with id 67044ef102a2778397102ed17f662628583cf7b129fb5370f89c77db773739ad
Sep 16 02:49:28.386055 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:28.386036    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 02:49:29.319596 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:29.319553    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f594795b-48bhs" event={"ID":"1a81a1c4-de5d-4a86-89b7-d5a99a5a6328","Type":"ContainerStarted","Data":"e647b673521c4865b0d61fa75b730d6639fc750572a13a380afbf803caf30472"}
Sep 16 02:49:29.319971 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:29.319641    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f594795b-48bhs" event={"ID":"1a81a1c4-de5d-4a86-89b7-d5a99a5a6328","Type":"ContainerStarted","Data":"67044ef102a2778397102ed17f662628583cf7b129fb5370f89c77db773739ad"}
Sep 16 02:49:29.319971 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:29.319767    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6f594795b-48bhs"
Sep 16 02:49:29.335962 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:29.335916    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6f594795b-48bhs" podStartSLOduration=1.908008935 podStartE2EDuration="2.335904135s" totalImagesPullingTime="427.8952ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:49:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:49:29.333776605 +0000 UTC m=+1847.384121095" watchObservedRunningTime="2026-09-16 02:49:29.335904135 +0000 UTC m=+1847.386248628"
Sep 16 02:49:33.384700 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:33.384669    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8" secret="" err="secret \"payload-processing-dockercfg-7v8jt\" not found"
Sep 16 02:49:40.328097 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:40.328069    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6f594795b-48bhs"
Sep 16 02:49:51.628252 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:51.628218    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:49:51.736060 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:51.736021    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f594795b-48bhs"]
Sep 16 02:49:51.736316 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:51.736263    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6f594795b-48bhs" podUID="1a81a1c4-de5d-4a86-89b7-d5a99a5a6328" containerName="manager" containerID="cri-o://e647b673521c4865b0d61fa75b730d6639fc750572a13a380afbf803caf30472" gracePeriod=30
Sep 16 02:49:51.973324 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:51.973301    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f594795b-48bhs"
Sep 16 02:49:52.056831 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:52.056803    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whtwz\" (UniqueName: \"kubernetes.io/projected/1a81a1c4-de5d-4a86-89b7-d5a99a5a6328-kube-api-access-whtwz\") pod \"1a81a1c4-de5d-4a86-89b7-d5a99a5a6328\" (UID: \"1a81a1c4-de5d-4a86-89b7-d5a99a5a6328\") "
Sep 16 02:49:52.056831 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:52.056838    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a81a1c4-de5d-4a86-89b7-d5a99a5a6328-webhook-cert\") pod \"1a81a1c4-de5d-4a86-89b7-d5a99a5a6328\" (UID: \"1a81a1c4-de5d-4a86-89b7-d5a99a5a6328\") "
Sep 16 02:49:52.057015 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:52.056857    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a81a1c4-de5d-4a86-89b7-d5a99a5a6328-metrics-certs\") pod \"1a81a1c4-de5d-4a86-89b7-d5a99a5a6328\" (UID: \"1a81a1c4-de5d-4a86-89b7-d5a99a5a6328\") "
Sep 16 02:49:52.058901 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:52.058875    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a81a1c4-de5d-4a86-89b7-d5a99a5a6328-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1a81a1c4-de5d-4a86-89b7-d5a99a5a6328" (UID: "1a81a1c4-de5d-4a86-89b7-d5a99a5a6328"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:49:52.059017 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:52.058999    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a81a1c4-de5d-4a86-89b7-d5a99a5a6328-kube-api-access-whtwz" (OuterVolumeSpecName: "kube-api-access-whtwz") pod "1a81a1c4-de5d-4a86-89b7-d5a99a5a6328" (UID: "1a81a1c4-de5d-4a86-89b7-d5a99a5a6328"). InnerVolumeSpecName "kube-api-access-whtwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:49:52.059017 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:52.058999    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a81a1c4-de5d-4a86-89b7-d5a99a5a6328-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1a81a1c4-de5d-4a86-89b7-d5a99a5a6328" (UID: "1a81a1c4-de5d-4a86-89b7-d5a99a5a6328"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:49:52.158351 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:52.158329    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whtwz\" (UniqueName: \"kubernetes.io/projected/1a81a1c4-de5d-4a86-89b7-d5a99a5a6328-kube-api-access-whtwz\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:49:52.158487 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:52.158352    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a81a1c4-de5d-4a86-89b7-d5a99a5a6328-webhook-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:49:52.158487 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:52.158383    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a81a1c4-de5d-4a86-89b7-d5a99a5a6328-metrics-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 16 02:49:52.458092 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:52.458028    2565 generic.go:356] "Generic (PLEG): container finished" podID="1a81a1c4-de5d-4a86-89b7-d5a99a5a6328" containerID="e647b673521c4865b0d61fa75b730d6639fc750572a13a380afbf803caf30472" exitCode=0
Sep 16 02:49:52.458092 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:52.458071    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f594795b-48bhs"
Sep 16 02:49:52.458254 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:52.458103    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f594795b-48bhs" event={"ID":"1a81a1c4-de5d-4a86-89b7-d5a99a5a6328","Type":"ContainerDied","Data":"e647b673521c4865b0d61fa75b730d6639fc750572a13a380afbf803caf30472"}
Sep 16 02:49:52.458254 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:52.458154    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f594795b-48bhs" event={"ID":"1a81a1c4-de5d-4a86-89b7-d5a99a5a6328","Type":"ContainerDied","Data":"67044ef102a2778397102ed17f662628583cf7b129fb5370f89c77db773739ad"}
Sep 16 02:49:52.458254 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:52.458176    2565 scope.go:117] "RemoveContainer" containerID="e647b673521c4865b0d61fa75b730d6639fc750572a13a380afbf803caf30472"
Sep 16 02:49:52.467585 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:52.467559    2565 scope.go:117] "RemoveContainer" containerID="e647b673521c4865b0d61fa75b730d6639fc750572a13a380afbf803caf30472"
Sep 16 02:49:52.467880 ip-10-0-137-62 kubenswrapper[2565]: E0916 02:49:52.467860    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e647b673521c4865b0d61fa75b730d6639fc750572a13a380afbf803caf30472\": container with ID starting with e647b673521c4865b0d61fa75b730d6639fc750572a13a380afbf803caf30472 not found: ID does not exist" containerID="e647b673521c4865b0d61fa75b730d6639fc750572a13a380afbf803caf30472"
Sep 16 02:49:52.467946 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:52.467890    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e647b673521c4865b0d61fa75b730d6639fc750572a13a380afbf803caf30472"} err="failed to get container status \"e647b673521c4865b0d61fa75b730d6639fc750572a13a380afbf803caf30472\": rpc error: code = NotFound desc = could not find container \"e647b673521c4865b0d61fa75b730d6639fc750572a13a380afbf803caf30472\": container with ID starting with e647b673521c4865b0d61fa75b730d6639fc750572a13a380afbf803caf30472 not found: ID does not exist"
Sep 16 02:49:52.475539 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:52.475519    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f594795b-48bhs"]
Sep 16 02:49:52.478767 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:52.478746    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6f594795b-48bhs"]
Sep 16 02:49:53.143050 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:53.142997    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:49:53.253099 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:53.253061    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6f594795b-6mx8z"]
Sep 16 02:49:53.253520 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:53.253500    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="040944c9-d831-4757-96ff-667b76585c7a" containerName="istio-proxy"
Sep 16 02:49:53.253520 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:53.253521    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="040944c9-d831-4757-96ff-667b76585c7a" containerName="istio-proxy"
Sep 16 02:49:53.253783 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:53.253538    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a81a1c4-de5d-4a86-89b7-d5a99a5a6328" containerName="manager"
Sep 16 02:49:53.253783 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:53.253547    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a81a1c4-de5d-4a86-89b7-d5a99a5a6328" containerName="manager"
Sep 16 02:49:53.253783 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:53.253655    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a81a1c4-de5d-4a86-89b7-d5a99a5a6328" containerName="manager"
Sep 16 02:49:53.253783 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:53.253670    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="65aee6e8-258a-46db-946e-35165a96aacd" containerName="istio-proxy"
Sep 16 02:49:53.258035 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:53.258013    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f594795b-6mx8z"
Sep 16 02:49:53.261199 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:53.261166    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 16 02:49:53.261591 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:53.261337    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rvmxp\""
Sep 16 02:49:53.261591 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:53.261558    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 16 02:49:53.261837 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:53.261817    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 16 02:49:53.264533 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:53.264503    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f594795b-6mx8z"]
Sep 16 02:49:53.368219 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:53.368193    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6316011c-33c5-4ce7-9a9e-724894f0a0ee-webhook-cert\") pod \"maas-controller-6f594795b-6mx8z\" (UID: \"6316011c-33c5-4ce7-9a9e-724894f0a0ee\") " pod="opendatahub/maas-controller-6f594795b-6mx8z"
Sep 16 02:49:53.368327 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:53.368253    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6smv\" (UniqueName: \"kubernetes.io/projected/6316011c-33c5-4ce7-9a9e-724894f0a0ee-kube-api-access-t6smv\") pod \"maas-controller-6f594795b-6mx8z\" (UID: \"6316011c-33c5-4ce7-9a9e-724894f0a0ee\") " pod="opendatahub/maas-controller-6f594795b-6mx8z"
Sep 16 02:49:53.368327 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:53.368274    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6316011c-33c5-4ce7-9a9e-724894f0a0ee-metrics-certs\") pod \"maas-controller-6f594795b-6mx8z\" (UID: \"6316011c-33c5-4ce7-9a9e-724894f0a0ee\") " pod="opendatahub/maas-controller-6f594795b-6mx8z"
Sep 16 02:49:53.468751 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:53.468724    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6smv\" (UniqueName: \"kubernetes.io/projected/6316011c-33c5-4ce7-9a9e-724894f0a0ee-kube-api-access-t6smv\") pod \"maas-controller-6f594795b-6mx8z\" (UID: \"6316011c-33c5-4ce7-9a9e-724894f0a0ee\") " pod="opendatahub/maas-controller-6f594795b-6mx8z"
Sep 16 02:49:53.468891 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:53.468756    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6316011c-33c5-4ce7-9a9e-724894f0a0ee-metrics-certs\") pod \"maas-controller-6f594795b-6mx8z\" (UID: \"6316011c-33c5-4ce7-9a9e-724894f0a0ee\") " pod="opendatahub/maas-controller-6f594795b-6mx8z"
Sep 16 02:49:53.468891 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:53.468798    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6316011c-33c5-4ce7-9a9e-724894f0a0ee-webhook-cert\") pod \"maas-controller-6f594795b-6mx8z\" (UID: \"6316011c-33c5-4ce7-9a9e-724894f0a0ee\") " pod="opendatahub/maas-controller-6f594795b-6mx8z"
Sep 16 02:49:53.471472 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:53.471446    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6316011c-33c5-4ce7-9a9e-724894f0a0ee-webhook-cert\") pod \"maas-controller-6f594795b-6mx8z\" (UID: \"6316011c-33c5-4ce7-9a9e-724894f0a0ee\") " pod="opendatahub/maas-controller-6f594795b-6mx8z"
Sep 16 02:49:53.471634 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:53.471607    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6316011c-33c5-4ce7-9a9e-724894f0a0ee-metrics-certs\") pod \"maas-controller-6f594795b-6mx8z\" (UID: \"6316011c-33c5-4ce7-9a9e-724894f0a0ee\") " pod="opendatahub/maas-controller-6f594795b-6mx8z"
Sep 16 02:49:53.476542 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:53.476517    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6smv\" (UniqueName: \"kubernetes.io/projected/6316011c-33c5-4ce7-9a9e-724894f0a0ee-kube-api-access-t6smv\") pod \"maas-controller-6f594795b-6mx8z\" (UID: \"6316011c-33c5-4ce7-9a9e-724894f0a0ee\") " pod="opendatahub/maas-controller-6f594795b-6mx8z"
Sep 16 02:49:53.570516 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:53.570486    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f594795b-6mx8z"
Sep 16 02:49:53.843497 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:53.843296    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f594795b-6mx8z"]
Sep 16 02:49:53.846461 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:49:53.846426    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6316011c_33c5_4ce7_9a9e_724894f0a0ee.slice/crio-8e181f2ae5c8049582e45957c3c8578b77c878bb0bbdd2a34e228c722694dd30 WatchSource:0}: Error finding container 8e181f2ae5c8049582e45957c3c8578b77c878bb0bbdd2a34e228c722694dd30: Status 404 returned error can't find the container with id 8e181f2ae5c8049582e45957c3c8578b77c878bb0bbdd2a34e228c722694dd30
Sep 16 02:49:54.390570 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:54.390536    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a81a1c4-de5d-4a86-89b7-d5a99a5a6328" path="/var/lib/kubelet/pods/1a81a1c4-de5d-4a86-89b7-d5a99a5a6328/volumes"
Sep 16 02:49:54.472226 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:54.472195    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f594795b-6mx8z" event={"ID":"6316011c-33c5-4ce7-9a9e-724894f0a0ee","Type":"ContainerStarted","Data":"2a0dcc1c9a2b069430f5e81101a158a68658b7975bce2e83e6f687a2ef01fc4f"}
Sep 16 02:49:54.472352 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:54.472252    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f594795b-6mx8z" event={"ID":"6316011c-33c5-4ce7-9a9e-724894f0a0ee","Type":"ContainerStarted","Data":"8e181f2ae5c8049582e45957c3c8578b77c878bb0bbdd2a34e228c722694dd30"}
Sep 16 02:49:54.472352 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:54.472303    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6f594795b-6mx8z"
Sep 16 02:49:54.490132 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:49:54.490085    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6f594795b-6mx8z" podStartSLOduration=1.04505094 podStartE2EDuration="1.490070498s" totalImagesPullingTime="445.019558ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:49:54.4865098 +0000 UTC m=+1872.536854311" watchObservedRunningTime="2026-09-16 02:49:54.490070498 +0000 UTC m=+1872.540415018"
Sep 16 02:50:05.480663 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:50:05.480572    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6f594795b-6mx8z"
Sep 16 02:50:40.385183 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:50:40.385145    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8" secret="" err="secret \"payload-processing-dockercfg-7v8jt\" not found"
Sep 16 02:51:01.959250 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:51:01.959208    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:51:02.057231 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:51:02.057199    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:51:42.830835 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:51:42.830755    2565 scope.go:117] "RemoveContainer" containerID="0f4ccc165dc6ccb48444c2efa9d3b4bbb1758786459459397fb6fb212a9b1b02"
Sep 16 02:51:42.840221 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:51:42.840196    2565 scope.go:117] "RemoveContainer" containerID="0e9a0726d59fa6996c2c93c126fe2df1ba0cda3fef9b42f148b54a7c29379e55"
Sep 16 02:51:42.848378 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:51:42.848336    2565 scope.go:117] "RemoveContainer" containerID="ece0b6fff8c9d19b83c7238d7457354097cb5d1aba983eb6de63009bf7716627"
Sep 16 02:51:45.321039 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:51:45.321004    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:51:50.686733 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:51:50.686690    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:52:01.384680 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:52:01.384644    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8" secret="" err="secret \"payload-processing-dockercfg-7v8jt\" not found"
Sep 16 02:52:15.167479 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:52:15.167437    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:52:15.268952 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:52:15.268918    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:52:42.877334 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:52:42.877292    2565 scope.go:117] "RemoveContainer" containerID="578b1030f7d8c3e51c3ee3805a9570f9f771795d9d794ab953913c202d79d162"
Sep 16 02:52:42.885906 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:52:42.885886    2565 scope.go:117] "RemoveContainer" containerID="19433515695a24b02673a7ddaa3c4e9b7af5638a31216416972017ee0893912d"
Sep 16 02:52:53.266402 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:52:53.266356    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:52:59.436122 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:52:59.436089    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:53:15.385007 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:53:15.384918    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8" secret="" err="secret \"payload-processing-dockercfg-7v8jt\" not found"
Sep 16 02:53:33.318587 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:53:33.318553    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:53:39.977543 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:53:39.977507    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:53:41.775554 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:53:41.775516    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:53:42.912480 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:53:42.912449    2565 scope.go:117] "RemoveContainer" containerID="6f99d6ec7d529512cc7db63a8349fdd4f87cb36814bd8d8b3936479ad94f2257"
Sep 16 02:54:33.385420 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:54:33.385383    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8" secret="" err="secret \"payload-processing-dockercfg-7v8jt\" not found"
Sep 16 02:54:42.932245 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:54:42.932147    2565 scope.go:117] "RemoveContainer" containerID="9ef13d7b9c8d26b510982d5de02117e541d63872a7e92e817ccd18198f9abeac"
Sep 16 02:54:42.941828 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:54:42.941805    2565 scope.go:117] "RemoveContainer" containerID="c7ede3689663d20aec2ce04caf51682977db86eba4417197f63e4b297bcf6dc5"
Sep 16 02:55:53.385654 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:55:53.385614    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8" secret="" err="secret \"payload-processing-dockercfg-7v8jt\" not found"
Sep 16 02:57:01.385100 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:01.385064    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8" secret="" err="secret \"payload-processing-dockercfg-7v8jt\" not found"
Sep 16 02:57:30.191053 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:30.191017    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:57:31.812587 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:31.812552    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:57:33.821262 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:33.821212    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log" limit=1024
Sep 16 02:57:34.287468 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:34.287437    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5z7kc_4b569dfd-1a91-4dfd-a893-355d2a94681c/global-pull-secret-syncer/0.log"
Sep 16 02:57:34.432896 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:34.432870    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-j8mcn_7e92efdb-9c85-4515-9195-1fdb836771ae/konnectivity-agent/0.log"
Sep 16 02:57:34.553104 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:34.553026    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-62.ec2.internal_9119e0687bd7d52fed7d7ab65f2ce9e1/haproxy/0.log"
Sep 16 02:57:41.149005 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:41.148935    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2167a2d5-5649-4538-b2e7-55a713b3c794/alertmanager/0.log"
Sep 16 02:57:41.171945 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:41.171918    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2167a2d5-5649-4538-b2e7-55a713b3c794/config-reloader/0.log"
Sep 16 02:57:41.196079 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:41.196057    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2167a2d5-5649-4538-b2e7-55a713b3c794/kube-rbac-proxy-web/0.log"
Sep 16 02:57:41.224678 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:41.224656    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2167a2d5-5649-4538-b2e7-55a713b3c794/kube-rbac-proxy/0.log"
Sep 16 02:57:41.245850 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:41.245829    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2167a2d5-5649-4538-b2e7-55a713b3c794/kube-rbac-proxy-metric/0.log"
Sep 16 02:57:41.269022 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:41.268994    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2167a2d5-5649-4538-b2e7-55a713b3c794/prom-label-proxy/0.log"
Sep 16 02:57:41.289270 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:41.289250    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2167a2d5-5649-4538-b2e7-55a713b3c794/init-config-reloader/0.log"
Sep 16 02:57:41.462102 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:41.462080    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-plzgf_597f5055-e714-4c18-8217-c33dc5b785e6/monitoring-plugin/0.log"
Sep 16 02:57:41.513080 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:41.513062    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fmr8r_ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6/node-exporter/0.log"
Sep 16 02:57:41.536492 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:41.536476    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fmr8r_ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6/kube-rbac-proxy/0.log"
Sep 16 02:57:41.558401 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:41.558378    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fmr8r_ac8eda9d-aeda-41a5-96ce-c1734ae0b1b6/init-textfile/0.log"
Sep 16 02:57:41.760223 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:41.760158    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-tdd7g_2ec7313b-82d8-4c4c-8bf7-5dcdf2387851/kube-rbac-proxy-main/0.log"
Sep 16 02:57:41.780355 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:41.780328    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-tdd7g_2ec7313b-82d8-4c4c-8bf7-5dcdf2387851/kube-rbac-proxy-self/0.log"
Sep 16 02:57:41.809564 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:41.809536    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-tdd7g_2ec7313b-82d8-4c4c-8bf7-5dcdf2387851/openshift-state-metrics/0.log"
Sep 16 02:57:42.107849 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:42.107769    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56d69fd86-k7t96_182043a0-fc81-4e3f-857a-b663267ef5cb/telemeter-client/0.log"
Sep 16 02:57:42.130598 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:42.130573    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56d69fd86-k7t96_182043a0-fc81-4e3f-857a-b663267ef5cb/reload/0.log"
Sep 16 02:57:42.149772 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:42.149742    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56d69fd86-k7t96_182043a0-fc81-4e3f-857a-b663267ef5cb/kube-rbac-proxy/0.log"
Sep 16 02:57:44.858297 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:44.858267    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5cc69984b8-wjjq4_822095f4-8797-46dc-9f8a-23e8f3266271/console/0.log"
Sep 16 02:57:44.888738 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:44.888714    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-28zx4_e97c2084-e633-418b-a513-a1ea5875e1ba/download-server/0.log"
Sep 16 02:57:45.066255 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:45.066225    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fv4vf/perf-node-gather-daemonset-cfthl"]
Sep 16 02:57:45.069739 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:45.069723    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fv4vf/perf-node-gather-daemonset-cfthl"
Sep 16 02:57:45.072380 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:45.072345    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fv4vf\"/\"default-dockercfg-nxld2\""
Sep 16 02:57:45.072493 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:45.072396    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fv4vf\"/\"openshift-service-ca.crt\""
Sep 16 02:57:45.073259 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:45.073241    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fv4vf\"/\"kube-root-ca.crt\""
Sep 16 02:57:45.079100 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:45.079079    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fv4vf/perf-node-gather-daemonset-cfthl"]
Sep 16 02:57:45.220615 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:45.220588    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f79562ce-59dc-496d-b0fe-71ac7b135b20-proc\") pod \"perf-node-gather-daemonset-cfthl\" (UID: \"f79562ce-59dc-496d-b0fe-71ac7b135b20\") " pod="openshift-must-gather-fv4vf/perf-node-gather-daemonset-cfthl"
Sep 16 02:57:45.220792 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:45.220640    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f79562ce-59dc-496d-b0fe-71ac7b135b20-sys\") pod \"perf-node-gather-daemonset-cfthl\" (UID: \"f79562ce-59dc-496d-b0fe-71ac7b135b20\") " pod="openshift-must-gather-fv4vf/perf-node-gather-daemonset-cfthl"
Sep 16 02:57:45.220792 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:45.220700    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f79562ce-59dc-496d-b0fe-71ac7b135b20-podres\") pod \"perf-node-gather-daemonset-cfthl\" (UID: \"f79562ce-59dc-496d-b0fe-71ac7b135b20\") " pod="openshift-must-gather-fv4vf/perf-node-gather-daemonset-cfthl"
Sep 16 02:57:45.220792 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:45.220722    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kg24\" (UniqueName: \"kubernetes.io/projected/f79562ce-59dc-496d-b0fe-71ac7b135b20-kube-api-access-9kg24\") pod \"perf-node-gather-daemonset-cfthl\" (UID: \"f79562ce-59dc-496d-b0fe-71ac7b135b20\") " pod="openshift-must-gather-fv4vf/perf-node-gather-daemonset-cfthl"
Sep 16 02:57:45.220936 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:45.220791    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f79562ce-59dc-496d-b0fe-71ac7b135b20-lib-modules\") pod \"perf-node-gather-daemonset-cfthl\" (UID: \"f79562ce-59dc-496d-b0fe-71ac7b135b20\") " pod="openshift-must-gather-fv4vf/perf-node-gather-daemonset-cfthl"
Sep 16 02:57:45.321700 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:45.321666    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f79562ce-59dc-496d-b0fe-71ac7b135b20-proc\") pod \"perf-node-gather-daemonset-cfthl\" (UID: \"f79562ce-59dc-496d-b0fe-71ac7b135b20\") " pod="openshift-must-gather-fv4vf/perf-node-gather-daemonset-cfthl"
Sep 16 02:57:45.321866 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:45.321718    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f79562ce-59dc-496d-b0fe-71ac7b135b20-sys\") pod \"perf-node-gather-daemonset-cfthl\" (UID: \"f79562ce-59dc-496d-b0fe-71ac7b135b20\") " pod="openshift-must-gather-fv4vf/perf-node-gather-daemonset-cfthl"
Sep 16 02:57:45.321866 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:45.321746    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f79562ce-59dc-496d-b0fe-71ac7b135b20-podres\") pod \"perf-node-gather-daemonset-cfthl\" (UID: \"f79562ce-59dc-496d-b0fe-71ac7b135b20\") " pod="openshift-must-gather-fv4vf/perf-node-gather-daemonset-cfthl"
Sep 16 02:57:45.321866 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:45.321776    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kg24\" (UniqueName: \"kubernetes.io/projected/f79562ce-59dc-496d-b0fe-71ac7b135b20-kube-api-access-9kg24\") pod \"perf-node-gather-daemonset-cfthl\" (UID: \"f79562ce-59dc-496d-b0fe-71ac7b135b20\") " pod="openshift-must-gather-fv4vf/perf-node-gather-daemonset-cfthl"
Sep 16 02:57:45.321866 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:45.321787    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f79562ce-59dc-496d-b0fe-71ac7b135b20-proc\") pod \"perf-node-gather-daemonset-cfthl\" (UID: \"f79562ce-59dc-496d-b0fe-71ac7b135b20\") " pod="openshift-must-gather-fv4vf/perf-node-gather-daemonset-cfthl"
Sep 16 02:57:45.321866 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:45.321853    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f79562ce-59dc-496d-b0fe-71ac7b135b20-sys\") pod \"perf-node-gather-daemonset-cfthl\" (UID: \"f79562ce-59dc-496d-b0fe-71ac7b135b20\") " pod="openshift-must-gather-fv4vf/perf-node-gather-daemonset-cfthl"
Sep 16 02:57:45.322121 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:45.321856    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f79562ce-59dc-496d-b0fe-71ac7b135b20-lib-modules\") pod \"perf-node-gather-daemonset-cfthl\" (UID: \"f79562ce-59dc-496d-b0fe-71ac7b135b20\") " pod="openshift-must-gather-fv4vf/perf-node-gather-daemonset-cfthl"
Sep 16 02:57:45.322121 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:45.321908    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f79562ce-59dc-496d-b0fe-71ac7b135b20-podres\") pod \"perf-node-gather-daemonset-cfthl\" (UID: \"f79562ce-59dc-496d-b0fe-71ac7b135b20\") " pod="openshift-must-gather-fv4vf/perf-node-gather-daemonset-cfthl"
Sep 16 02:57:45.322121 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:45.321927    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f79562ce-59dc-496d-b0fe-71ac7b135b20-lib-modules\") pod \"perf-node-gather-daemonset-cfthl\" (UID: \"f79562ce-59dc-496d-b0fe-71ac7b135b20\") " pod="openshift-must-gather-fv4vf/perf-node-gather-daemonset-cfthl"
Sep 16 02:57:45.329545 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:45.329522    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kg24\" (UniqueName: \"kubernetes.io/projected/f79562ce-59dc-496d-b0fe-71ac7b135b20-kube-api-access-9kg24\") pod \"perf-node-gather-daemonset-cfthl\" (UID: \"f79562ce-59dc-496d-b0fe-71ac7b135b20\") " pod="openshift-must-gather-fv4vf/perf-node-gather-daemonset-cfthl"
Sep 16 02:57:45.380649 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:45.380618    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fv4vf/perf-node-gather-daemonset-cfthl"
Sep 16 02:57:45.652836 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:45.652812    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fv4vf/perf-node-gather-daemonset-cfthl"]
Sep 16 02:57:45.654087 ip-10-0-137-62 kubenswrapper[2565]: W0916 02:57:45.654045    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf79562ce_59dc_496d_b0fe_71ac7b135b20.slice/crio-23b35c925799734e7619134e5c1c84814f7acc62fc704677572b5318ae89fee1 WatchSource:0}: Error finding container 23b35c925799734e7619134e5c1c84814f7acc62fc704677572b5318ae89fee1: Status 404 returned error can't find the container with id 23b35c925799734e7619134e5c1c84814f7acc62fc704677572b5318ae89fee1
Sep 16 02:57:46.120272 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:46.120236    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fv4vf/perf-node-gather-daemonset-cfthl" event={"ID":"f79562ce-59dc-496d-b0fe-71ac7b135b20","Type":"ContainerStarted","Data":"b533c0d5e0c3afce9a0c23aa302af4853386b40e8c6bf3f77c63e8c619c8b587"}
Sep 16 02:57:46.120741 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:46.120295    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fv4vf/perf-node-gather-daemonset-cfthl" event={"ID":"f79562ce-59dc-496d-b0fe-71ac7b135b20","Type":"ContainerStarted","Data":"23b35c925799734e7619134e5c1c84814f7acc62fc704677572b5318ae89fee1"}
Sep 16 02:57:46.120741 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:46.120390    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fv4vf/perf-node-gather-daemonset-cfthl"
Sep 16 02:57:46.134698 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:46.134654    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fv4vf/perf-node-gather-daemonset-cfthl" podStartSLOduration=1.13463974 podStartE2EDuration="1.13463974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 02:57:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:57:46.133722855 +0000 UTC m=+2344.184067369" watchObservedRunningTime="2026-09-16 02:57:46.13463974 +0000 UTC m=+2344.184984233"
Sep 16 02:57:46.809740 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:46.809708    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gz9mz_62b1f3ce-a76e-4c6d-8108-ffe145dd98a3/dns/0.log"
Sep 16 02:57:46.828566 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:46.828539    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gz9mz_62b1f3ce-a76e-4c6d-8108-ffe145dd98a3/kube-rbac-proxy/0.log"
Sep 16 02:57:46.936133 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:46.936103    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-znbz8_f343f46e-3e8c-4d87-a516-5e37eeb16035/dns-node-resolver/0.log"
Sep 16 02:57:47.473591 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:47.473562    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-64594f967d-5d94c_d0a3b230-68f1-4b0e-bd12-7958e83505b5/registry/0.log"
Sep 16 02:57:47.543650 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:47.543626    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jhvrv_6a767a10-1fc2-4f3c-b655-74c71d814656/node-ca/0.log"
Sep 16 02:57:48.444511 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:48.444484    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl_b9fd013c-2c32-4366-8fe2-98c6b8b097c8/istio-proxy/0.log"
Sep 16 02:57:48.774585 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:48.774506    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-gdrj9_3a28e95a-1262-4c3f-82a3-198beec0a7dc/discovery/0.log"
Sep 16 02:57:48.873016 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:48.872988    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-6cd864bc95-vrcw8_4ea77906-c510-4fe3-97c7-ecf122c3a86a/payload-pre-processing/0.log"
Sep 16 02:57:49.940204 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:49.940178    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gmh95_3514ea95-b101-4089-b26a-d663d7865dd9/serve-healthcheck-canary/0.log"
Sep 16 02:57:50.493801 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:50.493773    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kgfsm_4e7c13f3-f878-4c05-93e5-b2939da20191/kube-rbac-proxy/0.log"
Sep 16 02:57:50.512911 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:50.512888    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kgfsm_4e7c13f3-f878-4c05-93e5-b2939da20191/exporter/0.log"
Sep 16 02:57:50.534880 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:50.534855    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kgfsm_4e7c13f3-f878-4c05-93e5-b2939da20191/extractor/0.log"
Sep 16 02:57:52.135342 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:52.135310    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fv4vf/perf-node-gather-daemonset-cfthl"
Sep 16 02:57:53.178206 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:53.178175    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6f594795b-6mx8z_6316011c-33c5-4ce7-9a9e-724894f0a0ee/manager/0.log"
Sep 16 02:57:53.197476 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:53.197452    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-drgfc_1d14ed0f-f87a-4a2b-859b-fe3044d4302c/server/0.log"
Sep 16 02:57:53.274822 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:53.274794    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-t9htj_0e253ed5-c778-481a-99dd-57e7ad152373/manager/0.log"
Sep 16 02:57:53.297661 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:53.297638    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-599b75f66d-dkpvk_28a73677-4241-42ba-9d5c-c10ad8fa3c7e/manager/0.log"
Sep 16 02:57:53.317026 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:53.317004    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-599b75f66d-dkpvk_28a73677-4241-42ba-9d5c-c10ad8fa3c7e/copy-manifests/0.log"
Sep 16 02:57:54.966801 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:54.966772    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-54ff6bb656-2x6d2_d838c72f-30dc-484a-87c9-5aeffb4b8361/manager/0.log"
Sep 16 02:57:55.015469 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:55.015447    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-7wdn2_a8ca801a-6998-4bf0-850f-01e7d321f75b/openshift-lws-operator/0.log"
Sep 16 02:57:55.317281 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:55.317204    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl_b9fd013c-2c32-4366-8fe2-98c6b8b097c8/istio-proxy/0.log"
Sep 16 02:57:55.635452 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:55.635354    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-gdrj9_3a28e95a-1262-4c3f-82a3-198beec0a7dc/discovery/0.log"
Sep 16 02:57:55.692536 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:55.692505    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-6cd864bc95-vrcw8_4ea77906-c510-4fe3-97c7-ecf122c3a86a/payload-pre-processing/0.log"
Sep 16 02:57:57.239307 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:57.239278    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl_b9fd013c-2c32-4366-8fe2-98c6b8b097c8/istio-proxy/0.log"
Sep 16 02:57:57.574780 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:57.574703    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-gdrj9_3a28e95a-1262-4c3f-82a3-198beec0a7dc/discovery/0.log"
Sep 16 02:57:57.643275 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:57:57.643243    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-6cd864bc95-vrcw8_4ea77906-c510-4fe3-97c7-ecf122c3a86a/payload-pre-processing/0.log"
Sep 16 02:58:01.695304 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:58:01.695262    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4sw86_f085f4b0-6a6b-4c05-b83e-45418e1df86b/kube-multus/0.log"
Sep 16 02:58:01.776436 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:58:01.776406    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5nl9d_0e3d5667-b41e-4ff5-beb3-ebe791b48183/kube-multus-additional-cni-plugins/0.log"
Sep 16 02:58:01.796062 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:58:01.796041    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5nl9d_0e3d5667-b41e-4ff5-beb3-ebe791b48183/egress-router-binary-copy/0.log"
Sep 16 02:58:01.815802 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:58:01.815781    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5nl9d_0e3d5667-b41e-4ff5-beb3-ebe791b48183/cni-plugins/0.log"
Sep 16 02:58:01.835316 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:58:01.835297    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5nl9d_0e3d5667-b41e-4ff5-beb3-ebe791b48183/bond-cni-plugin/0.log"
Sep 16 02:58:01.855780 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:58:01.855763    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5nl9d_0e3d5667-b41e-4ff5-beb3-ebe791b48183/routeoverride-cni/0.log"
Sep 16 02:58:01.875748 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:58:01.875731    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5nl9d_0e3d5667-b41e-4ff5-beb3-ebe791b48183/whereabouts-cni-bincopy/0.log"
Sep 16 02:58:01.895911 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:58:01.895895    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5nl9d_0e3d5667-b41e-4ff5-beb3-ebe791b48183/whereabouts-cni/0.log"
Sep 16 02:58:02.313119 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:58:02.313093    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-p7rcn_57b965f8-cef0-417c-b3a8-8c5c1a0883bf/network-metrics-daemon/0.log"
Sep 16 02:58:02.329277 ip-10-0-137-62 kubenswrapper[2565]: I0916 02:58:02.329259    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-p7rcn_57b965f8-cef0-417c-b3a8-8c5c1a0883bf/kube-rbac-proxy/0.log"